-- Logs begin at Mon 2022-08-01 13:17:54 UTC, end at Mon 2022-08-01 14:41:48 UTC. -- Aug 01 14:07:34.841050 dv-cinder-845990-5-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 01 14:07:34.851503 dv-cinder-845990-5-smb devstack@keystone.service[80128]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 01 14:07:34.854420 dv-cinder-845990-5-smb devstack@keystone.service[80128]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 1 14:07:34 2022] *** Aug 01 14:07:34.854420 dv-cinder-845990-5-smb devstack@keystone.service[80128]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 01 14:07:34.854420 dv-cinder-845990-5-smb devstack@keystone.service[80128]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 01 14:07:34.854420 dv-cinder-845990-5-smb devstack@keystone.service[80128]: nodename: dv-cinder-845990-5-smb Aug 01 14:07:34.854420 dv-cinder-845990-5-smb devstack@keystone.service[80128]: machine: x86_64 Aug 01 14:07:34.854420 dv-cinder-845990-5-smb devstack@keystone.service[80128]: clock source: unix Aug 01 14:07:34.854420 dv-cinder-845990-5-smb devstack@keystone.service[80128]: pcre jit disabled Aug 01 14:07:34.854420 dv-cinder-845990-5-smb devstack@keystone.service[80128]: detected number of CPU cores: 4 Aug 01 14:07:34.854420 dv-cinder-845990-5-smb devstack@keystone.service[80128]: current working directory: / Aug 01 14:07:34.854420 dv-cinder-845990-5-smb devstack@keystone.service[80128]: detected binary path: /usr/bin/uwsgi-core Aug 01 14:07:34.854999 dv-cinder-845990-5-smb devstack@keystone.service[80128]: your processes number limit is 47680 Aug 01 14:07:34.854999 dv-cinder-845990-5-smb devstack@keystone.service[80128]: your memory page size is 4096 bytes Aug 01 14:07:34.854999 dv-cinder-845990-5-smb devstack@keystone.service[80128]: detected max file descriptor number: 2048 Aug 01 14:07:34.854999 dv-cinder-845990-5-smb devstack@keystone.service[80128]: lock engine: pthread robust mutexes Aug 01 14:07:34.854999 dv-cinder-845990-5-smb devstack@keystone.service[80128]: thunder lock: enabled Aug 01 14:07:34.854999 dv-cinder-845990-5-smb devstack@keystone.service[80128]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 01 14:07:34.854999 dv-cinder-845990-5-smb devstack@keystone.service[80128]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 01 14:07:34.893398 dv-cinder-845990-5-smb devstack@keystone.service[80128]: Python main interpreter initialized at 0x55cc036469c0 Aug 01 14:07:34.893398 dv-cinder-845990-5-smb devstack@keystone.service[80128]: python threads support enabled Aug 01 14:07:34.893398 dv-cinder-845990-5-smb devstack@keystone.service[80128]: your server socket listen backlog is limited to 100 connections Aug 01 14:07:34.893398 dv-cinder-845990-5-smb devstack@keystone.service[80128]: your mercy for graceful operations on workers is 90 seconds Aug 01 14:07:34.893739 dv-cinder-845990-5-smb devstack@keystone.service[80128]: mapped 403077 bytes (393 KB) for 2 cores Aug 01 14:07:34.893808 dv-cinder-845990-5-smb devstack@keystone.service[80128]: *** Operational MODE: preforking *** Aug 01 14:07:34.894089 dv-cinder-845990-5-smb devstack@keystone.service[80128]: *** uWSGI is running in multiple interpreter mode *** Aug 01 14:07:34.894089 dv-cinder-845990-5-smb devstack@keystone.service[80128]: spawned uWSGI master process (pid: 80128) Aug 01 14:07:34.894287 dv-cinder-845990-5-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 01 14:07:34.895473 dv-cinder-845990-5-smb devstack@keystone.service[80128]: spawned uWSGI worker 1 (pid: 80141, cores: 1) Aug 01 14:07:34.895473 dv-cinder-845990-5-smb devstack@keystone.service[80128]: spawned uWSGI worker 2 (pid: 80142, cores: 1) Aug 01 14:07:34.895473 dv-cinder-845990-5-smb devstack@keystone.service[80128]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 01 14:07:40.444720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:07:40.444720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: from cryptography.utils import int_from_bytes Aug 01 14:07:40.445990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:07:40.445990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: from cryptography.utils import int_from_bytes Aug 01 14:07:40.446139 dv-cinder-845990-5-smb devstack@keystone.service[80142]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:07:40.446139 dv-cinder-845990-5-smb devstack@keystone.service[80142]: from cryptography.utils import int_from_bytes Aug 01 14:07:40.446569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 01 14:07:40.446569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: from cryptography.utils import int_from_bytes Aug 01 14:07:40.495655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:07:40.495860 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:07:40.496050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] command line args: [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:07:40.496180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 01 14:07:40.496322 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:07:40.496432 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 01 14:07:40.496509 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ================================================================================ {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:07:40.496592 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] command line args: [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 01 14:07:40.496747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] admin_token = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.496855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 01 14:07:40.496994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] config_dir = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.497078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ================================================================================ {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 01 14:07:40.497182 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.497271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] admin_token = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.497350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] config_source = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.497506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] config_dir = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.497590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] debug = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.497692 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.497782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.497960 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] config_source = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.498030 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] debug = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.498094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.498224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.498371 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.498479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.498601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.498717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.498819 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.498935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.499035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.499138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] log_config_append = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.499235 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.499343 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.499447 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] list_limit = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.499555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] log_dir = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.499659 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] log_config_append = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.499762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] log_file = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.499877 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.499983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.500087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] log_dir = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.500087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] log_file = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.500285 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.500368 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.500446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.500519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.500635 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.500723 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.500805 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.500922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.501000 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.501117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.501201 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.501333 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.501418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.501498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.501614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.501742 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.501830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.501972 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.502056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.502201 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.502283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.502426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.502510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.502686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.502778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.502934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.503014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.503178 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.503450 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.503534 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.503630 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] publish_errors = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.503862 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.503992 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.70/identity {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.504093 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.504172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] publish_errors = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.504273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.504362 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.504518 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.504595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.504712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.504805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.504955 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.505034 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] standard_threads = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.505187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.505272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.505418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] standard_threads = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.505495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.505617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.505739 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.505820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] use_journal = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.505917 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] use_json = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.505994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.506095 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] use_stderr = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.506180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.506253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] use_journal = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.506323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] use_syslog = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.506426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] use_json = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.506510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.506614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] use_stderr = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.506759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.506839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] use_syslog = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.507000 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.507078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 01 14:07:40.507249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.507334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.507486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.507570 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.507734 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.507811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.508498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.508587 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.508749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.508832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.508983 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.509060 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.509230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.509315 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.509461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.509537 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.509707 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.509791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.509941 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.510028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.510187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.510269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.510418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.510496 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.510687 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.510781 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.511167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.511257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.511257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.511388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.511388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.511593 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.511669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.511747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.511864 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.511950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.512104 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.512241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.512359 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.512524 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.512622 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.512767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.512877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.513020 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.513126 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.513279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.513357 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.513531 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.513608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.513778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.513862 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.514007 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.514086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.514237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.514329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.514467 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.514545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.514732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.514823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.514963 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.515048 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.515210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.515289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.515438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.515519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.515666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.515753 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.515910 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.515992 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.516140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.516223 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.516375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.516460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.516611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.516689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.516840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.516915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.517070 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.517218 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.517300 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.517372 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.517519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.517597 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.517748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.517835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.517977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.518061 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.518203 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.518281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.518437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.518522 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.518692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.518773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.518930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.519016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.519161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.519255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.519409 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.519486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.519640 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.519718 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.519876 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.519962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.520112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.520196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.520348 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.520453 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.520584 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.520706 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.520812 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.520913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.521041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.521148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.521292 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.521411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.521521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.521620 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.521754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.521837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.521970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.522104 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.522218 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.522296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.522453 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.522533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.522705 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.522786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.522945 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.523038 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.523181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.523304 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.523409 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.523519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.524259 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.524352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.524510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.524590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.524757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.524840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.524994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.525085 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.525231 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.525310 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.525467 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.525546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.525716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.525806 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.525955 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.526034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.526187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.526265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.526429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.526508 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.526688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.526769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.526923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.527012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.527161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.527245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.527394 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.527471 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.527628 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.527707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.527872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.527953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.528107 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.528192 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.528341 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.528425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.528576 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.528655 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.528819 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.528899 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.529057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.529135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.529282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.529357 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.529515 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.529593 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.529746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.529826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.529977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.530064 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.530205 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.530284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.530431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.530508 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.530682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.530762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.530910 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.530989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.531143 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.531228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.531372 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.531458 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.531611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.531690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.531842 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.531919 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.532088 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.532166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.532325 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.532412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.532561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.external = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.532638 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.532791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.532878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.533053 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.533130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.533283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] auth.external = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.533361 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.533513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.533609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.password = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.533743 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] auth.token = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.533830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.533982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.534063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.534218 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.534293 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] auth.password = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.534459 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] auth.token = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.534547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.534712 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.534792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.534950 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.535030 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.535195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.535287 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.535423 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.535502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.535659 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.535739 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.535901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.535988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.536129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.536209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.536362 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] credential.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.536441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.536605 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.536692 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.536850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.536928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.537082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.537161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.537318 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.537405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.537560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.537646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.537794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.537873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.538054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.538147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.538307 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.538387 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.538540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.538638 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.538814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.538904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.539110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.539189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.539373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.539461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.539610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.539698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.539847 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.539936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.540093 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.540172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.540325 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.540412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.540559 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.540639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.540801 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.540880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.541038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.541125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.541266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.541344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.541510 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.541589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.541745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.541835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.541986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.542065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.542220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.542304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.542458 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.542544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.542718 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.542810 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.542965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.543045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.543198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.543348 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.543427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.543499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.543668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.543749 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.543900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.543981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.544135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.544221 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.544380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.544460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.544609 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.544690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.544845 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.544923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.545077 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.545157 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.545308 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.545389 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.545543 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.545621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.545787 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.545865 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.546032 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.546136 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.546285 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.546421 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.546532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.546732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.546826 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.546988 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.547099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.547247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.547329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.547488 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.547578 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.547735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.547817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.547965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.548045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.548200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.548288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.548428 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.548507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.548663 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.548742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.548891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.548980 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.549123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.549204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.549364 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.549443 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.549603 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.549691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.549836 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.549914 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.550068 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.550146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.550313 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.550401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.550540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.550665 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.550802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.550883 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.551034 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.551127 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.551273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.551353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.551499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.551577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.551734 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.551822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.551963 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.552042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.552198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.552277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.552430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.552517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.552681 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.552874 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.552955 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.553115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.553195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.553368 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.553447 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.553614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.553695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.553849 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.553929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.554082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.554161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.554311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.554392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.554539 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.554636 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.554830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.554912 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.555071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.555150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.555306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.555395 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.555542 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.555623 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.555772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.555852 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.556013 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.556101 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.556245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.556323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.556476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.556557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.556711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.556800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.556946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.557026 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.557187 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.557267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.557416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.557503 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.557645 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.557725 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.557878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.557957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.558110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.558198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.558344 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.558461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.558622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.558746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.558827 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.558984 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.559067 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.559231 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.559312 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.559471 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.559678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.559767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.559931 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.560011 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.560165 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.560244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.560411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.560501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.560658 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.560739 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.560896 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.560976 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.561150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.561238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.561380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.561460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.561622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.561703 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.561856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.561942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.562091 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.562170 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.562325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.562403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.562558 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.562667 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.562824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.562903 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.563057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.563136 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.563294 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.563383 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.563527 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.563605 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.563775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.563854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.564025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.564117 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.564288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.564367 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.564531 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.564611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.564775 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.564864 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.565008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.565086 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.565253 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.565333 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.565486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.565572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.565723 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.565802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.565960 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] role.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.566040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.566192 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.566346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] role.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.566423 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.566495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.566681 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.566766 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.566919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.567011 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.567154 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] role.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.567234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.567398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] role.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.567478 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.567628 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.567716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.567874 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.567954 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.568119 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.568198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.568363 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.568443 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.568593 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.568672 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.568841 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.568920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.569085 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.569166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.569330 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.569409 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.569572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.569650 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.569799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.569981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.570062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.570223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.570303 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.571025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.571120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.571281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.571362 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.571532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.571682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.571782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.571917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.572020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.572167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.572272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.572414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.572523 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.572660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.572765 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.572907 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.572987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.573141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.573220 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.573390 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.573471 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.573639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.573718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.573878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.573969 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.574109 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.574189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.574339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.574434 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.574566 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.574711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.574839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.574920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.575074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.575152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.575315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.575408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.575552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.575632 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.575786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.575866 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.576015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.576104 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.576248 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.576329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.576482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.576562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.576726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.576814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.576957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.577036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.577205 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.577410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.577492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.577662 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.577743 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.577896 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.577974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.578135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.578214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.578373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.578455 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.578617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.578700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.578865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.578946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.579124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.579206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.579358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.579438 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.connection = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.579601 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.579691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.579846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.579927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.580074 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.580156 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.580314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.580394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.580549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.580628 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.580787 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.580868 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.connection = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.581022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.581112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.581258 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.581339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.581503 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.581592 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.581738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.581819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.581975 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.582054 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.582208 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.582295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.582438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.582517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.582695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.582778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.582939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.583030 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.583169 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.583250 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.583406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.583485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.583637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.583725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.583801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80141) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:07:40.583875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.584098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.584339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.584567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.584806 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.585045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 01 14:07:40.585213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80142) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 01 14:07:40.613580 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.613811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.614050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.614138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.614364 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.614616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.622447 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.623062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.653028 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.653266 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.653917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.654149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.705915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.706183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.756491 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.756712 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.757482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.757718 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.823419 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.823645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.823812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.823902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.824051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.824157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.824274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.824359 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.824487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.824570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.824700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.824915 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.848402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.848635 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.848810 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.848917 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.849089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.849175 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.849314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.849396 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.849532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.849622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.849749 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.849828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.849964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.850175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.860800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.861015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.874038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.874273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.874380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.874496 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.874615 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.874744 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.874827 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.874972 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.875092 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.875187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.875266 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.875341 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.875409 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80141) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.875556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80142) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 01 14:07:40.892885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.893094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 14:07:40.893250 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.893425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.893508 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 14:07:40.893626 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 14:07:40.893779 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.893896 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.893979 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 01 14:07:40.894155 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.894235 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.894407 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.894489 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.894684 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.894768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.894968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.904361 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.904635 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.904897 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.904980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.905173 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.905253 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.905436 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.905710 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.912055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.912549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.916770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.917045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.917325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.917408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.917606 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.917688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.917884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.917976 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.918143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.918226 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.918408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.918491 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.918702 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.918786 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.918971 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.919052 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.919239 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.919331 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.919502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.919583 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.919768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.920028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.942824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.943350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.944300 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.944581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.944812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.945088 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.949715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.949992 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.950276 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.950406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.950720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.951040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.956915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.957159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.957757 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.958038 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.961322 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.961612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.961903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.962106 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.962234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.962387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.962523 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.962732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.962861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.962999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.963128 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.963517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.963648 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.963951 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.964258 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.964534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.979358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.979643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.982328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.982328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.983566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.985176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.986691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.986989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.988297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.988590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.991358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.993644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.995077 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.996796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:40.998248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.998487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.998795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.999094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.999372 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:40.999655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.000028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.000321 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.000600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.000887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.001167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.001447 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.016815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.017097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.017363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.017626 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.018012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.018295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.018558 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.018841 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.024512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.025654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.026041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.026315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.027212 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.027482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.029132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.029414 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.029714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.029996 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.030234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.030317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.030508 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.030956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.031280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.031570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.041704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.041980 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.042258 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.042536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.042838 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.043110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.043201 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.043382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.043466 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.043732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.044010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.044288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.044558 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.044825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.060717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.060968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.063689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.064210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.066637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.067171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.069149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.069788 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.071290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.071571 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.071850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.071936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.072213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.072488 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.078297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.078902 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.079906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.080475 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.082832 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.083121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.083391 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.083475 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.083673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.083755 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.083949 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.084220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.092449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.092736 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.093016 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.093187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.093467 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.093743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.099873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80141) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.100148 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.100424 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.100682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80142) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 01 14:07:41.100778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.100952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.101035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.101226 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.101309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.101493 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.101646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.102304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.102391 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.102673 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.102774 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.102946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.103029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.103224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.103355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.103486 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.103593 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.103759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.103871 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.104031 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80141) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.104153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.104416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.104686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.104954 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80142) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 01 14:07:41.139454 dv-cinder-845990-5-smb devstack@keystone.service[80142]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55cc036469c0 pid: 80142 (default app) Aug 01 14:07:41.142856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8eb6-f50e-4780-987c-2e9897f2588c None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:41.143146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8eb6-f50e-4780-987c-2e9897f2588c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:41.143235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55cc036469c0 pid: 80141 (default app) Aug 01 14:07:41.143420 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cc8eb6-f50e-4780-987c-2e9897f2588c None None] PATH_INFO: `/v3` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:41.147726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1/1] 10.222.0.70 () {50 vars in 791 bytes} [Mon Aug 1 14:07:41 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:07:48.811697 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875ab22-a0e7-450e-9959-1902338a1332 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:48.812289 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875ab22-a0e7-450e-9959-1902338a1332 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:48.812289 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3875ab22-a0e7-450e-9959-1902338a1332 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:48.816860 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1/2] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:07:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:07:48.822374 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb7ce3-4e1c-42c0-bcbc-9494b18769b7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:48.822832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb7ce3-4e1c-42c0-bcbc-9494b18769b7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:48.822962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb7ce3-4e1c-42c0-bcbc-9494b18769b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:48.894379 dv-cinder-845990-5-smb devstack@keystone.service[80142]: INFO dbcounter [None req-21eb7ce3-4e1c-42c0-bcbc-9494b18769b7 None None] Registered counter for database keystone Aug 01 14:07:48.913428 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG oslo_db.sqlalchemy.engines [None req-21eb7ce3-4e1c-42c0-bcbc-9494b18769b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80142) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:07:48.920392 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writer thread running {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:07:49.105064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG passlib.handlers.bcrypt [None req-21eb7ce3-4e1c-42c0-bcbc-9494b18769b7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80142) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 14:07:49.105390 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG passlib.handlers.bcrypt [None req-21eb7ce3-4e1c-42c0-bcbc-9494b18769b7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80142) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 14:07:49.162879 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-21eb7ce3-4e1c-42c0-bcbc-9494b18769b7 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:07:49.165688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-21eb7ce3-4e1c-42c0-bcbc-9494b18769b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:07:49.295401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 2/3] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:07:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 01 14:07:49.454838 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875ab22-a0e7-450e-9959-1902338a1332 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:49.525033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: INFO dbcounter [None req-3875ab22-a0e7-450e-9959-1902338a1332 None None] Registered counter for database keystone Aug 01 14:07:49.545802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG oslo_db.sqlalchemy.engines [None req-3875ab22-a0e7-450e-9959-1902338a1332 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80141) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 01 14:07:49.551913 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writer thread running {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 01 14:07:49.672055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3875ab22-a0e7-450e-9959-1902338a1332 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:49.676412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fa0830-94d4-4e48-9eb6-4164716e2177 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:49.677046 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa0830-94d4-4e48-9eb6-4164716e2177 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:49.677329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa0830-94d4-4e48-9eb6-4164716e2177 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:49.677604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fa0830-94d4-4e48-9eb6-4164716e2177 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:49.685662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa0830-94d4-4e48-9eb6-4164716e2177 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:49.738161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: WARNING keystone.common.rbac_enforcer.enforcer [None req-24fa0830-94d4-4e48-9eb6-4164716e2177 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 14:07:49.738448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fa0830-94d4-4e48-9eb6-4164716e2177 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:49.747949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 2/4] 10.222.0.70 () {58 vars in 1324 bytes} [Mon Aug 1 14:07:49 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:07:49.754249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb7ce3-4e1c-42c0-bcbc-9494b18769b7 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:49.769197 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb7ce3-4e1c-42c0-bcbc-9494b18769b7 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:49.774199 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f6ca5-ef27-483e-a2cf-c1df72f754a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:49.775348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f6ca5-ef27-483e-a2cf-c1df72f754a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:49.775634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f6ca5-ef27-483e-a2cf-c1df72f754a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:49.775909 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f6ca5-ef27-483e-a2cf-c1df72f754a1 admin admin] PATH_INFO: `/v3/projects/e6b4d136938b4489ad1103924c0d158f` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:49.777421 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f6ca5-ef27-483e-a2cf-c1df72f754a1 admin admin] RBAC: Authorizing `identity:get_project(project_id=e6b4d136938b4489ad1103924c0d158f)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:49.827665 dv-cinder-845990-5-smb devstack@keystone.service[80142]: WARNING keystone.common.rbac_enforcer.enforcer [None req-009f6ca5-ef27-483e-a2cf-c1df72f754a1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 01 14:07:49.828212 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f6ca5-ef27-483e-a2cf-c1df72f754a1 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:49.832642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 3/5] 10.222.0.70 () {56 vars in 1207 bytes} [Mon Aug 1 14:07:49 2022] GET /identity/v3/projects/e6b4d136938b4489ad1103924c0d158f => generated 344 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:07:51.874737 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a5ef8-7b55-4c67-b849-ebab0f68171b None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:51.875283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a5ef8-7b55-4c67-b849-ebab0f68171b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:51.875283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84a5ef8-7b55-4c67-b849-ebab0f68171b None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:51.879422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 3/6] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:07:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:07:51.884747 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799964ef-c0d7-49f2-acbe-a6f99d104d74 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:51.885114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799964ef-c0d7-49f2-acbe-a6f99d104d74 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:51.885305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799964ef-c0d7-49f2-acbe-a6f99d104d74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:51.904994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-799964ef-c0d7-49f2-acbe-a6f99d104d74 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:07:51.906496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-799964ef-c0d7-49f2-acbe-a6f99d104d74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:07:51.915015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 4/7] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:07:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 01 14:07:51.937299 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a5ef8-7b55-4c67-b849-ebab0f68171b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:51.949291 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84a5ef8-7b55-4c67-b849-ebab0f68171b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:51.953482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998a691a-9135-4107-a561-41ff56398d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:51.954087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a691a-9135-4107-a561-41ff56398d52 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:51.954374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a691a-9135-4107-a561-41ff56398d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:51.954680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998a691a-9135-4107-a561-41ff56398d52 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:51.962455 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a691a-9135-4107-a561-41ff56398d52 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:51.964544 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998a691a-9135-4107-a561-41ff56398d52 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:51.973662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 4/8] 10.222.0.70 () {58 vars in 1324 bytes} [Mon Aug 1 14:07:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:07:51.979920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799964ef-c0d7-49f2-acbe-a6f99d104d74 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:51.989037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799964ef-c0d7-49f2-acbe-a6f99d104d74 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:51.994150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcca4fe-a527-42a2-8a3e-912439376bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:51.994812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcca4fe-a527-42a2-8a3e-912439376bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:51.995098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcca4fe-a527-42a2-8a3e-912439376bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:51.995374 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcca4fe-a527-42a2-8a3e-912439376bb3 admin admin] PATH_INFO: `/v3/users/22dd50ff891948b58a7664099f06c392` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:51.996798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcca4fe-a527-42a2-8a3e-912439376bb3 admin admin] RBAC: Authorizing `identity:get_user(user_id=22dd50ff891948b58a7664099f06c392)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:51.998842 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dcca4fe-a527-42a2-8a3e-912439376bb3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:52.000227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 5/9] 10.222.0.70 () {56 vars in 1198 bytes} [Mon Aug 1 14:07:51 2022] GET /identity/v3/users/22dd50ff891948b58a7664099f06c392 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:07:54.057100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ab622-716c-40ad-bc28-82db15f43053 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:54.057625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ab622-716c-40ad-bc28-82db15f43053 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:54.057625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583ab622-716c-40ad-bc28-82db15f43053 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:54.059007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 5/10] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:07:54.064098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c99919-73d4-4ba0-b5a9-f64f878b9e7c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:54.064529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c99919-73d4-4ba0-b5a9-f64f878b9e7c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:54.064795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c99919-73d4-4ba0-b5a9-f64f878b9e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:54.084376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-49c99919-73d4-4ba0-b5a9-f64f878b9e7c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:07:54.085592 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-49c99919-73d4-4ba0-b5a9-f64f878b9e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:07:54.120520 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13edd54-afb9-495a-baf9-81988de5ad24 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:54.120805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13edd54-afb9-495a-baf9-81988de5ad24 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:54.121086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13edd54-afb9-495a-baf9-81988de5ad24 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:54.122403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 6/11] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:07:54.127530 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc5f4-986e-4824-8eb3-aa47fda3b2c1 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:54.127818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc5f4-986e-4824-8eb3-aa47fda3b2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:54.128096 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32dc5f4-986e-4824-8eb3-aa47fda3b2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:54.168959 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 6/12] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:07:54.170775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG passlib.handlers.bcrypt [None req-e32dc5f4-986e-4824-8eb3-aa47fda3b2c1 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80141) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 01 14:07:54.171294 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG passlib.handlers.bcrypt [None req-e32dc5f4-986e-4824-8eb3-aa47fda3b2c1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80141) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 01 14:07:54.190725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c99919-73d4-4ba0-b5a9-f64f878b9e7c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:54.214955 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:54.218034 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e32dc5f4-986e-4824-8eb3-aa47fda3b2c1 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:07:54.219748 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e32dc5f4-986e-4824-8eb3-aa47fda3b2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:07:54.294810 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c99919-73d4-4ba0-b5a9-f64f878b9e7c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:54.321425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 7/13] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:07:54.328400 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca0805-5a51-4c61-98bf-2f0e5a1bc248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:54.329052 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca0805-5a51-4c61-98bf-2f0e5a1bc248 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:54.329336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca0805-5a51-4c61-98bf-2f0e5a1bc248 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:54.329616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ca0805-5a51-4c61-98bf-2f0e5a1bc248 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:54.341971 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ca0805-5a51-4c61-98bf-2f0e5a1bc248 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:07:54.345563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc5f4-986e-4824-8eb3-aa47fda3b2c1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-99ca0805-5a51-4c61-98bf-2f0e5a1bc248 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:07:54.350794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:07:54.351936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:07:54.352935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:07:54.352935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:07:54.352935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:07:54.352935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:07:54.352935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:07:54.352935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:07:54.352935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:07:54.352935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:07:54.352935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:07:54.352935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:07:54.352935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:07:54.352935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:07:54.352935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 7/14] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:07:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:07:54.359601 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca0805-5a51-4c61-98bf-2f0e5a1bc248 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:54.442390 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:54.447047 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32dc5f4-986e-4824-8eb3-aa47fda3b2c1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:54.449223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:54.462142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ca0805-5a51-4c61-98bf-2f0e5a1bc248 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:54.488423 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bf6f9-01a0-4269-ac26-5fed2bb9f8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:54.489290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bf6f9-01a0-4269-ac26-5fed2bb9f8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:54.489666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bf6f9-01a0-4269-ac26-5fed2bb9f8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:54.489935 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7bf6f9-01a0-4269-ac26-5fed2bb9f8e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:54.498872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739ae2f-6660-420a-8ef0-8b70e2b77d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:54.499495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739ae2f-6660-420a-8ef0-8b70e2b77d7d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:54.499774 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739ae2f-6660-420a-8ef0-8b70e2b77d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:54.500047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f739ae2f-6660-420a-8ef0-8b70e2b77d7d None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:54.500772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739ae2f-6660-420a-8ef0-8b70e2b77d7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:07:54.501079 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739ae2f-6660-420a-8ef0-8b70e2b77d7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:54.502494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f739ae2f-6660-420a-8ef0-8b70e2b77d7d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:54.515139 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 8/15] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:07:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:07:54.520681 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739ae2f-6660-420a-8ef0-8b70e2b77d7d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:54.558703 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bf6f9-01a0-4269-ac26-5fed2bb9f8e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:54.560154 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7bf6f9-01a0-4269-ac26-5fed2bb9f8e8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:54.622468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f739ae2f-6660-420a-8ef0-8b70e2b77d7d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:54.663308 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 8/16] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:07:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 14:07:54.670169 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bf6f9-01a0-4269-ac26-5fed2bb9f8e8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:54.673415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:54.771216 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d401e-f8db-48e6-9bd0-da2f764e3043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:54.772231 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d401e-f8db-48e6-9bd0-da2f764e3043 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:54.772717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d401e-f8db-48e6-9bd0-da2f764e3043 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:54.773173 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72d401e-f8db-48e6-9bd0-da2f764e3043 None admin] PATH_INFO: `/v3/users/22dd50ff891948b58a7664099f06c392` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:54.773796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7bf6f9-01a0-4269-ac26-5fed2bb9f8e8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:54.774390 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d401e-f8db-48e6-9bd0-da2f764e3043 None admin] RBAC: Authorizing `identity:get_user(user_id=22dd50ff891948b58a7664099f06c392)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:54.775916 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72d401e-f8db-48e6-9bd0-da2f764e3043 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:54.777519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 9/17] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:07:54 2022] GET /identity/v3/users/22dd50ff891948b58a7664099f06c392 => generated 247 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:07:54.783457 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d401e-f8db-48e6-9bd0-da2f764e3043 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:54.801310 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:54.811622 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ce056-226b-449b-911f-0de52ba71500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:54.812425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ce056-226b-449b-911f-0de52ba71500 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:54.812708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ce056-226b-449b-911f-0de52ba71500 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:54.812979 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7ce056-226b-449b-911f-0de52ba71500 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:54.831263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ce056-226b-449b-911f-0de52ba71500 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:54.832739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7ce056-226b-449b-911f-0de52ba71500 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:54.851113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6f7ce056-226b-449b-911f-0de52ba71500 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:07:54.851113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:07:54.851113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:07:54.851113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:07:54.851113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:07:54.851113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:07:54.851113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:07:54.851113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:07:54.851113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:07:54.851113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:07:54.851113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:07:54.851113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:07:54.851113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:07:54.851113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:07:54.851113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:07:54.852709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:07:54.853562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:07:54.853562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:07:54.853562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:07:54.853562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:07:54.853562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 9/18] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:07:54.858662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ce056-226b-449b-911f-0de52ba71500 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:54.893717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72d401e-f8db-48e6-9bd0-da2f764e3043 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:54.916251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:54.930418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29bf15-be44-4356-8606-f777f004e015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:54.931102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29bf15-be44-4356-8606-f777f004e015 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:54.931381 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29bf15-be44-4356-8606-f777f004e015 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:54.931658 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d29bf15-be44-4356-8606-f777f004e015 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:54.932834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29bf15-be44-4356-8606-f777f004e015 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:54.934284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d29bf15-be44-4356-8606-f777f004e015 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:54.935898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 10/19] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:07:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:07:54.941753 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29bf15-be44-4356-8606-f777f004e015 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:54.963849 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7ce056-226b-449b-911f-0de52ba71500 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:55.000382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95bd767e-42dd-4a67-b4e8-8ce30d3fc736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:55.001107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd767e-42dd-4a67-b4e8-8ce30d3fc736 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:55.001396 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd767e-42dd-4a67-b4e8-8ce30d3fc736 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:55.001726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95bd767e-42dd-4a67-b4e8-8ce30d3fc736 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:55.002487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd767e-42dd-4a67-b4e8-8ce30d3fc736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:07:55.002821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd767e-42dd-4a67-b4e8-8ce30d3fc736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:55.004398 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95bd767e-42dd-4a67-b4e8-8ce30d3fc736 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:55.023560 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 10/20] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:07:55.023835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:55.046534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d29bf15-be44-4356-8606-f777f004e015 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:55.085298 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491fb230-cdd8-45b8-b718-097f4a5d3bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:55.086474 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fb230-cdd8-45b8-b718-097f4a5d3bce None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:55.086738 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fb230-cdd8-45b8-b718-097f4a5d3bce None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:55.087011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491fb230-cdd8-45b8-b718-097f4a5d3bce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:55.087816 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fb230-cdd8-45b8-b718-097f4a5d3bce None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.domain.id=default, user.id=22dd50ff891948b58a7664099f06c392) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:07:55.088123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fb230-cdd8-45b8-b718-097f4a5d3bce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:55.089860 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491fb230-cdd8-45b8-b718-097f4a5d3bce None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:55.110621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 11/21] 10.222.0.70 () {56 vars in 1322 bytes} [Mon Aug 1 14:07:54 2022] GET /identity/v3/role_assignments?user.id=22dd50ff891948b58a7664099f06c392&scope.domain.id=default&role.id=0681632796d144f6a7ac8eca157001ec => generated 233 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:07:57.480608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5592a8-b168-45cd-9816-342a57bb0b92 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:57.481112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5592a8-b168-45cd-9816-342a57bb0b92 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:57.481185 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5592a8-b168-45cd-9816-342a57bb0b92 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:57.482706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 11/22] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:07:57.487822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac21ef-f749-4bed-b22a-09bef98c7de6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:57.488214 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac21ef-f749-4bed-b22a-09bef98c7de6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:57.488383 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eac21ef-f749-4bed-b22a-09bef98c7de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:57.511811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9eac21ef-f749-4bed-b22a-09bef98c7de6 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:07:57.512987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bbb49-8f09-4e3c-9f52-f2c4fd07a4bd None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:57.513268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9eac21ef-f749-4bed-b22a-09bef98c7de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:07:57.513625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bbb49-8f09-4e3c-9f52-f2c4fd07a4bd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:57.514054 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074bbb49-8f09-4e3c-9f52-f2c4fd07a4bd None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:57.515552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 12/23] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:07:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:07:57.523768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b000c54-3b09-4cdf-bcef-88c51404e47a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:57.524262 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b000c54-3b09-4cdf-bcef-88c51404e47a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:57.524681 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b000c54-3b09-4cdf-bcef-88c51404e47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:57.575579 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9b000c54-3b09-4cdf-bcef-88c51404e47a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:07:57.577070 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9b000c54-3b09-4cdf-bcef-88c51404e47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:07:57.633336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 12/24] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:07:57.685243 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac21ef-f749-4bed-b22a-09bef98c7de6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:57.711600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 13/25] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:07:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 01 14:07:57.746129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b000c54-3b09-4cdf-bcef-88c51404e47a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:57.806937 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:57.831443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eac21ef-f749-4bed-b22a-09bef98c7de6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:57.865188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:57.877539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8086810f-5450-4a39-a249-01b6bb1141a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:57.878193 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086810f-5450-4a39-a249-01b6bb1141a5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:57.878467 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086810f-5450-4a39-a249-01b6bb1141a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:57.878916 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8086810f-5450-4a39-a249-01b6bb1141a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:57.890392 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086810f-5450-4a39-a249-01b6bb1141a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:57.892220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8086810f-5450-4a39-a249-01b6bb1141a5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:57.912378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-8086810f-5450-4a39-a249-01b6bb1141a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:07:57.912378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:07:57.912378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:07:57.912378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:07:57.912378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:07:57.912378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:07:57.912378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:07:57.912378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:07:57.912378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:07:57.912378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:07:57.912378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:07:57.912378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:07:57.912378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:07:57.912378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:07:57.912378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:07:57.913244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:07:57.914065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:07:57.914065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:07:57.914065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:07:57.914065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:07:57.916630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 13/26] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:07:57.918277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bf744-2f93-44c7-83b3-a7c740f00f9b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:57.919260 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bf744-2f93-44c7-83b3-a7c740f00f9b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:57.919774 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11bf744-2f93-44c7-83b3-a7c740f00f9b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:57.921853 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 14/27] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:07:57.923666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4592892-ae15-4698-b21f-2c6c95e4a399 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:57.924202 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4592892-ae15-4698-b21f-2c6c95e4a399 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:57.924689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4592892-ae15-4698-b21f-2c6c95e4a399 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:57.926915 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 15/28] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:07:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:07:57.928068 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4592892-ae15-4698-b21f-2c6c95e4a399 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:57.948022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b000c54-3b09-4cdf-bcef-88c51404e47a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:57.990675 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8e326-060e-40fc-97bc-649f4df5b70e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:57.992086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8e326-060e-40fc-97bc-649f4df5b70e None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:57.992837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8e326-060e-40fc-97bc-649f4df5b70e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:57.993311 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c8e326-060e-40fc-97bc-649f4df5b70e None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:57.994395 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8e326-060e-40fc-97bc-649f4df5b70e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:57.996745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c8e326-060e-40fc-97bc-649f4df5b70e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:58.049221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4592892-ae15-4698-b21f-2c6c95e4a399 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:58.081929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:58.094466 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff076b9-08d8-46c9-86fd-27b7de7c28d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:58.095415 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff076b9-08d8-46c9-86fd-27b7de7c28d8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:58.095835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff076b9-08d8-46c9-86fd-27b7de7c28d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:58.096251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff076b9-08d8-46c9-86fd-27b7de7c28d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:58.097115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff076b9-08d8-46c9-86fd-27b7de7c28d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:07:58.097563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff076b9-08d8-46c9-86fd-27b7de7c28d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:58.099193 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff076b9-08d8-46c9-86fd-27b7de7c28d8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:58.125390 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 16/29] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:07:58.127166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305da5b6-41bd-465f-a093-d9336f0e64ce None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:58.127598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305da5b6-41bd-465f-a093-d9336f0e64ce None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:58.128008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305da5b6-41bd-465f-a093-d9336f0e64ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:58.149073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-305da5b6-41bd-465f-a093-d9336f0e64ce None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:07:58.150518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-305da5b6-41bd-465f-a093-d9336f0e64ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:07:58.228573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 17/30] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:07:58.229974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c7934-b7bb-4ef2-a4ee-e6a22a4581f6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:58.230406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c7934-b7bb-4ef2-a4ee-e6a22a4581f6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:58.230804 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04c7934-b7bb-4ef2-a4ee-e6a22a4581f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:58.249593 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b04c7934-b7bb-4ef2-a4ee-e6a22a4581f6 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:07:58.250896 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b04c7934-b7bb-4ef2-a4ee-e6a22a4581f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:07:58.263910 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 14/31] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Aug 1 14:07:57 2022] POST /identity/v3/roles => generated 219 bytes in 518 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:07:58.265226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8e326-060e-40fc-97bc-649f4df5b70e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:58.335886 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 18/32] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:07:58.337757 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c7934-b7bb-4ef2-a4ee-e6a22a4581f6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:58.397509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:58.444643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c8e326-060e-40fc-97bc-649f4df5b70e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:58.453272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:58.471907 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04c7934-b7bb-4ef2-a4ee-e6a22a4581f6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:58.485299 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5a13e-cbac-48ea-96d6-eea9e6769a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:58.486757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5a13e-cbac-48ea-96d6-eea9e6769a27 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:58.487243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5a13e-cbac-48ea-96d6-eea9e6769a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:58.487717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc5a13e-cbac-48ea-96d6-eea9e6769a27 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:58.489114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5a13e-cbac-48ea-96d6-eea9e6769a27 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:58.491540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc5a13e-cbac-48ea-96d6-eea9e6769a27 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:58.517099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7952652-ad66-4d71-a0d5-7f07b5650ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:58.517825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7952652-ad66-4d71-a0d5-7f07b5650ac6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:58.518045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7952652-ad66-4d71-a0d5-7f07b5650ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:58.518319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7952652-ad66-4d71-a0d5-7f07b5650ac6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:58.532875 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 15/33] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 1 14:07:58 2022] POST /identity/v3/projects => generated 301 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:07:58.534174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5a13e-cbac-48ea-96d6-eea9e6769a27 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:58.539144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7952652-ad66-4d71-a0d5-7f07b5650ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-e7952652-ad66-4d71-a0d5-7f07b5650ac6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:07:58.541632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:07:58.542479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:07:58.543376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:07:58.543376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:07:58.543376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:07:58.543376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:07:58.543376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:07:58.543376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:07:58.543376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:07:58.543376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:07:58.543376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:07:58.543376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:07:58.543376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:07:58.543376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:07:58.543376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 19/34] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:07:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:07:58.550748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7952652-ad66-4d71-a0d5-7f07b5650ac6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:58.676302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7952652-ad66-4d71-a0d5-7f07b5650ac6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:58.685271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:58.715726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a8e50-4f46-4356-b016-bd1849c3fb85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:58.716371 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a8e50-4f46-4356-b016-bd1849c3fb85 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:58.716654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a8e50-4f46-4356-b016-bd1849c3fb85 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:58.716931 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a8e50-4f46-4356-b016-bd1849c3fb85 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:58.719606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a8e50-4f46-4356-b016-bd1849c3fb85 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:07:58.719606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a8e50-4f46-4356-b016-bd1849c3fb85 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:58.719606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a8e50-4f46-4356-b016-bd1849c3fb85 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:58.733876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 20/35] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:07:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:07:58.737896 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a8e50-4f46-4356-b016-bd1849c3fb85 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:58.740133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc5a13e-cbac-48ea-96d6-eea9e6769a27 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:58.799834 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eabb1-a713-4851-b0ba-9098d06c0488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:58.800992 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eabb1-a713-4851-b0ba-9098d06c0488 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:58.801541 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eabb1-a713-4851-b0ba-9098d06c0488 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:58.802105 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185eabb1-a713-4851-b0ba-9098d06c0488 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:58.803050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eabb1-a713-4851-b0ba-9098d06c0488 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:58.805437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185eabb1-a713-4851-b0ba-9098d06c0488 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:58.831529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 16/36] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Aug 1 14:07:58 2022] POST /identity/v3/roles => generated 225 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:07:58.855077 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a8e50-4f46-4356-b016-bd1849c3fb85 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:58.894779 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d32713-f4d0-40f6-a840-01dee970b4d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:58.895452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d32713-f4d0-40f6-a840-01dee970b4d7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:58.895724 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d32713-f4d0-40f6-a840-01dee970b4d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:58.896000 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d32713-f4d0-40f6-a840-01dee970b4d7 None admin] PATH_INFO: `/v3/users/22dd50ff891948b58a7664099f06c392` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:58.897262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d32713-f4d0-40f6-a840-01dee970b4d7 None admin] RBAC: Authorizing `identity:get_user(user_id=22dd50ff891948b58a7664099f06c392)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:58.899379 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d32713-f4d0-40f6-a840-01dee970b4d7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:58.901554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 21/37] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:07:58 2022] GET /identity/v3/users/22dd50ff891948b58a7664099f06c392 => generated 247 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:07:58.907460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eabb1-a713-4851-b0ba-9098d06c0488 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:58.939017 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:59.040848 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452252e2-aab1-40df-b275-8e9e237a5ad3 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:59.041275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452252e2-aab1-40df-b275-8e9e237a5ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:59.041662 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452252e2-aab1-40df-b275-8e9e237a5ad3 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:59.047288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 22/38] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:07:59.048924 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3095ecb-d420-42fa-9cb9-7ac0329aac95 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:59.049382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3095ecb-d420-42fa-9cb9-7ac0329aac95 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:59.049764 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3095ecb-d420-42fa-9cb9-7ac0329aac95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:59.060762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185eabb1-a713-4851-b0ba-9098d06c0488 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:59.070847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a3095ecb-d420-42fa-9cb9-7ac0329aac95 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:07:59.072112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a3095ecb-d420-42fa-9cb9-7ac0329aac95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:07:59.102224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378690a7-3eff-46ae-a160-3328a1756dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:59.102934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378690a7-3eff-46ae-a160-3328a1756dc1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:59.103749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378690a7-3eff-46ae-a160-3328a1756dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:59.103950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378690a7-3eff-46ae-a160-3328a1756dc1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:59.105430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378690a7-3eff-46ae-a160-3328a1756dc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:59.107587 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378690a7-3eff-46ae-a160-3328a1756dc1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:59.108581 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:59.109902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 17/39] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:07:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:07:59.111168 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ec7c9-e814-4399-8917-ff4b08337fc4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:59.111465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ec7c9-e814-4399-8917-ff4b08337fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:59.111743 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3ec7c9-e814-4399-8917-ff4b08337fc4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:59.112972 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 18/40] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:07:59.116062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ec7c9-e814-4399-8917-ff4b08337fc4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:59.153490 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 23/41] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:07:59.155060 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f93d60-d9b2-4802-a1f2-929be693aed6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:59.155352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f93d60-d9b2-4802-a1f2-929be693aed6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:59.155630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f93d60-d9b2-4802-a1f2-929be693aed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:59.175225 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-08f93d60-d9b2-4802-a1f2-929be693aed6 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:07:59.176407 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-08f93d60-d9b2-4802-a1f2-929be693aed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:07:59.210397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:59.227258 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3ec7c9-e814-4399-8917-ff4b08337fc4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:59.246121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 24/42] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:07:59.258725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f93d60-d9b2-4802-a1f2-929be693aed6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:59.261026 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b2d8e-9dcd-4580-873b-00cf7ed8d58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:59.261702 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b2d8e-9dcd-4580-873b-00cf7ed8d58b None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:59.261987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b2d8e-9dcd-4580-873b-00cf7ed8d58b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:59.262269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345b2d8e-9dcd-4580-873b-00cf7ed8d58b None admin] PATH_INFO: `/v3/domains/default/users/22dd50ff891948b58a7664099f06c392/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:59.264470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b2d8e-9dcd-4580-873b-00cf7ed8d58b None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=22dd50ff891948b58a7664099f06c392, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:59.265930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345b2d8e-9dcd-4580-873b-00cf7ed8d58b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:59.282774 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 19/43] 10.222.0.70 () {58 vars in 1361 bytes} [Mon Aug 1 14:07:59 2022] PUT /identity/v3/domains/default/users/22dd50ff891948b58a7664099f06c392/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:07:59.283821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b2d8e-9dcd-4580-873b-00cf7ed8d58b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:59.368712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:07:59.378836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f93d60-d9b2-4802-a1f2-929be693aed6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:59.412740 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345b2d8e-9dcd-4580-873b-00cf7ed8d58b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:59.420237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e3db9-b13a-445f-a519-c441065c948f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:59.421424 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e3db9-b13a-445f-a519-c441065c948f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:59.421717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e3db9-b13a-445f-a519-c441065c948f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:59.422064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8e3db9-b13a-445f-a519-c441065c948f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:59.423752 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e3db9-b13a-445f-a519-c441065c948f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:59.425600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8e3db9-b13a-445f-a519-c441065c948f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:59.427315 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 25/44] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:07:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:07:59.434012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e3db9-b13a-445f-a519-c441065c948f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:07:59.456049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda2999a-2b75-456c-97df-b897960cdef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:59.456679 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2999a-2b75-456c-97df-b897960cdef5 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:59.456964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2999a-2b75-456c-97df-b897960cdef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:59.457236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda2999a-2b75-456c-97df-b897960cdef5 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:59.457948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2999a-2b75-456c-97df-b897960cdef5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:59.459490 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda2999a-2b75-456c-97df-b897960cdef5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:59.476150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 20/45] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Aug 1 14:07:59 2022] POST /identity/v3/roles => generated 223 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:07:59.551355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8e3db9-b13a-445f-a519-c441065c948f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:07:59.590317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41c07fd-8dfb-4411-b7a4-8f4e0db7d1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:07:59.591135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c07fd-8dfb-4411-b7a4-8f4e0db7d1ad None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:07:59.591500 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c07fd-8dfb-4411-b7a4-8f4e0db7d1ad None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:07:59.591930 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41c07fd-8dfb-4411-b7a4-8f4e0db7d1ad None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:07:59.592696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c07fd-8dfb-4411-b7a4-8f4e0db7d1ad None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:07:59.594263 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41c07fd-8dfb-4411-b7a4-8f4e0db7d1ad None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:07:59.731939 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 26/46] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 1 14:07:59 2022] POST /identity/v3/projects => generated 312 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:08:01.283470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3706a-4d18-490e-abda-2a4a55fa9afa None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:01.283980 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3706a-4d18-490e-abda-2a4a55fa9afa None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:01.283980 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa3706a-4d18-490e-abda-2a4a55fa9afa None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:01.285330 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 21/47] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:01.290863 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519256aa-a92a-4ead-b86b-346248a10af1 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:01.291251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519256aa-a92a-4ead-b86b-346248a10af1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:01.291438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519256aa-a92a-4ead-b86b-346248a10af1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:01.310185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-519256aa-a92a-4ead-b86b-346248a10af1 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:01.311749 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-519256aa-a92a-4ead-b86b-346248a10af1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:01.323035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:01.380364 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 27/48] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:01.403494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3706a-4d18-490e-abda-2a4a55fa9afa None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:01.412358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:01.507078 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa3706a-4d18-490e-abda-2a4a55fa9afa None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:01.540517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e718b-6e75-4776-9eb7-55e2f7dc24e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:01.541154 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e718b-6e75-4776-9eb7-55e2f7dc24e8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:01.541436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e718b-6e75-4776-9eb7-55e2f7dc24e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:01.541710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7e718b-6e75-4776-9eb7-55e2f7dc24e8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:01.553369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7e718b-6e75-4776-9eb7-55e2f7dc24e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6b7e718b-6e75-4776-9eb7-55e2f7dc24e8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:01.559991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:01.560986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:01.562062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:01.562062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:01.562062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:01.562062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:01.562062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:01.562062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:01.562062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:01.562062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:01.562062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:01.562062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:01.562062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:01.562062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:01.562062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 22/49] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:08:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:01.566917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519256aa-a92a-4ead-b86b-346248a10af1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:01.666680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519256aa-a92a-4ead-b86b-346248a10af1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:01.700490 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ee483a-b0ef-4730-a0c3-ceb9071637fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:01.701115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee483a-b0ef-4730-a0c3-ceb9071637fc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:01.701402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee483a-b0ef-4730-a0c3-ceb9071637fc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:01.701681 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ee483a-b0ef-4730-a0c3-ceb9071637fc None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:01.702402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee483a-b0ef-4730-a0c3-ceb9071637fc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:01.702746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee483a-b0ef-4730-a0c3-ceb9071637fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:01.704286 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59ee483a-b0ef-4730-a0c3-ceb9071637fc None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:01.712427 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 28/50] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:01.718429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e718b-6e75-4776-9eb7-55e2f7dc24e8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:01.745113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346eea0-2df6-4f74-9626-1d514ed43086 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:01.745408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346eea0-2df6-4f74-9626-1d514ed43086 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:01.745689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d346eea0-2df6-4f74-9626-1d514ed43086 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:01.747083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 29/51] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:08:01.751906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff5680-e575-412a-b167-43ec94331144 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:01.752199 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff5680-e575-412a-b167-43ec94331144 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:01.752481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cff5680-e575-412a-b167-43ec94331144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:01.769894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7cff5680-e575-412a-b167-43ec94331144 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:01.771121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7cff5680-e575-412a-b167-43ec94331144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:01.773051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:01.787300 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:01.823181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7e718b-6e75-4776-9eb7-55e2f7dc24e8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:01.838235 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 30/52] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:01.857265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa015f77-9b29-4081-bec3-b0c4c90d5dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:01.857914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa015f77-9b29-4081-bec3-b0c4c90d5dfe None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:01.858199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa015f77-9b29-4081-bec3-b0c4c90d5dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:01.858480 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa015f77-9b29-4081-bec3-b0c4c90d5dfe None admin] PATH_INFO: `/v3/users/22dd50ff891948b58a7664099f06c392` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:01.859787 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa015f77-9b29-4081-bec3-b0c4c90d5dfe None admin] RBAC: Authorizing `identity:get_user(user_id=22dd50ff891948b58a7664099f06c392)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:01.861262 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa015f77-9b29-4081-bec3-b0c4c90d5dfe None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:01.861633 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff5680-e575-412a-b167-43ec94331144 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:01.862909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 23/53] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:01 2022] GET /identity/v3/users/22dd50ff891948b58a7664099f06c392 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:01.868209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa015f77-9b29-4081-bec3-b0c4c90d5dfe None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:01.958598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cff5680-e575-412a-b167-43ec94331144 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:01.967675 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa015f77-9b29-4081-bec3-b0c4c90d5dfe None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:01.993836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b7f29-c0fb-49bb-ba06-d130175191c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:01.994497 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b7f29-c0fb-49bb-ba06-d130175191c4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:01.994815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b7f29-c0fb-49bb-ba06-d130175191c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:01.995093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807b7f29-c0fb-49bb-ba06-d130175191c4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:01.996268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b7f29-c0fb-49bb-ba06-d130175191c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:01.997793 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807b7f29-c0fb-49bb-ba06-d130175191c4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:01.999375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 31/54] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:02.004832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b7f29-c0fb-49bb-ba06-d130175191c4 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:02.005168 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aac0a4-9029-4a19-9683-f1fbb36877bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:02.005818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aac0a4-9029-4a19-9683-f1fbb36877bc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:02.006103 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aac0a4-9029-4a19-9683-f1fbb36877bc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:02.006381 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aac0a4-9029-4a19-9683-f1fbb36877bc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:02.007613 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aac0a4-9029-4a19-9683-f1fbb36877bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:02.009061 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aac0a4-9029-4a19-9683-f1fbb36877bc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:02.010676 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 24/55] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:02.013236 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:02.016405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aac0a4-9029-4a19-9683-f1fbb36877bc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:02.019169 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:02.106237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807b7f29-c0fb-49bb-ba06-d130175191c4 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:02.117409 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aac0a4-9029-4a19-9683-f1fbb36877bc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:02.140866 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c724196-7e91-4dc8-8330-f9c811764677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:02.141487 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c724196-7e91-4dc8-8330-f9c811764677 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:02.141775 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c724196-7e91-4dc8-8330-f9c811764677 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:02.142050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c724196-7e91-4dc8-8330-f9c811764677 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:02.142762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c724196-7e91-4dc8-8330-f9c811764677 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:02.144236 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c724196-7e91-4dc8-8330-f9c811764677 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:02.151102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b29670-3a4d-4bd8-9b12-f572325c280e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:02.151719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b29670-3a4d-4bd8-9b12-f572325c280e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:02.151998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b29670-3a4d-4bd8-9b12-f572325c280e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:02.152271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b29670-3a4d-4bd8-9b12-f572325c280e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:02.153052 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b29670-3a4d-4bd8-9b12-f572325c280e None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.domain.id=default, user.id=22dd50ff891948b58a7664099f06c392) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:02.153416 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b29670-3a4d-4bd8-9b12-f572325c280e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:02.154908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b29670-3a4d-4bd8-9b12-f572325c280e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:02.162782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 25/56] 10.222.0.70 () {56 vars in 1322 bytes} [Mon Aug 1 14:08:02 2022] GET /identity/v3/role_assignments?user.id=22dd50ff891948b58a7664099f06c392&scope.domain.id=default&role.id=0681632796d144f6a7ac8eca157001ec => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:02.177093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 32/57] 10.222.0.70 () {60 vars in 1140 bytes} [Mon Aug 1 14:08:02 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:08:04.193424 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83192015-a7b9-4650-add4-0b16a5602491 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:04.193928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83192015-a7b9-4650-add4-0b16a5602491 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:04.194035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83192015-a7b9-4650-add4-0b16a5602491 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:04.196098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 26/58] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:04.201360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46337f-7d85-45c1-bf1b-b4fec63a08e6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:04.201772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46337f-7d85-45c1-bf1b-b4fec63a08e6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:04.201918 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46337f-7d85-45c1-bf1b-b4fec63a08e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:04.219934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2e46337f-7d85-45c1-bf1b-b4fec63a08e6 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:04.221101 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2e46337f-7d85-45c1-bf1b-b4fec63a08e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:04.272723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:04.286257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 33/59] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:04.309881 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83192015-a7b9-4650-add4-0b16a5602491 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:04.380713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:04.415946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83192015-a7b9-4650-add4-0b16a5602491 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:04.448989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8258c9dd-9e39-4c37-ba3f-0f1128245bf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:04.449625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258c9dd-9e39-4c37-ba3f-0f1128245bf1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:04.449909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258c9dd-9e39-4c37-ba3f-0f1128245bf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:04.450189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8258c9dd-9e39-4c37-ba3f-0f1128245bf1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:04.451375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258c9dd-9e39-4c37-ba3f-0f1128245bf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:04.452837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8258c9dd-9e39-4c37-ba3f-0f1128245bf1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:04.454440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 27/60] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:04.459959 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46337f-7d85-45c1-bf1b-b4fec63a08e6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:04.556113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e46337f-7d85-45c1-bf1b-b4fec63a08e6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:04.588711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafaf25-f4f6-4e4e-b38a-3f0a30900bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:04.589319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafaf25-f4f6-4e4e-b38a-3f0a30900bf8 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:04.589605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafaf25-f4f6-4e4e-b38a-3f0a30900bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:04.589882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafaf25-f4f6-4e4e-b38a-3f0a30900bf8 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:04.590559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafaf25-f4f6-4e4e-b38a-3f0a30900bf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:04.592044 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafaf25-f4f6-4e4e-b38a-3f0a30900bf8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:04.634613 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 34/61] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:08:04 2022] POST /identity/v3/users => generated 275 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:08:07.780414 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d3fc1-0d2b-49b0-a5ae-72696360fc9b None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:07.780923 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d3fc1-0d2b-49b0-a5ae-72696360fc9b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:07.781040 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d3fc1-0d2b-49b0-a5ae-72696360fc9b None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:07.782470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 28/62] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:07.788240 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9ee2c-7b73-406b-9af5-367d17bf66b2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:07.789701 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9ee2c-7b73-406b-9af5-367d17bf66b2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:07.790200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d9ee2c-7b73-406b-9af5-367d17bf66b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:07.819598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-74d9ee2c-7b73-406b-9af5-367d17bf66b2 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:07.821674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-74d9ee2c-7b73-406b-9af5-367d17bf66b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:07.871941 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:07.910022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 35/63] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:07.937633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d3fc1-0d2b-49b0-a5ae-72696360fc9b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:08.089957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9da805-2668-4cdc-af4f-a5b0cb84ff21 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.090634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9da805-2668-4cdc-af4f-a5b0cb84ff21 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.091116 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9da805-2668-4cdc-af4f-a5b0cb84ff21 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.092838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 36/64] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:08:08.095186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04596bf1-4ed8-453d-891d-dc23da893d05 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.095726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04596bf1-4ed8-453d-891d-dc23da893d05 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.096209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04596bf1-4ed8-453d-891d-dc23da893d05 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.097667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 37/65] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:08.097771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d3fc1-0d2b-49b0-a5ae-72696360fc9b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:08.103190 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a1373-196c-4dda-88d0-75703de4a780 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.103704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a1373-196c-4dda-88d0-75703de4a780 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.104208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6a1373-196c-4dda-88d0-75703de4a780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.122486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9d6a1373-196c-4dda-88d0-75703de4a780 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:08.124029 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9d6a1373-196c-4dda-88d0-75703de4a780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:08.134322 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d74008e-aef3-42bf-8fcb-5e90f7e242f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:08.135046 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74008e-aef3-42bf-8fcb-5e90f7e242f7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.135297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74008e-aef3-42bf-8fcb-5e90f7e242f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.135563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d74008e-aef3-42bf-8fcb-5e90f7e242f7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.137444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:08.147512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d74008e-aef3-42bf-8fcb-5e90f7e242f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0d74008e-aef3-42bf-8fcb-5e90f7e242f7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:08.153691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:08.154768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:08.155790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:08.155790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:08.155790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:08.155790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:08.155790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:08.155790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:08.155790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:08.155790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:08.155790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:08.155790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:08.155790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:08.155790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:08.157733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 29/66] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:08.159150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479a243-4945-437b-8b02-8bcb547625cf None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.159571 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479a243-4945-437b-8b02-8bcb547625cf None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.159982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a479a243-4945-437b-8b02-8bcb547625cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.178315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a479a243-4945-437b-8b02-8bcb547625cf None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:08.180089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a479a243-4945-437b-8b02-8bcb547625cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:08.206698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 38/67] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:08.207747 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a1373-196c-4dda-88d0-75703de4a780 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:08.261776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 30/68] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:08.262657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479a243-4945-437b-8b02-8bcb547625cf None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:08.327706 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6a1373-196c-4dda-88d0-75703de4a780 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:08.331468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:08.363374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a479a243-4945-437b-8b02-8bcb547625cf None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:08.363672 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6ab16-8252-4b2b-8668-65b2dcdc4d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:08.364296 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6ab16-8252-4b2b-8668-65b2dcdc4d0b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.364583 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6ab16-8252-4b2b-8668-65b2dcdc4d0b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.364861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6ab16-8252-4b2b-8668-65b2dcdc4d0b None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.365580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6ab16-8252-4b2b-8668-65b2dcdc4d0b None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:08.365890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6ab16-8252-4b2b-8668-65b2dcdc4d0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:08.367858 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6ab16-8252-4b2b-8668-65b2dcdc4d0b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:08.376200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 39/69] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:08.377354 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182652bd-2535-47e0-a9ca-489df12c673f None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.377644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182652bd-2535-47e0-a9ca-489df12c673f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.377931 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182652bd-2535-47e0-a9ca-489df12c673f None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.379167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 40/70] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:08.380334 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee318e1-da1b-4dff-8793-1038ee02afba None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.380777 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee318e1-da1b-4dff-8793-1038ee02afba None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.381218 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee318e1-da1b-4dff-8793-1038ee02afba None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.382555 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 41/71] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:08.383709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee318e1-da1b-4dff-8793-1038ee02afba None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:08.393470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:08.406915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a794a2-5a2c-4c31-87a8-a192bc8faf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:08.407123 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a794a2-5a2c-4c31-87a8-a192bc8faf5b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.407336 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a794a2-5a2c-4c31-87a8-a192bc8faf5b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.407606 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a794a2-5a2c-4c31-87a8-a192bc8faf5b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.418952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a794a2-5a2c-4c31-87a8-a192bc8faf5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-49a794a2-5a2c-4c31-87a8-a192bc8faf5b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:08.423863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:08.424752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:08.425686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:08.425686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:08.425686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:08.425686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:08.425686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:08.425686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:08.425686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:08.425686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:08.425686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:08.425686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:08.425686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:08.425686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:08.425686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 31/72] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:08:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:08.426729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a794a2-5a2c-4c31-87a8-a192bc8faf5b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:08.502966 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee318e1-da1b-4dff-8793-1038ee02afba None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:08.524335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a794a2-5a2c-4c31-87a8-a192bc8faf5b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:08.536516 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e40ff9b-0977-46dc-8ddc-635dde54283f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:08.537158 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40ff9b-0977-46dc-8ddc-635dde54283f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.537442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40ff9b-0977-46dc-8ddc-635dde54283f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.537717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e40ff9b-0977-46dc-8ddc-635dde54283f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.547724 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e40ff9b-0977-46dc-8ddc-635dde54283f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-2e40ff9b-0977-46dc-8ddc-635dde54283f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:08.553045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:08.553920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:08.555262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:08.555262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:08.555262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:08.555262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:08.555262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:08.555262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:08.555262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:08.555262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:08.555262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:08.555262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:08.555262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:08.555262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:08.555262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 42/73] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:08:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:08.556473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e803d85-aaea-43c7-b1aa-2a2e39e23deb None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.556473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e803d85-aaea-43c7-b1aa-2a2e39e23deb None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.556473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e803d85-aaea-43c7-b1aa-2a2e39e23deb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.559142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41535d2-30e8-4493-8eda-ee94f531c3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:08.559791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41535d2-30e8-4493-8eda-ee94f531c3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.560077 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41535d2-30e8-4493-8eda-ee94f531c3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.560354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41535d2-30e8-4493-8eda-ee94f531c3b6 None admin] PATH_INFO: `/v3/users/c37e568c83a64a37acb7f86a4a1011b0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.573789 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-5e803d85-aaea-43c7-b1aa-2a2e39e23deb None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:08.575011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5e803d85-aaea-43c7-b1aa-2a2e39e23deb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:08.577017 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41535d2-30e8-4493-8eda-ee94f531c3b6 None admin] RBAC: Authorizing `identity:get_user(user_id=c37e568c83a64a37acb7f86a4a1011b0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:08.578494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41535d2-30e8-4493-8eda-ee94f531c3b6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:08.580187 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 32/74] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:08 2022] GET /identity/v3/users/c37e568c83a64a37acb7f86a4a1011b0 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:08.581405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac22f3-50cb-4213-a064-ca8aeb922054 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.581693 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac22f3-50cb-4213-a064-ca8aeb922054 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.581983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dac22f3-50cb-4213-a064-ca8aeb922054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.598075 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:08.599325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8dac22f3-50cb-4213-a064-ca8aeb922054 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:08.600801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8dac22f3-50cb-4213-a064-ca8aeb922054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:08.637872 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:08.647657 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 43/75] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:08.651843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e803d85-aaea-43c7-b1aa-2a2e39e23deb None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:08.673726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 33/76] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:08.674589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac22f3-50cb-4213-a064-ca8aeb922054 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:08.769102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e803d85-aaea-43c7-b1aa-2a2e39e23deb None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:08.779136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dac22f3-50cb-4213-a064-ca8aeb922054 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:08.803082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b8757-40fc-4b1b-80cb-e96f9dab25e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:08.803705 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b8757-40fc-4b1b-80cb-e96f9dab25e9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.803992 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b8757-40fc-4b1b-80cb-e96f9dab25e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.804268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8b8757-40fc-4b1b-80cb-e96f9dab25e9 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.805565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b8757-40fc-4b1b-80cb-e96f9dab25e9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:08.805867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b8757-40fc-4b1b-80cb-e96f9dab25e9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:08.807306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8b8757-40fc-4b1b-80cb-e96f9dab25e9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:08.815570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 44/77] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:08:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:08.816282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b8757-40fc-4b1b-80cb-e96f9dab25e9 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:08.821567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75548e9-135e-43e2-86d8-27f0d1dd7c4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:08.822195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75548e9-135e-43e2-86d8-27f0d1dd7c4f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.822480 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75548e9-135e-43e2-86d8-27f0d1dd7c4f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.822785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75548e9-135e-43e2-86d8-27f0d1dd7c4f None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.823509 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75548e9-135e-43e2-86d8-27f0d1dd7c4f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:08.823817 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75548e9-135e-43e2-86d8-27f0d1dd7c4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:08.825211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75548e9-135e-43e2-86d8-27f0d1dd7c4f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:08.834740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:08.837475 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 34/78] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:08.838541 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75548e9-135e-43e2-86d8-27f0d1dd7c4f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:08.875950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:08.919144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8b8757-40fc-4b1b-80cb-e96f9dab25e9 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:08.943972 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75548e9-135e-43e2-86d8-27f0d1dd7c4f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:08.952004 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cc328-c615-4998-a6b1-15a76550b988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:08.952627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cc328-c615-4998-a6b1-15a76550b988 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.952910 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cc328-c615-4998-a6b1-15a76550b988 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.953184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4cc328-c615-4998-a6b1-15a76550b988 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.978719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19a622-2809-41d2-a839-be6cc453af5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:08.979360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a622-2809-41d2-a839-be6cc453af5b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:08.979644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a622-2809-41d2-a839-be6cc453af5b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:08.979919 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d19a622-2809-41d2-a839-be6cc453af5b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:08.981098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19a622-2809-41d2-a839-be6cc453af5b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:08.982559 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d19a622-2809-41d2-a839-be6cc453af5b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:08.984189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 35/79] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:08.984943 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19a622-2809-41d2-a839-be6cc453af5b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:09.026267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cc328-c615-4998-a6b1-15a76550b988 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:09.027802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4cc328-c615-4998-a6b1-15a76550b988 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:09.045533 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:09.082937 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d19a622-2809-41d2-a839-be6cc453af5b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:09.084491 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:09.118446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8840f4-b8c9-4314-856b-d00f087b8739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:09.119112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8840f4-b8c9-4314-856b-d00f087b8739 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:09.119397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8840f4-b8c9-4314-856b-d00f087b8739 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:09.119674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8840f4-b8c9-4314-856b-d00f087b8739 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:09.128171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 45/80] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:09.129015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cc328-c615-4998-a6b1-15a76550b988 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:09.129720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8840f4-b8c9-4314-856b-d00f087b8739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-dd8840f4-b8c9-4314-856b-d00f087b8739 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:09.134733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:09.135800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:09.136732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:09.136732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:09.136732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:09.136732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:09.136732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:09.136732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:09.136732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:09.136732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:09.136732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:09.136732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:09.136732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:09.136732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:09.136732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 36/81] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:09.136732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8840f4-b8c9-4314-856b-d00f087b8739 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:09.234338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4cc328-c615-4998-a6b1-15a76550b988 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:09.235038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8840f4-b8c9-4314-856b-d00f087b8739 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:09.252741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:09.269657 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90cc71-a42a-42c3-a6ec-fca250c6a960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:09.269807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebf4d5-ff78-4298-9eae-2dbb6db11495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:09.270298 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90cc71-a42a-42c3-a6ec-fca250c6a960 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:09.270442 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebf4d5-ff78-4298-9eae-2dbb6db11495 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:09.270591 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90cc71-a42a-42c3-a6ec-fca250c6a960 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:09.270761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebf4d5-ff78-4298-9eae-2dbb6db11495 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:09.270879 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c90cc71-a42a-42c3-a6ec-fca250c6a960 None admin] PATH_INFO: `/v3/users/c37e568c83a64a37acb7f86a4a1011b0` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:09.271042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebf4d5-ff78-4298-9eae-2dbb6db11495 None admin] PATH_INFO: `/v3/users/22dd50ff891948b58a7664099f06c392` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:09.272044 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90cc71-a42a-42c3-a6ec-fca250c6a960 None admin] RBAC: Authorizing `identity:get_user(user_id=c37e568c83a64a37acb7f86a4a1011b0)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:09.272221 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebf4d5-ff78-4298-9eae-2dbb6db11495 None admin] RBAC: Authorizing `identity:get_user(user_id=22dd50ff891948b58a7664099f06c392)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:09.274036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c90cc71-a42a-42c3-a6ec-fca250c6a960 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:09.274177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ebf4d5-ff78-4298-9eae-2dbb6db11495 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:09.275667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 46/82] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:09 2022] GET /identity/v3/users/c37e568c83a64a37acb7f86a4a1011b0 => generated 275 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:09.276041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 37/83] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:09 2022] GET /identity/v3/users/22dd50ff891948b58a7664099f06c392 => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:09.276404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90cc71-a42a-42c3-a6ec-fca250c6a960 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:09.280927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebf4d5-ff78-4298-9eae-2dbb6db11495 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:09.311450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:09.375437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c90cc71-a42a-42c3-a6ec-fca250c6a960 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:09.380728 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ebf4d5-ff78-4298-9eae-2dbb6db11495 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:09.409340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32816d7a-acef-4303-aa6c-82397786da54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:09.409951 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32816d7a-acef-4303-aa6c-82397786da54 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:09.410234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32816d7a-acef-4303-aa6c-82397786da54 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:09.410504 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32816d7a-acef-4303-aa6c-82397786da54 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:09.411264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32816d7a-acef-4303-aa6c-82397786da54 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:09.412799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32816d7a-acef-4303-aa6c-82397786da54 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:09.414690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f298a-6436-43df-a6fd-d2ebfee9db23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:09.415327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f298a-6436-43df-a6fd-d2ebfee9db23 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:09.415612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f298a-6436-43df-a6fd-d2ebfee9db23 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:09.415890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202f298a-6436-43df-a6fd-d2ebfee9db23 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:09.417063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f298a-6436-43df-a6fd-d2ebfee9db23 None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:09.418490 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202f298a-6436-43df-a6fd-d2ebfee9db23 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:09.420187 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 38/84] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:09 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:09.420939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f298a-6436-43df-a6fd-d2ebfee9db23 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:09.438748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 47/85] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:08:09 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:08:09.439572 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32816d7a-acef-4303-aa6c-82397786da54 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:09.492263 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:09.534631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:09.539447 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202f298a-6436-43df-a6fd-d2ebfee9db23 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:09.559068 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32816d7a-acef-4303-aa6c-82397786da54 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:09.578347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794cc07-1801-4f6c-964e-ad6c757c276a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:09.579104 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794cc07-1801-4f6c-964e-ad6c757c276a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:09.579406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794cc07-1801-4f6c-964e-ad6c757c276a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:09.579686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794cc07-1801-4f6c-964e-ad6c757c276a None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:09.580413 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794cc07-1801-4f6c-964e-ad6c757c276a None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:09.581131 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794cc07-1801-4f6c-964e-ad6c757c276a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:09.582115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794cc07-1801-4f6c-964e-ad6c757c276a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:09.592322 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 39/86] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:09.592696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794cc07-1801-4f6c-964e-ad6c757c276a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:09.598493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9a730-6bed-43ed-8e77-11628a296e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:09.599830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9a730-6bed-43ed-8e77-11628a296e1e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:09.599830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9a730-6bed-43ed-8e77-11628a296e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:09.599830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f9a730-6bed-43ed-8e77-11628a296e1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:09.685692 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9a730-6bed-43ed-8e77-11628a296e1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:09.687227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f9a730-6bed-43ed-8e77-11628a296e1e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:09.716648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794cc07-1801-4f6c-964e-ad6c757c276a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:09.743347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:09.763975 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d23911-707a-4248-a761-33a5e7548725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:09.764646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d23911-707a-4248-a761-33a5e7548725 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:09.764891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d23911-707a-4248-a761-33a5e7548725 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:09.765171 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d23911-707a-4248-a761-33a5e7548725 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:09.797417 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:09.814788 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 48/87] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:09.816559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9a730-6bed-43ed-8e77-11628a296e1e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:09.841532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d23911-707a-4248-a761-33a5e7548725 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:09.843170 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d23911-707a-4248-a761-33a5e7548725 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:09.939409 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f9a730-6bed-43ed-8e77-11628a296e1e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:09.975765 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 40/88] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:09.980570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca6951-90d5-4964-9edf-c6aa5dc99769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:09.980570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca6951-90d5-4964-9edf-c6aa5dc99769 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:09.980570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca6951-90d5-4964-9edf-c6aa5dc99769 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:09.980570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bca6951-90d5-4964-9edf-c6aa5dc99769 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:09.980873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca6951-90d5-4964-9edf-c6aa5dc99769 None admin] RBAC: Adding query filter params (role.id=125ef16e078848b2bd772db91d4115d4, scope.project.id=cf19eb89de594cdaaf28c40785f2dfac, user.id=c37e568c83a64a37acb7f86a4a1011b0) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:09.980873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca6951-90d5-4964-9edf-c6aa5dc99769 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:09.980873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bca6951-90d5-4964-9edf-c6aa5dc99769 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:09.982109 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d23911-707a-4248-a761-33a5e7548725 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:09.987580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 49/89] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:09 2022] GET /identity/v3/role_assignments?user.id=c37e568c83a64a37acb7f86a4a1011b0&scope.project.id=cf19eb89de594cdaaf28c40785f2dfac&role.id=125ef16e078848b2bd772db91d4115d4 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:09.988815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca6951-90d5-4964-9edf-c6aa5dc99769 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:09.998704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:10.067233 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:10.121451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d23911-707a-4248-a761-33a5e7548725 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:10.156883 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bca6951-90d5-4964-9edf-c6aa5dc99769 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:10.167161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814abeae-1e85-453f-bece-fb7a1b50d08d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:10.167829 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814abeae-1e85-453f-bece-fb7a1b50d08d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:10.168114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814abeae-1e85-453f-bece-fb7a1b50d08d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:10.168384 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814abeae-1e85-453f-bece-fb7a1b50d08d None admin] PATH_INFO: `/v3/users/c37e568c83a64a37acb7f86a4a1011b0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:10.169632 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814abeae-1e85-453f-bece-fb7a1b50d08d None admin] RBAC: Authorizing `identity:get_user(user_id=c37e568c83a64a37acb7f86a4a1011b0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:10.173653 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814abeae-1e85-453f-bece-fb7a1b50d08d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:10.173804 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 41/90] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:09 2022] GET /identity/v3/users/c37e568c83a64a37acb7f86a4a1011b0 => generated 275 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:10.179617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814abeae-1e85-453f-bece-fb7a1b50d08d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:10.251406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27cab1-eddf-4dad-a04a-19910bf94f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:10.251991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27cab1-eddf-4dad-a04a-19910bf94f56 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:10.252274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27cab1-eddf-4dad-a04a-19910bf94f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:10.252546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27cab1-eddf-4dad-a04a-19910bf94f56 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:10.253744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27cab1-eddf-4dad-a04a-19910bf94f56 None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:10.255240 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd27cab1-eddf-4dad-a04a-19910bf94f56 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:10.257189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 50/91] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:09 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:10.258371 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27cab1-eddf-4dad-a04a-19910bf94f56 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:10.294873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814abeae-1e85-453f-bece-fb7a1b50d08d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:10.350944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:10.365140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32617ee3-34c7-4a35-8c63-f2a8f5a3d657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:10.365788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32617ee3-34c7-4a35-8c63-f2a8f5a3d657 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:10.366068 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32617ee3-34c7-4a35-8c63-f2a8f5a3d657 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:10.366334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32617ee3-34c7-4a35-8c63-f2a8f5a3d657 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:10.368386 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32617ee3-34c7-4a35-8c63-f2a8f5a3d657 None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:10.369869 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32617ee3-34c7-4a35-8c63-f2a8f5a3d657 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:10.375020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 42/92] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:10 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:10.375629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32617ee3-34c7-4a35-8c63-f2a8f5a3d657 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:10.416695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:10.459684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27cab1-eddf-4dad-a04a-19910bf94f56 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:10.519274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f573d-a94d-469f-8a6c-b418979b2b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:10.521745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f573d-a94d-469f-8a6c-b418979b2b6b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:10.522236 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f573d-a94d-469f-8a6c-b418979b2b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:10.524450 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f573d-a94d-469f-8a6c-b418979b2b6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:10.568090 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32617ee3-34c7-4a35-8c63-f2a8f5a3d657 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:10.635319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f573d-a94d-469f-8a6c-b418979b2b6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:10.637142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f573d-a94d-469f-8a6c-b418979b2b6b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:10.638921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48455ee0-ae2d-478f-948b-43aad1b15e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:10.641408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48455ee0-ae2d-478f-948b-43aad1b15e05 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:10.641928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48455ee0-ae2d-478f-948b-43aad1b15e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:10.642452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48455ee0-ae2d-478f-948b-43aad1b15e05 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:10.644227 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48455ee0-ae2d-478f-948b-43aad1b15e05 None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=cf19eb89de594cdaaf28c40785f2dfac, user.id=22dd50ff891948b58a7664099f06c392) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:10.644743 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48455ee0-ae2d-478f-948b-43aad1b15e05 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:10.649295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48455ee0-ae2d-478f-948b-43aad1b15e05 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:10.659446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 43/93] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:10 2022] GET /identity/v3/role_assignments?user.id=22dd50ff891948b58a7664099f06c392&scope.project.id=cf19eb89de594cdaaf28c40785f2dfac&role.id=0681632796d144f6a7ac8eca157001ec => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:10.660568 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48455ee0-ae2d-478f-948b-43aad1b15e05 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:10.777795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:10.784426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:10.842746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 51/94] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:10.854211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f573d-a94d-469f-8a6c-b418979b2b6b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:10.871147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48455ee0-ae2d-478f-948b-43aad1b15e05 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:10.937347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57978f14-f7f6-41a9-878b-d3c6716b1241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:10.939397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57978f14-f7f6-41a9-878b-d3c6716b1241 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:10.940097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57978f14-f7f6-41a9-878b-d3c6716b1241 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:10.941977 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57978f14-f7f6-41a9-878b-d3c6716b1241 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:10.943120 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57978f14-f7f6-41a9-878b-d3c6716b1241 None admin] RBAC: Adding query filter params (role.id=b99d323b1fad482ead67a8e8501c1c0b, scope.project.id=cf19eb89de594cdaaf28c40785f2dfac, user.id=c37e568c83a64a37acb7f86a4a1011b0) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:10.943951 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57978f14-f7f6-41a9-878b-d3c6716b1241 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:10.946283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57978f14-f7f6-41a9-878b-d3c6716b1241 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:10.955686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 44/95] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:10 2022] GET /identity/v3/role_assignments?user.id=c37e568c83a64a37acb7f86a4a1011b0&scope.project.id=cf19eb89de594cdaaf28c40785f2dfac&role.id=b99d323b1fad482ead67a8e8501c1c0b => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:11.068488 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f573d-a94d-469f-8a6c-b418979b2b6b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:11.123106 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aeba34c-27ae-4c3e-bf5e-de42ad90b0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:11.123770 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeba34c-27ae-4c3e-bf5e-de42ad90b0cc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:11.124050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeba34c-27ae-4c3e-bf5e-de42ad90b0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:11.124324 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeba34c-27ae-4c3e-bf5e-de42ad90b0cc None admin] PATH_INFO: `/v3/projects/5686845a060449f19f36219e26ee6801` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:11.131316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeba34c-27ae-4c3e-bf5e-de42ad90b0cc None admin] RBAC: Authorizing `identity:get_project(project_id=5686845a060449f19f36219e26ee6801)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:11.132821 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aeba34c-27ae-4c3e-bf5e-de42ad90b0cc None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:11.134761 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 52/96] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:10 2022] GET /identity/v3/projects/5686845a060449f19f36219e26ee6801 => generated 312 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:11.140850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57978f14-f7f6-41a9-878b-d3c6716b1241 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:11.289742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57978f14-f7f6-41a9-878b-d3c6716b1241 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:11.319038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:11.327149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bda4ce-08d8-4ddb-817f-0b5aac24ccf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:11.327996 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bda4ce-08d8-4ddb-817f-0b5aac24ccf1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:11.328440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bda4ce-08d8-4ddb-817f-0b5aac24ccf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:11.328876 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bda4ce-08d8-4ddb-817f-0b5aac24ccf1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:11.330788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bda4ce-08d8-4ddb-817f-0b5aac24ccf1 None admin] RBAC: Adding query filter params (role.id=125ef16e078848b2bd772db91d4115d4, scope.project.id=5686845a060449f19f36219e26ee6801, user.id=c37e568c83a64a37acb7f86a4a1011b0) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:11.330788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bda4ce-08d8-4ddb-817f-0b5aac24ccf1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:11.331640 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bda4ce-08d8-4ddb-817f-0b5aac24ccf1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:11.341027 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 45/97] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:11 2022] GET /identity/v3/role_assignments?user.id=c37e568c83a64a37acb7f86a4a1011b0&scope.project.id=5686845a060449f19f36219e26ee6801&role.id=125ef16e078848b2bd772db91d4115d4 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:12.002010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11452285-4ecd-449d-8c1a-275838e0643a None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:12.002406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11452285-4ecd-449d-8c1a-275838e0643a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:12.002596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11452285-4ecd-449d-8c1a-275838e0643a None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:12.003965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 53/98] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:12.018771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fb4ba-4c79-4b9b-abc6-5ba89f6200bb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:12.019249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fb4ba-4c79-4b9b-abc6-5ba89f6200bb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:12.019352 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fb4ba-4c79-4b9b-abc6-5ba89f6200bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:12.045008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-905fb4ba-4c79-4b9b-abc6-5ba89f6200bb None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:12.046548 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-905fb4ba-4c79-4b9b-abc6-5ba89f6200bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:12.122476 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f315298-da1e-4c80-8b9b-c6f3ffeea61f None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:12.122838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f315298-da1e-4c80-8b9b-c6f3ffeea61f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:12.123070 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f315298-da1e-4c80-8b9b-c6f3ffeea61f None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:12.124429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 54/99] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:12.129508 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634d346-425d-4f42-ac89-797e1f85dff8 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:12.129802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634d346-425d-4f42-ac89-797e1f85dff8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:12.130083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0634d346-425d-4f42-ac89-797e1f85dff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:12.134056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 46/100] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:12.171694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0634d346-425d-4f42-ac89-797e1f85dff8 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:12.172960 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0634d346-425d-4f42-ac89-797e1f85dff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:12.190806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fb4ba-4c79-4b9b-abc6-5ba89f6200bb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:12.227719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:12.299729 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 55/101] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:12.335979 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634d346-425d-4f42-ac89-797e1f85dff8 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:12.374462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905fb4ba-4c79-4b9b-abc6-5ba89f6200bb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:12.405355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:12.454443 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76df67-756d-4cc9-a145-f4b7c71dc832 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:12.455478 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76df67-756d-4cc9-a145-f4b7c71dc832 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:12.455993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76df67-756d-4cc9-a145-f4b7c71dc832 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:12.456475 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de76df67-756d-4cc9-a145-f4b7c71dc832 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:12.490902 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0634d346-425d-4f42-ac89-797e1f85dff8 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:12.491821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de76df67-756d-4cc9-a145-f4b7c71dc832 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-de76df67-756d-4cc9-a145-f4b7c71dc832 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:12.497776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:12.498634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:12.499484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:12.499484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:12.499484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:12.499484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:12.499484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:12.499484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:12.499484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:12.499484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:12.499484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:12.499484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:12.499484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:12.499484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:12.502202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 47/102] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:08:12.521411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76df67-756d-4cc9-a145-f4b7c71dc832 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:12.542780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd0a62-ff28-4a83-b6dd-5b662a7946e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:12.543599 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd0a62-ff28-4a83-b6dd-5b662a7946e8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:12.543888 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd0a62-ff28-4a83-b6dd-5b662a7946e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:12.544164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cd0a62-ff28-4a83-b6dd-5b662a7946e8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:12.550654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd0a62-ff28-4a83-b6dd-5b662a7946e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:12.550654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cd0a62-ff28-4a83-b6dd-5b662a7946e8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:12.550654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 56/103] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:12.555219 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd0a62-ff28-4a83-b6dd-5b662a7946e8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:12.622935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:12.718922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cd0a62-ff28-4a83-b6dd-5b662a7946e8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:12.769257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de76df67-756d-4cc9-a145-f4b7c71dc832 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:12.790403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717dc858-a0b5-4181-a02d-923f9659cd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:12.791066 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dc858-a0b5-4181-a02d-923f9659cd44 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:12.791354 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dc858-a0b5-4181-a02d-923f9659cd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:12.791631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717dc858-a0b5-4181-a02d-923f9659cd44 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:12.792316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717dc858-a0b5-4181-a02d-923f9659cd44 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:12.794783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717dc858-a0b5-4181-a02d-923f9659cd44 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:12.834174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0998e-f063-4352-b2ce-6db27f720fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:12.836988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0998e-f063-4352-b2ce-6db27f720fcf None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:12.837284 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0998e-f063-4352-b2ce-6db27f720fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:12.837558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e0998e-f063-4352-b2ce-6db27f720fcf None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:12.839332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0998e-f063-4352-b2ce-6db27f720fcf None admin] RBAC: Adding query filter params (name=reader) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:12.839642 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0998e-f063-4352-b2ce-6db27f720fcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:12.842778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e0998e-f063-4352-b2ce-6db27f720fcf None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:12.848062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 57/104] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 1 14:08:12 2022] POST /identity/v3/projects => generated 302 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:08:12.849405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93584280-3263-4831-a117-bdbe53af0d85 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:12.849691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93584280-3263-4831-a117-bdbe53af0d85 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:12.849974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93584280-3263-4831-a117-bdbe53af0d85 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:12.853028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 58/105] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:12.863532 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a36f0e-f219-49b0-bf01-f67228cfb17c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:12.863845 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a36f0e-f219-49b0-bf01-f67228cfb17c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:12.864118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a36f0e-f219-49b0-bf01-f67228cfb17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:12.868630 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 48/106] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:12.875119 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0998e-f063-4352-b2ce-6db27f720fcf None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:12.897387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-38a36f0e-f219-49b0-bf01-f67228cfb17c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:12.899274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-38a36f0e-f219-49b0-bf01-f67228cfb17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:12.968038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:13.057431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 59/107] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:13.079083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e0998e-f063-4352-b2ce-6db27f720fcf None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:13.086484 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a36f0e-f219-49b0-bf01-f67228cfb17c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:13.125492 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:13.153401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c331c0-aca4-4b61-8359-4f397cbcd9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:13.154058 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c331c0-aca4-4b61-8359-4f397cbcd9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:13.154345 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c331c0-aca4-4b61-8359-4f397cbcd9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:13.154648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c331c0-aca4-4b61-8359-4f397cbcd9f2 None admin] PATH_INFO: `/v3/users/1725f0355c2c4b328ecabf7643c01fd2` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:13.171264 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c331c0-aca4-4b61-8359-4f397cbcd9f2 None admin] RBAC: Authorizing `identity:get_user(user_id=1725f0355c2c4b328ecabf7643c01fd2)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:13.172741 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c331c0-aca4-4b61-8359-4f397cbcd9f2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:13.174832 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 49/108] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:12 2022] GET /identity/v3/users/1725f0355c2c4b328ecabf7643c01fd2 => generated 289 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:13.180444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c331c0-aca4-4b61-8359-4f397cbcd9f2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:13.266130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a36f0e-f219-49b0-bf01-f67228cfb17c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:13.328332 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8398bf4-6af8-450a-8b36-f31bb0e31b95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:13.328989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8398bf4-6af8-450a-8b36-f31bb0e31b95 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:13.329275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8398bf4-6af8-450a-8b36-f31bb0e31b95 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:13.329554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8398bf4-6af8-450a-8b36-f31bb0e31b95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:13.348881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8398bf4-6af8-450a-8b36-f31bb0e31b95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-f8398bf4-6af8-450a-8b36-f31bb0e31b95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:13.355823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:13.356670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:13.357419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:13.357419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:13.357419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:13.357419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:13.357419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:13.357419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:13.357419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:13.357419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:13.357419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:13.357419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:13.357419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:13.357419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:13.359682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 60/109] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:08:13.362944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:13.366833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c331c0-aca4-4b61-8359-4f397cbcd9f2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:13.375596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8398bf4-6af8-450a-8b36-f31bb0e31b95 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:13.431702 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e47863-3704-4773-8500-48309efb9903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:13.432345 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e47863-3704-4773-8500-48309efb9903 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:13.432627 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e47863-3704-4773-8500-48309efb9903 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:13.432904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e47863-3704-4773-8500-48309efb9903 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:13.527767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:13.566249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e47863-3704-4773-8500-48309efb9903 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:13.567778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e47863-3704-4773-8500-48309efb9903 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:13.572764 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8398bf4-6af8-450a-8b36-f31bb0e31b95 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:13.663653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd377e-1a58-4c86-9de1-26f96b229f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:13.664257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd377e-1a58-4c86-9de1-26f96b229f4c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:13.664546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd377e-1a58-4c86-9de1-26f96b229f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:13.664829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dd377e-1a58-4c86-9de1-26f96b229f4c None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:13.665565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd377e-1a58-4c86-9de1-26f96b229f4c None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:13.665871 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd377e-1a58-4c86-9de1-26f96b229f4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:13.667315 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dd377e-1a58-4c86-9de1-26f96b229f4c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:13.681730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 61/110] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:13.687152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd377e-1a58-4c86-9de1-26f96b229f4c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:13.755034 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:13.768143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 50/111] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:13.773831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e47863-3704-4773-8500-48309efb9903 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:13.894593 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dd377e-1a58-4c86-9de1-26f96b229f4c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:13.958589 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a44eba-0197-4108-b96d-5c3f6b8058e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:13.959183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44eba-0197-4108-b96d-5c3f6b8058e1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:13.959470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44eba-0197-4108-b96d-5c3f6b8058e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:13.959750 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a44eba-0197-4108-b96d-5c3f6b8058e1 None admin] PATH_INFO: `/v3/users/c37e568c83a64a37acb7f86a4a1011b0` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:13.962273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a44eba-0197-4108-b96d-5c3f6b8058e1 None admin] RBAC: Authorizing `identity:get_user(user_id=c37e568c83a64a37acb7f86a4a1011b0)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:13.964049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a44eba-0197-4108-b96d-5c3f6b8058e1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:13.967636 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 62/112] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:13 2022] GET /identity/v3/users/c37e568c83a64a37acb7f86a4a1011b0 => generated 275 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:13.971742 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbc9f4-ff68-45d8-87cb-3763b4034bb5 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:13.972030 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbc9f4-ff68-45d8-87cb-3763b4034bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:13.972309 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bbc9f4-ff68-45d8-87cb-3763b4034bb5 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:13.981545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e47863-3704-4773-8500-48309efb9903 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:13.981849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 63/113] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:13.982725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbc9f4-ff68-45d8-87cb-3763b4034bb5 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:14.013144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:14.041961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb6e724-06ba-47cf-a9f4-0e3ece60b2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:14.042629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6e724-06ba-47cf-a9f4-0e3ece60b2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:14.042914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6e724-06ba-47cf-a9f4-0e3ece60b2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:14.043186 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb6e724-06ba-47cf-a9f4-0e3ece60b2f4 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:14.045089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6e724-06ba-47cf-a9f4-0e3ece60b2f4 None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:14.047393 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb6e724-06ba-47cf-a9f4-0e3ece60b2f4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:14.051224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 51/114] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:13 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:14.053230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf4aaf-5201-4bc2-bb31-89cf15cd0321 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:14.053515 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf4aaf-5201-4bc2-bb31-89cf15cd0321 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:14.053792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cf4aaf-5201-4bc2-bb31-89cf15cd0321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:14.092437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d6cf4aaf-5201-4bc2-bb31-89cf15cd0321 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:14.093811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d6cf4aaf-5201-4bc2-bb31-89cf15cd0321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:14.177919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bbc9f4-ff68-45d8-87cb-3763b4034bb5 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:14.219697 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:14.234728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ae314-3dd3-46c9-b380-b2df9adcf051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:14.235520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ae314-3dd3-46c9-b380-b2df9adcf051 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:14.235911 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ae314-3dd3-46c9-b380-b2df9adcf051 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:14.236287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ae314-3dd3-46c9-b380-b2df9adcf051 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:14.238010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ae314-3dd3-46c9-b380-b2df9adcf051 None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:14.240294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ae314-3dd3-46c9-b380-b2df9adcf051 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:14.240494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 52/115] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:14.241538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf4aaf-5201-4bc2-bb31-89cf15cd0321 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:14.242182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 64/116] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:13 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:14.248103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ae314-3dd3-46c9-b380-b2df9adcf051 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:14.348298 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:14.357689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cf4aaf-5201-4bc2-bb31-89cf15cd0321 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:14.370492 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ae314-3dd3-46c9-b380-b2df9adcf051 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:14.392910 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67d04bf-2ab8-40d9-9f7d-c6961d9e971a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:14.393525 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d04bf-2ab8-40d9-9f7d-c6961d9e971a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:14.393801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d04bf-2ab8-40d9-9f7d-c6961d9e971a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:14.394236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67d04bf-2ab8-40d9-9f7d-c6961d9e971a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:14.395056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d04bf-2ab8-40d9-9f7d-c6961d9e971a None admin] RBAC: Adding query filter params (role.id=cead600aedc04a92955d0976f7f9e0fd, scope.project.id=cf19eb89de594cdaaf28c40785f2dfac, user.id=1725f0355c2c4b328ecabf7643c01fd2) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:14.395368 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d04bf-2ab8-40d9-9f7d-c6961d9e971a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:14.396816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67d04bf-2ab8-40d9-9f7d-c6961d9e971a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:14.402926 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 53/117] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:14 2022] GET /identity/v3/role_assignments?user.id=1725f0355c2c4b328ecabf7643c01fd2&scope.project.id=cf19eb89de594cdaaf28c40785f2dfac&role.id=cead600aedc04a92955d0976f7f9e0fd => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:14.404218 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc51450-5cdd-4657-9524-6a83e74476a5 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:14.404651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc51450-5cdd-4657-9524-6a83e74476a5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:14.404927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc51450-5cdd-4657-9524-6a83e74476a5 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:14.406159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 54/118] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:14.407655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046de10-08c9-4c24-8891-662bf74ac99a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:14.408173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046de10-08c9-4c24-8891-662bf74ac99a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:14.408612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7046de10-08c9-4c24-8891-662bf74ac99a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:14.415237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 55/119] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:14.415704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f8822a-e1b6-4b67-b18f-edea0f5f60f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:14.416495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8822a-e1b6-4b67-b18f-edea0f5f60f4 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:14.416857 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8822a-e1b6-4b67-b18f-edea0f5f60f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:14.417029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046de10-08c9-4c24-8891-662bf74ac99a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:14.417282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f8822a-e1b6-4b67-b18f-edea0f5f60f4 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac/users/c37e568c83a64a37acb7f86a4a1011b0/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:14.419687 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8822a-e1b6-4b67-b18f-edea0f5f60f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf19eb89de594cdaaf28c40785f2dfac, user_id=c37e568c83a64a37acb7f86a4a1011b0, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:14.422526 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f8822a-e1b6-4b67-b18f-edea0f5f60f4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:14.443484 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 65/120] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:08:14 2022] PUT /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac/users/c37e568c83a64a37acb7f86a4a1011b0/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:08:14.446446 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b11ec7-3e0b-44c2-8bb5-3e6d41faf308 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:14.446941 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b11ec7-3e0b-44c2-8bb5-3e6d41faf308 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:14.447393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b11ec7-3e0b-44c2-8bb5-3e6d41faf308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:14.472047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-51b11ec7-3e0b-44c2-8bb5-3e6d41faf308 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:14.474319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-51b11ec7-3e0b-44c2-8bb5-3e6d41faf308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:14.518995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:14.612394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7046de10-08c9-4c24-8891-662bf74ac99a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:14.634203 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 66/121] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:14.635887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e5b97-b8da-4c05-be5c-73b83705203b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:14.636338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e5b97-b8da-4c05-be5c-73b83705203b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:14.636890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e5b97-b8da-4c05-be5c-73b83705203b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:14.663186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1e4e5b97-b8da-4c05-be5c-73b83705203b None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:14.664441 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1e4e5b97-b8da-4c05-be5c-73b83705203b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:14.670689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddea0e0-2000-4090-9cd9-1b8aa6df5c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:14.671349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddea0e0-2000-4090-9cd9-1b8aa6df5c0a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:14.671692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddea0e0-2000-4090-9cd9-1b8aa6df5c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:14.671972 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddea0e0-2000-4090-9cd9-1b8aa6df5c0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:14.689448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ddea0e0-2000-4090-9cd9-1b8aa6df5c0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6ddea0e0-2000-4090-9cd9-1b8aa6df5c0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:14.696968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:14.697822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:14.698609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:14.698609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:14.698609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:14.698609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:14.698609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:14.698609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:14.698609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:14.698609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:14.698609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:14.698609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:14.698609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:14.698609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:14.699372 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 56/122] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:14.700058 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddea0e0-2000-4090-9cd9-1b8aa6df5c0a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:14.759139 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:14.770821 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 67/123] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:14.772141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e5b97-b8da-4c05-be5c-73b83705203b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:14.832089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ddea0e0-2000-4090-9cd9-1b8aa6df5c0a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:14.860770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:14.886068 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8ad13-eae9-491d-89f6-16bd32b595bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:14.886763 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8ad13-eae9-491d-89f6-16bd32b595bf None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:14.887051 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8ad13-eae9-491d-89f6-16bd32b595bf None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:14.887335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc8ad13-eae9-491d-89f6-16bd32b595bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:14.906171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4e5b97-b8da-4c05-be5c-73b83705203b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:14.919530 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc8ad13-eae9-491d-89f6-16bd32b595bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-4fc8ad13-eae9-491d-89f6-16bd32b595bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:14.924999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:14.925842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:14.930696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:14.930696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:14.930696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:14.930696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:14.930696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:14.930696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:14.930696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:14.930696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:14.930696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:14.930696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:14.930696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:14.930696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:14.930696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 57/124] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:14.935093 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8ad13-eae9-491d-89f6-16bd32b595bf None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:14.966708 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1583a8f-948f-4c00-8408-bc45a4a70375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:14.967824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1583a8f-948f-4c00-8408-bc45a4a70375 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:14.968363 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1583a8f-948f-4c00-8408-bc45a4a70375 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:14.968846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1583a8f-948f-4c00-8408-bc45a4a70375 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:14.969776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1583a8f-948f-4c00-8408-bc45a4a70375 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:14.970410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1583a8f-948f-4c00-8408-bc45a4a70375 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:14.975695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1583a8f-948f-4c00-8408-bc45a4a70375 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:14.993156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 68/125] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:15.001489 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1583a8f-948f-4c00-8408-bc45a4a70375 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:15.100206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc8ad13-eae9-491d-89f6-16bd32b595bf None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:15.126904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:15.150889 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1583a8f-948f-4c00-8408-bc45a4a70375 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:15.192416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea70aa8-7fdf-477a-b1db-3610db1ba6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:15.193194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea70aa8-7fdf-477a-b1db-3610db1ba6fc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:15.193383 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea70aa8-7fdf-477a-b1db-3610db1ba6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:15.193674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea70aa8-7fdf-477a-b1db-3610db1ba6fc None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:15.194440 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea70aa8-7fdf-477a-b1db-3610db1ba6fc None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:15.194793 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea70aa8-7fdf-477a-b1db-3610db1ba6fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:15.196432 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ea70aa8-7fdf-477a-b1db-3610db1ba6fc None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:15.205935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 69/126] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:15.211689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea70aa8-7fdf-477a-b1db-3610db1ba6fc None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:15.231319 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e8ebc-b4a3-4272-96db-b20c1c016b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:15.232001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e8ebc-b4a3-4272-96db-b20c1c016b9a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:15.232292 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e8ebc-b4a3-4272-96db-b20c1c016b9a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:15.232571 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053e8ebc-b4a3-4272-96db-b20c1c016b9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:15.259950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053e8ebc-b4a3-4272-96db-b20c1c016b9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-053e8ebc-b4a3-4272-96db-b20c1c016b9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:15.270646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:15.272729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:15.275225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:15.275225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:15.275225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:15.275225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:15.275225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:15.275225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:15.275225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:15.275225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:15.275225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:15.275225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:15.275225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:15.275225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:15.275225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 58/127] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:08:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:15.275225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e8ebc-b4a3-4272-96db-b20c1c016b9a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:15.336772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea70aa8-7fdf-477a-b1db-3610db1ba6fc None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:15.371392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:15.388797 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:15.406282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7513c-5f96-4979-bbb2-b3e1da1a5597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:15.407737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7513c-5f96-4979-bbb2-b3e1da1a5597 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:15.408687 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7513c-5f96-4979-bbb2-b3e1da1a5597 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:15.408974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f7513c-5f96-4979-bbb2-b3e1da1a5597 None admin] PATH_INFO: `/v3/users/22dd50ff891948b58a7664099f06c392` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:15.410349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7513c-5f96-4979-bbb2-b3e1da1a5597 None admin] RBAC: Authorizing `identity:get_user(user_id=22dd50ff891948b58a7664099f06c392)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:15.411870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f7513c-5f96-4979-bbb2-b3e1da1a5597 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:15.413784 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 70/128] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:15 2022] GET /identity/v3/users/22dd50ff891948b58a7664099f06c392 => generated 247 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:15.418844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7513c-5f96-4979-bbb2-b3e1da1a5597 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:15.495332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053e8ebc-b4a3-4272-96db-b20c1c016b9a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:15.566943 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f7513c-5f96-4979-bbb2-b3e1da1a5597 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:15.574030 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cfbc6-80b6-47a8-98c9-3660ff66a10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:15.574723 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cfbc6-80b6-47a8-98c9-3660ff66a10b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:15.575009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cfbc6-80b6-47a8-98c9-3660ff66a10b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:15.575286 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01cfbc6-80b6-47a8-98c9-3660ff66a10b None admin] PATH_INFO: `/v3/users/c37e568c83a64a37acb7f86a4a1011b0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:15.577203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cfbc6-80b6-47a8-98c9-3660ff66a10b None admin] RBAC: Authorizing `identity:get_user(user_id=c37e568c83a64a37acb7f86a4a1011b0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:15.581955 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01cfbc6-80b6-47a8-98c9-3660ff66a10b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:15.583884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 59/129] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:15 2022] GET /identity/v3/users/c37e568c83a64a37acb7f86a4a1011b0 => generated 275 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:15.591411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cfbc6-80b6-47a8-98c9-3660ff66a10b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:15.618606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca754ab-6810-4ab6-8690-ce2755d30f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:15.619239 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca754ab-6810-4ab6-8690-ce2755d30f88 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:15.619531 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca754ab-6810-4ab6-8690-ce2755d30f88 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:15.619946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca754ab-6810-4ab6-8690-ce2755d30f88 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:15.620676 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca754ab-6810-4ab6-8690-ce2755d30f88 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:15.620988 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca754ab-6810-4ab6-8690-ce2755d30f88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:15.622439 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca754ab-6810-4ab6-8690-ce2755d30f88 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:15.630767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 71/130] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:08:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:15.637055 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3146a9-ef31-4ce0-9836-540ae4dc36e9 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:15.637354 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3146a9-ef31-4ce0-9836-540ae4dc36e9 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:15.637633 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3146a9-ef31-4ce0-9836-540ae4dc36e9 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:15.639444 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 72/131] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:15 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:15.640269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3146a9-ef31-4ce0-9836-540ae4dc36e9 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:15.703537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:15.706715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01cfbc6-80b6-47a8-98c9-3660ff66a10b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:15.718342 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:15.748342 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183e1ef-fea4-43d2-9e1b-6f7766387c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:15.749330 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183e1ef-fea4-43d2-9e1b-6f7766387c8d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:15.749669 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183e1ef-fea4-43d2-9e1b-6f7766387c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:15.749956 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b183e1ef-fea4-43d2-9e1b-6f7766387c8d None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:15.751934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183e1ef-fea4-43d2-9e1b-6f7766387c8d None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:15.753689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b183e1ef-fea4-43d2-9e1b-6f7766387c8d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:15.758645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 60/132] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:15 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:15.759680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183e1ef-fea4-43d2-9e1b-6f7766387c8d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:15.769355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3146a9-ef31-4ce0-9836-540ae4dc36e9 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:15.806302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03922495-85d8-4880-808e-c6ad0a3f8983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:15.806982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03922495-85d8-4880-808e-c6ad0a3f8983 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:15.807309 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03922495-85d8-4880-808e-c6ad0a3f8983 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:15.807585 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03922495-85d8-4880-808e-c6ad0a3f8983 None admin] PATH_INFO: `/v3/projects/5686845a060449f19f36219e26ee6801` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:15.808830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03922495-85d8-4880-808e-c6ad0a3f8983 None admin] RBAC: Authorizing `identity:get_project(project_id=5686845a060449f19f36219e26ee6801)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:15.810204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03922495-85d8-4880-808e-c6ad0a3f8983 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:15.812241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 73/133] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:15 2022] GET /identity/v3/projects/5686845a060449f19f36219e26ee6801 => generated 312 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:15.813156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f31ab-716c-48a6-92f8-0306ac9b6aad None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:15.818068 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f31ab-716c-48a6-92f8-0306ac9b6aad None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:15.818353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394f31ab-716c-48a6-92f8-0306ac9b6aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:15.837640 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-394f31ab-716c-48a6-92f8-0306ac9b6aad None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:15.839162 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-394f31ab-716c-48a6-92f8-0306ac9b6aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:15.900685 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b183e1ef-fea4-43d2-9e1b-6f7766387c8d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:15.922666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 74/134] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:15.923914 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f31ab-716c-48a6-92f8-0306ac9b6aad None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:15.964903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3440d-44b6-4e39-8a96-dd6852d260cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:15.965710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3440d-44b6-4e39-8a96-dd6852d260cc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:15.966233 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3440d-44b6-4e39-8a96-dd6852d260cc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:15.966517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d3440d-44b6-4e39-8a96-dd6852d260cc None admin] PATH_INFO: `/v3/users/c37e568c83a64a37acb7f86a4a1011b0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:15.968047 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3440d-44b6-4e39-8a96-dd6852d260cc None admin] RBAC: Authorizing `identity:get_user(user_id=c37e568c83a64a37acb7f86a4a1011b0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:15.970196 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d3440d-44b6-4e39-8a96-dd6852d260cc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:15.978281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 61/135] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:15 2022] GET /identity/v3/users/c37e568c83a64a37acb7f86a4a1011b0 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:15.978281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3440d-44b6-4e39-8a96-dd6852d260cc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:16.010321 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:16.054010 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:16.073396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394f31ab-716c-48a6-92f8-0306ac9b6aad None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:16.110032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f157b50-3c27-487b-8440-2afa551a193a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:16.110560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f157b50-3c27-487b-8440-2afa551a193a None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:16.110895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f157b50-3c27-487b-8440-2afa551a193a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:16.111175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f157b50-3c27-487b-8440-2afa551a193a None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac/users/22dd50ff891948b58a7664099f06c392/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:16.113240 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f157b50-3c27-487b-8440-2afa551a193a None admin] RBAC: Authorizing `identity:create_grant(project_id=cf19eb89de594cdaaf28c40785f2dfac, user_id=22dd50ff891948b58a7664099f06c392, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:16.114831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f157b50-3c27-487b-8440-2afa551a193a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:16.134477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d3440d-44b6-4e39-8a96-dd6852d260cc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:16.138672 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 75/136] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:08:15 2022] PUT /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac/users/22dd50ff891948b58a7664099f06c392/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:08:16.141017 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f157b50-3c27-487b-8440-2afa551a193a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:16.220446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c7387-6ed6-4a1e-9c7d-1c9c5f115d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:16.222608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7387-6ed6-4a1e-9c7d-1c9c5f115d28 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:16.224083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7387-6ed6-4a1e-9c7d-1c9c5f115d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:16.224597 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c7387-6ed6-4a1e-9c7d-1c9c5f115d28 None admin] PATH_INFO: `/v3/projects/5686845a060449f19f36219e26ee6801/users/c37e568c83a64a37acb7f86a4a1011b0/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:16.229404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c7387-6ed6-4a1e-9c7d-1c9c5f115d28 None admin] RBAC: Authorizing `identity:create_grant(project_id=5686845a060449f19f36219e26ee6801, user_id=c37e568c83a64a37acb7f86a4a1011b0, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:16.232237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c7387-6ed6-4a1e-9c7d-1c9c5f115d28 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:16.260190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 62/137] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:08:15 2022] PUT /identity/v3/projects/5686845a060449f19f36219e26ee6801/users/c37e568c83a64a37acb7f86a4a1011b0/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:08:16.267343 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c7387-6ed6-4a1e-9c7d-1c9c5f115d28 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:16.360691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f157b50-3c27-487b-8440-2afa551a193a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:16.382623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:16.406863 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8f186-0cd6-4319-a0cf-a7cba7e988e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:16.407583 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8f186-0cd6-4319-a0cf-a7cba7e988e9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:16.407872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8f186-0cd6-4319-a0cf-a7cba7e988e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:16.408148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d8f186-0cd6-4319-a0cf-a7cba7e988e9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:16.410007 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8f186-0cd6-4319-a0cf-a7cba7e988e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:16.411574 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d8f186-0cd6-4319-a0cf-a7cba7e988e9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:16.413397 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 76/138] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:16.419522 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8f186-0cd6-4319-a0cf-a7cba7e988e9 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:16.511522 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c7387-6ed6-4a1e-9c7d-1c9c5f115d28 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:16.516013 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:16.550519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d8f186-0cd6-4319-a0cf-a7cba7e988e9 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:16.588652 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d7eba-fe28-4045-a5d9-a6c36ef6cbac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:16.589277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d7eba-fe28-4045-a5d9-a6c36ef6cbac None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:16.589556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d7eba-fe28-4045-a5d9-a6c36ef6cbac None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:16.589823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580d7eba-fe28-4045-a5d9-a6c36ef6cbac None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:16.590513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d7eba-fe28-4045-a5d9-a6c36ef6cbac None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:16.592475 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580d7eba-fe28-4045-a5d9-a6c36ef6cbac None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:16.619343 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1858dbe-bb24-42da-8bc6-b93a803b99cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:16.620036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1858dbe-bb24-42da-8bc6-b93a803b99cd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:16.620234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 77/139] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:08:16 2022] POST /identity/v3/users => generated 283 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:08:16.620446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1858dbe-bb24-42da-8bc6-b93a803b99cd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:16.620737 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1858dbe-bb24-42da-8bc6-b93a803b99cd None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:16.622036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1858dbe-bb24-42da-8bc6-b93a803b99cd None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:16.623567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1858dbe-bb24-42da-8bc6-b93a803b99cd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:16.625606 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 63/140] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:16 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:16.631627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d7eba-fe28-4045-a5d9-a6c36ef6cbac None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:16.679018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:16.744200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c968cd-d5b7-4452-b11e-527362c7057c None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:16.744544 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c968cd-d5b7-4452-b11e-527362c7057c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:16.744890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c968cd-d5b7-4452-b11e-527362c7057c None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:16.746321 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 64/141] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:16.751854 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2dc4f-d8f6-448c-87de-ed07b611c321 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:16.752146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2dc4f-d8f6-448c-87de-ed07b611c321 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:16.752433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2dc4f-d8f6-448c-87de-ed07b611c321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:16.776007 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580d7eba-fe28-4045-a5d9-a6c36ef6cbac None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:16.815235 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ea9ec-74c6-4901-9989-dc2be2ec3d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:16.815663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-efd2dc4f-d8f6-448c-87de-ed07b611c321 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:16.815967 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ea9ec-74c6-4901-9989-dc2be2ec3d97 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:16.816258 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ea9ec-74c6-4901-9989-dc2be2ec3d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:16.816534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898ea9ec-74c6-4901-9989-dc2be2ec3d97 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac/users/c37e568c83a64a37acb7f86a4a1011b0/roles/b99d323b1fad482ead67a8e8501c1c0b` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:16.816889 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-efd2dc4f-d8f6-448c-87de-ed07b611c321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:16.819156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ea9ec-74c6-4901-9989-dc2be2ec3d97 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf19eb89de594cdaaf28c40785f2dfac, user_id=c37e568c83a64a37acb7f86a4a1011b0, role_id=b99d323b1fad482ead67a8e8501c1c0b)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:16.821204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898ea9ec-74c6-4901-9989-dc2be2ec3d97 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:16.843474 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 78/142] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:08:16 2022] PUT /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac/users/c37e568c83a64a37acb7f86a4a1011b0/roles/b99d323b1fad482ead67a8e8501c1c0b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:08:16.955495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 65/143] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:16.996922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ea9ec-74c6-4901-9989-dc2be2ec3d97 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:17.028516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d3d06-538f-4b37-8e76-efba799e5984 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:17.028698 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d3d06-538f-4b37-8e76-efba799e5984 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:17.028980 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475d3d06-538f-4b37-8e76-efba799e5984 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:17.030555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 66/144] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:08:17.036214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426e965-b6a3-4910-9580-2ead0231a6e3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:17.036499 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426e965-b6a3-4910-9580-2ead0231a6e3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:17.036769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d426e965-b6a3-4910-9580-2ead0231a6e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:17.075568 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d426e965-b6a3-4910-9580-2ead0231a6e3 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:17.076795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d426e965-b6a3-4910-9580-2ead0231a6e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:17.139377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:17.150835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898ea9ec-74c6-4901-9989-dc2be2ec3d97 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:17.166408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 67/145] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:17.189785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426e965-b6a3-4910-9580-2ead0231a6e3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:17.227147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:17.232059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79e58b-f3bf-41fa-92e4-62e22a7661b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:17.232720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79e58b-f3bf-41fa-92e4-62e22a7661b6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:17.233003 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79e58b-f3bf-41fa-92e4-62e22a7661b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:17.233272 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79e58b-f3bf-41fa-92e4-62e22a7661b6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:17.263520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff79e58b-f3bf-41fa-92e4-62e22a7661b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-ff79e58b-f3bf-41fa-92e4-62e22a7661b6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:17.268926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:17.269822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:17.270646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:17.270646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:17.270646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:17.270646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:17.270646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:17.270646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:17.270646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:17.270646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:17.270646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:17.270646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:17.270646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:17.270646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:17.270646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 79/146] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:16 2022] GET /identity/v3/roles/reader => generated 84 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:17.282101 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79e58b-f3bf-41fa-92e4-62e22a7661b6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:17.323198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d426e965-b6a3-4910-9580-2ead0231a6e3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:17.393702 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e322e-0f94-4f08-a91d-57516029ad4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:17.394363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e322e-0f94-4f08-a91d-57516029ad4e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:17.394662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e322e-0f94-4f08-a91d-57516029ad4e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:17.395033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e322e-0f94-4f08-a91d-57516029ad4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:17.413500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e322e-0f94-4f08-a91d-57516029ad4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f13e322e-0f94-4f08-a91d-57516029ad4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:17.419172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:17.420048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:17.420811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:17.420811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:17.420811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:17.420811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:17.420811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:17.420811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:17.420811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:17.420811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:17.420811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:17.420811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:17.420811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:17.420811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:17.423476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 68/147] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:17.430023 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e322e-0f94-4f08-a91d-57516029ad4e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:17.480880 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79e58b-f3bf-41fa-92e4-62e22a7661b6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:17.546220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cc069-82a6-4572-8f36-e8e7c8a28521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:17.546884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cc069-82a6-4572-8f36-e8e7c8a28521 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:17.547210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cc069-82a6-4572-8f36-e8e7c8a28521 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:17.547486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102cc069-82a6-4572-8f36-e8e7c8a28521 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:17.548204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cc069-82a6-4572-8f36-e8e7c8a28521 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:17.548504 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cc069-82a6-4572-8f36-e8e7c8a28521 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:17.549944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102cc069-82a6-4572-8f36-e8e7c8a28521 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:17.562858 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 80/148] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:17.568216 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cc069-82a6-4572-8f36-e8e7c8a28521 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:17.610862 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:17.611553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:17.629102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e322e-0f94-4f08-a91d-57516029ad4e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:17.695850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386811f-25d4-4b6a-a96d-ab22dd5a7f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:17.696537 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386811f-25d4-4b6a-a96d-ab22dd5a7f3d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:17.696818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386811f-25d4-4b6a-a96d-ab22dd5a7f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:17.697092 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0386811f-25d4-4b6a-a96d-ab22dd5a7f3d None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:17.697879 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386811f-25d4-4b6a-a96d-ab22dd5a7f3d None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:17.698183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386811f-25d4-4b6a-a96d-ab22dd5a7f3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:17.699787 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0386811f-25d4-4b6a-a96d-ab22dd5a7f3d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:17.719545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 69/149] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:17.725648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386811f-25d4-4b6a-a96d-ab22dd5a7f3d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:17.756942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102cc069-82a6-4572-8f36-e8e7c8a28521 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:17.803509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367786c9-b0f4-4b5b-9a3c-1bb4e68ecc17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:17.804085 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367786c9-b0f4-4b5b-9a3c-1bb4e68ecc17 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:17.805018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367786c9-b0f4-4b5b-9a3c-1bb4e68ecc17 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:17.805353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367786c9-b0f4-4b5b-9a3c-1bb4e68ecc17 None admin] PATH_INFO: `/v3/users/1725f0355c2c4b328ecabf7643c01fd2` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:17.811342 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367786c9-b0f4-4b5b-9a3c-1bb4e68ecc17 None admin] RBAC: Authorizing `identity:get_user(user_id=1725f0355c2c4b328ecabf7643c01fd2)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:17.812844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367786c9-b0f4-4b5b-9a3c-1bb4e68ecc17 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:17.814812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 81/150] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:17 2022] GET /identity/v3/users/1725f0355c2c4b328ecabf7643c01fd2 => generated 289 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:17.820298 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367786c9-b0f4-4b5b-9a3c-1bb4e68ecc17 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:17.834016 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0386811f-25d4-4b6a-a96d-ab22dd5a7f3d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:17.907342 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2054b6-fb3a-4445-8f94-f46d2be77027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:17.908028 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2054b6-fb3a-4445-8f94-f46d2be77027 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:17.908312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2054b6-fb3a-4445-8f94-f46d2be77027 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:17.908587 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2054b6-fb3a-4445-8f94-f46d2be77027 None admin] PATH_INFO: `/v3/users/c37e568c83a64a37acb7f86a4a1011b0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:17.915382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2054b6-fb3a-4445-8f94-f46d2be77027 None admin] RBAC: Authorizing `identity:get_user(user_id=c37e568c83a64a37acb7f86a4a1011b0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:17.916892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2054b6-fb3a-4445-8f94-f46d2be77027 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:17.919054 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 70/151] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:17 2022] GET /identity/v3/users/c37e568c83a64a37acb7f86a4a1011b0 => generated 275 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:17.927663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2054b6-fb3a-4445-8f94-f46d2be77027 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:17.954949 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:17.970987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:17.974242 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367786c9-b0f4-4b5b-9a3c-1bb4e68ecc17 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:18.043299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdb253-bc4d-4a86-935d-5b73fcc64287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:18.043959 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdb253-bc4d-4a86-935d-5b73fcc64287 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:18.044240 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdb253-bc4d-4a86-935d-5b73fcc64287 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:18.044513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fdb253-bc4d-4a86-935d-5b73fcc64287 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:18.045715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdb253-bc4d-4a86-935d-5b73fcc64287 None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:18.047210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fdb253-bc4d-4a86-935d-5b73fcc64287 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:18.049147 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 82/152] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:17 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:18.055251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdb253-bc4d-4a86-935d-5b73fcc64287 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:18.107367 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2054b6-fb3a-4445-8f94-f46d2be77027 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:18.163373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87567588-3215-463e-9ca0-d922e0ed0e62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:18.164587 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87567588-3215-463e-9ca0-d922e0ed0e62 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:18.164884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87567588-3215-463e-9ca0-d922e0ed0e62 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:18.165154 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87567588-3215-463e-9ca0-d922e0ed0e62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:18.190359 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fdb253-bc4d-4a86-935d-5b73fcc64287 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:18.234693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafc448-c5f4-41f7-9c12-b7d5b616b452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:18.235475 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafc448-c5f4-41f7-9c12-b7d5b616b452 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:18.235916 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafc448-c5f4-41f7-9c12-b7d5b616b452 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:18.236253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafc448-c5f4-41f7-9c12-b7d5b616b452 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac/users/1725f0355c2c4b328ecabf7643c01fd2/roles/cead600aedc04a92955d0976f7f9e0fd` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:18.238344 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafc448-c5f4-41f7-9c12-b7d5b616b452 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf19eb89de594cdaaf28c40785f2dfac, user_id=1725f0355c2c4b328ecabf7643c01fd2, role_id=cead600aedc04a92955d0976f7f9e0fd)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:18.240433 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafc448-c5f4-41f7-9c12-b7d5b616b452 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:18.258913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 83/153] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:08:18 2022] PUT /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac/users/1725f0355c2c4b328ecabf7643c01fd2/roles/cead600aedc04a92955d0976f7f9e0fd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:08:18.308053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87567588-3215-463e-9ca0-d922e0ed0e62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:18.309502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87567588-3215-463e-9ca0-d922e0ed0e62 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:18.339776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:18.430292 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 71/154] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 503 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:18.436748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafc448-c5f4-41f7-9c12-b7d5b616b452 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:18.464682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:18.575469 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafc448-c5f4-41f7-9c12-b7d5b616b452 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:18.612129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca83dfb6-c01b-4286-8f8a-0a63b8fa9590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:18.612773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83dfb6-c01b-4286-8f8a-0a63b8fa9590 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:18.613050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83dfb6-c01b-4286-8f8a-0a63b8fa9590 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:18.613320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca83dfb6-c01b-4286-8f8a-0a63b8fa9590 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:18.614711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83dfb6-c01b-4286-8f8a-0a63b8fa9590 None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:18.616215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca83dfb6-c01b-4286-8f8a-0a63b8fa9590 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:18.618755 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 84/155] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:18 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:18.627696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87567588-3215-463e-9ca0-d922e0ed0e62 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:18.778259 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87567588-3215-463e-9ca0-d922e0ed0e62 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:18.809289 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:18.828406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24769ee4-8298-48fb-b1fa-de035f86d2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:18.828957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769ee4-8298-48fb-b1fa-de035f86d2ce None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:18.829236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769ee4-8298-48fb-b1fa-de035f86d2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:18.829509 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24769ee4-8298-48fb-b1fa-de035f86d2ce None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:18.830307 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24769ee4-8298-48fb-b1fa-de035f86d2ce None admin] RBAC: Adding query filter params (role.id=125ef16e078848b2bd772db91d4115d4, scope.project.id=cf19eb89de594cdaaf28c40785f2dfac, user.id=c37e568c83a64a37acb7f86a4a1011b0) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:18.830630 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24769ee4-8298-48fb-b1fa-de035f86d2ce None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:18.832080 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24769ee4-8298-48fb-b1fa-de035f86d2ce None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:18.843543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 72/156] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:18 2022] GET /identity/v3/role_assignments?user.id=c37e568c83a64a37acb7f86a4a1011b0&scope.project.id=cf19eb89de594cdaaf28c40785f2dfac&role.id=125ef16e078848b2bd772db91d4115d4 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:19.811657 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60948fd-7199-4f02-901c-c2255fdf19a6 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:19.812528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60948fd-7199-4f02-901c-c2255fdf19a6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:19.812962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60948fd-7199-4f02-901c-c2255fdf19a6 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:19.814747 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 85/157] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:19.822449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1916e7-b4b2-4377-a90a-530f44a45784 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:19.823350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1916e7-b4b2-4377-a90a-530f44a45784 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:19.823987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1916e7-b4b2-4377-a90a-530f44a45784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:19.859878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0b1916e7-b4b2-4377-a90a-530f44a45784 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:19.861727 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0b1916e7-b4b2-4377-a90a-530f44a45784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:19.946741 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 73/158] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:19.981936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60948fd-7199-4f02-901c-c2255fdf19a6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:20.099059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:20.124420 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60948fd-7199-4f02-901c-c2255fdf19a6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:20.164930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a2d04-b6f7-4b8a-9303-4ce1030ef611 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:20.165587 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a2d04-b6f7-4b8a-9303-4ce1030ef611 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:20.166214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a2d04-b6f7-4b8a-9303-4ce1030ef611 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:20.167837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 74/159] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:20.173779 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dea0b-0e72-4386-bad4-8376c0088134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:20.174524 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dea0b-0e72-4386-bad4-8376c0088134 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:20.174847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dea0b-0e72-4386-bad4-8376c0088134 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:20.175123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6dea0b-0e72-4386-bad4-8376c0088134 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:20.180033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf9925-ce74-4dc1-951e-6db059dbb8b0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:20.180559 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf9925-ce74-4dc1-951e-6db059dbb8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:20.181035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bf9925-ce74-4dc1-951e-6db059dbb8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:20.193475 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6dea0b-0e72-4386-bad4-8376c0088134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-ea6dea0b-0e72-4386-bad4-8376c0088134 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:20.201573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:20.202430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:20.203247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:20.203247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:20.203247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:20.203247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:20.203247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:20.203247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:20.203247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:20.203247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:20.203247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:20.203247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:20.203247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:20.203247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:20.213051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 86/160] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:20.221870 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-60bf9925-ce74-4dc1-951e-6db059dbb8b0 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:20.223572 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dea0b-0e72-4386-bad4-8376c0088134 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:20.224523 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-60bf9925-ce74-4dc1-951e-6db059dbb8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:20.358147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 75/161] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:20.361437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f8069-45e2-443d-b873-451615153eee None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:20.361738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f8069-45e2-443d-b873-451615153eee None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:20.362014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f8069-45e2-443d-b873-451615153eee None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:20.369978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 76/162] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:20 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:20.376209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609e77c-2fa2-4391-ac66-3ed1de8e5317 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:20.376545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609e77c-2fa2-4391-ac66-3ed1de8e5317 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:20.376886 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6609e77c-2fa2-4391-ac66-3ed1de8e5317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:20.408614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6609e77c-2fa2-4391-ac66-3ed1de8e5317 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:20.410351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6609e77c-2fa2-4391-ac66-3ed1de8e5317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:20.430962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6dea0b-0e72-4386-bad4-8376c0088134 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:20.486937 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:20.511227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f01c72-3de7-48a9-986e-16bfbc07650d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:20.512230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f01c72-3de7-48a9-986e-16bfbc07650d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:20.512510 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f01c72-3de7-48a9-986e-16bfbc07650d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:20.512777 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f01c72-3de7-48a9-986e-16bfbc07650d None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:20.513562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f01c72-3de7-48a9-986e-16bfbc07650d None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:20.513796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f01c72-3de7-48a9-986e-16bfbc07650d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:20.515207 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f01c72-3de7-48a9-986e-16bfbc07650d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:20.534720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 87/163] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:20.535653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f01c72-3de7-48a9-986e-16bfbc07650d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:20.544833 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:20.546299 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 77/164] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:20.547177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609e77c-2fa2-4391-ac66-3ed1de8e5317 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:20.722865 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f01c72-3de7-48a9-986e-16bfbc07650d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:20.736630 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6609e77c-2fa2-4391-ac66-3ed1de8e5317 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:20.793421 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fec4af-54c0-4a78-8777-f8dd0eb13a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:20.794073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fec4af-54c0-4a78-8777-f8dd0eb13a52 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:20.794350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fec4af-54c0-4a78-8777-f8dd0eb13a52 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:20.794639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fec4af-54c0-4a78-8777-f8dd0eb13a52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:20.801554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e587a3-f77e-4c30-8d8e-0bb979f03c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:20.802200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e587a3-f77e-4c30-8d8e-0bb979f03c12 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:20.802478 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e587a3-f77e-4c30-8d8e-0bb979f03c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:20.802770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e587a3-f77e-4c30-8d8e-0bb979f03c12 None admin] PATH_INFO: `/v3/users/c37e568c83a64a37acb7f86a4a1011b0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:20.804183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e587a3-f77e-4c30-8d8e-0bb979f03c12 None admin] RBAC: Authorizing `identity:get_user(user_id=c37e568c83a64a37acb7f86a4a1011b0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:20.806837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8e587a3-f77e-4c30-8d8e-0bb979f03c12 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:20.808490 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 78/165] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:20 2022] GET /identity/v3/users/c37e568c83a64a37acb7f86a4a1011b0 => generated 275 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:20.809244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e587a3-f77e-4c30-8d8e-0bb979f03c12 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:20.816586 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fec4af-54c0-4a78-8777-f8dd0eb13a52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-97fec4af-54c0-4a78-8777-f8dd0eb13a52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:20.822084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:20.824316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:20.826271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:20.826271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:20.826271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:20.826271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:20.826271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:20.826271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:20.826271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:20.826271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:20.826271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:20.826271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:20.826271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:20.826271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:20.826271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 88/166] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:08:20 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:20.826271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fec4af-54c0-4a78-8777-f8dd0eb13a52 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:20.890941 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:20.940891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:20.992807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e587a3-f77e-4c30-8d8e-0bb979f03c12 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:21.022553 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fec4af-54c0-4a78-8777-f8dd0eb13a52 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:21.057758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910a77a-3909-424f-95fb-0321dc0dcefe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:21.058406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910a77a-3909-424f-95fb-0321dc0dcefe None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:21.058704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910a77a-3909-424f-95fb-0321dc0dcefe None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:21.058975 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910a77a-3909-424f-95fb-0321dc0dcefe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:21.078457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910a77a-3909-424f-95fb-0321dc0dcefe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c910a77a-3909-424f-95fb-0321dc0dcefe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:21.083785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:21.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:21.088716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:21.088716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:21.088716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:21.088716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:21.088716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:21.088716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:21.088716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:21.088716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:21.088716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:21.088716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:21.088716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:21.088716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:21.088716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 79/167] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:08:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:21.088716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910a77a-3909-424f-95fb-0321dc0dcefe None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:21.094670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699985e-ca47-4f7d-885b-b64b3f805385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:21.094670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699985e-ca47-4f7d-885b-b64b3f805385 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:21.094670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699985e-ca47-4f7d-885b-b64b3f805385 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:21.094670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6699985e-ca47-4f7d-885b-b64b3f805385 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:21.227982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699985e-ca47-4f7d-885b-b64b3f805385 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:21.229563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6699985e-ca47-4f7d-885b-b64b3f805385 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:21.243450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910a77a-3909-424f-95fb-0321dc0dcefe None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:21.247182 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:21.280520 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741d74f-6b77-4541-855d-7330b9031539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:21.281250 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d74f-6b77-4541-855d-7330b9031539 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:21.281598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d74f-6b77-4541-855d-7330b9031539 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:21.281939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741d74f-6b77-4541-855d-7330b9031539 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:21.282770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741d74f-6b77-4541-855d-7330b9031539 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:21.283146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741d74f-6b77-4541-855d-7330b9031539 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:21.284604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741d74f-6b77-4541-855d-7330b9031539 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:21.294173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 80/168] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:08:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:21.295737 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d080389-6b26-499a-9727-0d0fd1e245ae None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:21.300533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d080389-6b26-499a-9727-0d0fd1e245ae None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:21.300840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d080389-6b26-499a-9727-0d0fd1e245ae None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:21.302446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 81/169] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:21 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:21.303140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d080389-6b26-499a-9727-0d0fd1e245ae None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:21.307701 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:21.352319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 89/170] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:21.353689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699985e-ca47-4f7d-885b-b64b3f805385 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:21.437906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d080389-6b26-499a-9727-0d0fd1e245ae None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:21.465543 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6699985e-ca47-4f7d-885b-b64b3f805385 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:21.478762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719f0235-1453-4d96-88e6-5e5bf85729a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:21.479380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f0235-1453-4d96-88e6-5e5bf85729a7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:21.479660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f0235-1453-4d96-88e6-5e5bf85729a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:21.479927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719f0235-1453-4d96-88e6-5e5bf85729a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:21.480654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f0235-1453-4d96-88e6-5e5bf85729a7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:21.480953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f0235-1453-4d96-88e6-5e5bf85729a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:21.482750 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719f0235-1453-4d96-88e6-5e5bf85729a7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:21.491504 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 82/171] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:21.492931 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b8424-9269-4aad-b6b6-23c86256965a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:21.493225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b8424-9269-4aad-b6b6-23c86256965a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:21.493563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382b8424-9269-4aad-b6b6-23c86256965a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:21.505409 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736aa2a1-89af-4a32-881e-3ee10628dbd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:21.506520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa2a1-89af-4a32-881e-3ee10628dbd4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:21.507017 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa2a1-89af-4a32-881e-3ee10628dbd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:21.508149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736aa2a1-89af-4a32-881e-3ee10628dbd4 None admin] PATH_INFO: `/v3/users/c37e568c83a64a37acb7f86a4a1011b0` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:21.509632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aa2a1-89af-4a32-881e-3ee10628dbd4 None admin] RBAC: Authorizing `identity:get_user(user_id=c37e568c83a64a37acb7f86a4a1011b0)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:21.511452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736aa2a1-89af-4a32-881e-3ee10628dbd4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:21.512356 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-382b8424-9269-4aad-b6b6-23c86256965a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:21.513553 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 90/172] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:21 2022] GET /identity/v3/users/c37e568c83a64a37acb7f86a4a1011b0 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:21.513667 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-382b8424-9269-4aad-b6b6-23c86256965a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:21.515068 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f483f87-cacb-415b-97f0-02d20c2d312b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:21.515526 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f483f87-cacb-415b-97f0-02d20c2d312b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:21.516078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f483f87-cacb-415b-97f0-02d20c2d312b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:21.517607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 91/173] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:21.518475 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f483f87-cacb-415b-97f0-02d20c2d312b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:21.552487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:21.555685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:21.608086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 83/174] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:21.608955 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b8424-9269-4aad-b6b6-23c86256965a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:21.640683 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f483f87-cacb-415b-97f0-02d20c2d312b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:21.680588 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6cb78-29ad-4bc0-bc9d-29536b95a1b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:21.681575 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6cb78-29ad-4bc0-bc9d-29536b95a1b2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:21.682099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6cb78-29ad-4bc0-bc9d-29536b95a1b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:21.682702 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e6cb78-29ad-4bc0-bc9d-29536b95a1b2 None admin] PATH_INFO: `/v3/projects/5686845a060449f19f36219e26ee6801` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:21.684092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6cb78-29ad-4bc0-bc9d-29536b95a1b2 None admin] RBAC: Authorizing `identity:get_project(project_id=5686845a060449f19f36219e26ee6801)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:21.686143 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e6cb78-29ad-4bc0-bc9d-29536b95a1b2 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:21.688165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 92/175] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:21 2022] GET /identity/v3/projects/5686845a060449f19f36219e26ee6801 => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:21.689167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6cb78-29ad-4bc0-bc9d-29536b95a1b2 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:21.737678 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382b8424-9269-4aad-b6b6-23c86256965a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:21.776151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bee4f0-46eb-442e-a60c-814324ac1f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:21.776712 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bee4f0-46eb-442e-a60c-814324ac1f62 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:21.776991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bee4f0-46eb-442e-a60c-814324ac1f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:21.777262 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bee4f0-46eb-442e-a60c-814324ac1f62 None admin] PATH_INFO: `/v3/users/22dd50ff891948b58a7664099f06c392` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:21.778422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bee4f0-46eb-442e-a60c-814324ac1f62 None admin] RBAC: Authorizing `identity:get_user(user_id=22dd50ff891948b58a7664099f06c392)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:21.779892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bee4f0-46eb-442e-a60c-814324ac1f62 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:21.781499 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 84/176] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:21 2022] GET /identity/v3/users/22dd50ff891948b58a7664099f06c392 => generated 247 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:21.783011 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5b63c-bef9-4520-9f7c-575ab1acae54 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:21.783011 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5b63c-bef9-4520-9f7c-575ab1acae54 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:21.783238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5b63c-bef9-4520-9f7c-575ab1acae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:21.802319 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fbf5b63c-bef9-4520-9f7c-575ab1acae54 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:21.803547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fbf5b63c-bef9-4520-9f7c-575ab1acae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:21.807772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:21.811333 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e6cb78-29ad-4bc0-bc9d-29536b95a1b2 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:21.829174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:21.849230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d43e7-7fd8-4923-be58-867a08273e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:21.849850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d43e7-7fd8-4923-be58-867a08273e37 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:21.850122 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d43e7-7fd8-4923-be58-867a08273e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:21.850396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53d43e7-7fd8-4923-be58-867a08273e37 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:21.879446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 85/177] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:21.880275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5b63c-bef9-4520-9f7c-575ab1acae54 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:21.921150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d43e7-7fd8-4923-be58-867a08273e37 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:21.922682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53d43e7-7fd8-4923-be58-867a08273e37 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:21.985298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5b63c-bef9-4520-9f7c-575ab1acae54 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:22.021236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a3792e-7319-4b14-b302-3a5c328c1063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:22.022114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3792e-7319-4b14-b302-3a5c328c1063 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:22.022497 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3792e-7319-4b14-b302-3a5c328c1063 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:22.022693 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3792e-7319-4b14-b302-3a5c328c1063 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:22.026644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:22.030053 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 93/178] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:22.031047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d43e7-7fd8-4923-be58-867a08273e37 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:22.038323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a3792e-7319-4b14-b302-3a5c328c1063 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c1a3792e-7319-4b14-b302-3a5c328c1063 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:22.043303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:22.044215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:22.044993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:22.044993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:22.044993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:22.044993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:22.044993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:22.044993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:22.044993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:22.044993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:22.044993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:22.044993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:22.044993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:22.044993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:22.044993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 86/179] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:08:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:22.045626 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeed94-931e-4bc4-bb84-68904ec39332 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:22.045927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeed94-931e-4bc4-bb84-68904ec39332 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:22.046168 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23eeed94-931e-4bc4-bb84-68904ec39332 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:22.047405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 87/180] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:22.048093 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeed94-931e-4bc4-bb84-68904ec39332 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:22.066982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:22.138561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53d43e7-7fd8-4923-be58-867a08273e37 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:22.152156 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23eeed94-931e-4bc4-bb84-68904ec39332 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:22.171822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3bc9f-d56c-43ad-acc8-09c7960229d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:22.172439 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3bc9f-d56c-43ad-acc8-09c7960229d0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:22.172719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3bc9f-d56c-43ad-acc8-09c7960229d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:22.172985 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3bc9f-d56c-43ad-acc8-09c7960229d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:22.173768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3bc9f-d56c-43ad-acc8-09c7960229d0 None admin] RBAC: Adding query filter params (role.id=125ef16e078848b2bd772db91d4115d4, scope.project.id=5686845a060449f19f36219e26ee6801, user.id=c37e568c83a64a37acb7f86a4a1011b0) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:22.174075 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3bc9f-d56c-43ad-acc8-09c7960229d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:22.175547 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f3bc9f-d56c-43ad-acc8-09c7960229d0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:22.181878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 94/181] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:22 2022] GET /identity/v3/role_assignments?user.id=c37e568c83a64a37acb7f86a4a1011b0&scope.project.id=5686845a060449f19f36219e26ee6801&role.id=125ef16e078848b2bd772db91d4115d4 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:22.183081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e607799-b153-4d8e-9ddf-5bfbac3ae5da None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:22.183363 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e607799-b153-4d8e-9ddf-5bfbac3ae5da None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:22.183637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e607799-b153-4d8e-9ddf-5bfbac3ae5da None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:22.185040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 95/182] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:22 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:22.185554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e607799-b153-4d8e-9ddf-5bfbac3ae5da None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:22.195202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a15995-e458-43b1-9151-a729e3c5f9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:22.195914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a15995-e458-43b1-9151-a729e3c5f9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:22.196238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a15995-e458-43b1-9151-a729e3c5f9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:22.196551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a15995-e458-43b1-9151-a729e3c5f9a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:22.270145 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:22.281953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a15995-e458-43b1-9151-a729e3c5f9a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:22.283275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a15995-e458-43b1-9151-a729e3c5f9a4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:22.306163 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:22.315716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e607799-b153-4d8e-9ddf-5bfbac3ae5da None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:22.360976 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82f8bb-929d-447a-9b95-debe656c3e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:22.361627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82f8bb-929d-447a-9b95-debe656c3e84 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:22.361907 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82f8bb-929d-447a-9b95-debe656c3e84 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:22.362182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a82f8bb-929d-447a-9b95-debe656c3e84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:22.363494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82f8bb-929d-447a-9b95-debe656c3e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:22.364836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a82f8bb-929d-447a-9b95-debe656c3e84 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:22.367402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 96/183] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:22.367402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82f8bb-929d-447a-9b95-debe656c3e84 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:22.415204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 88/184] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:22.415204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a15995-e458-43b1-9151-a729e3c5f9a4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:22.481511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a82f8bb-929d-447a-9b95-debe656c3e84 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:22.510726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:22.516381 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3dbe6-38ec-441f-9799-5b8bbc123d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:22.517027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3dbe6-38ec-441f-9799-5b8bbc123d04 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:22.517312 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3dbe6-38ec-441f-9799-5b8bbc123d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:22.517414 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a15995-e458-43b1-9151-a729e3c5f9a4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:22.517587 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3dbe6-38ec-441f-9799-5b8bbc123d04 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:22.518800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3dbe6-38ec-441f-9799-5b8bbc123d04 None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:22.520262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3dbe6-38ec-441f-9799-5b8bbc123d04 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:22.521934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 97/185] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:22 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:22.523111 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027d841-f26f-485e-941a-41d76557ea36 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:22.523393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027d841-f26f-485e-941a-41d76557ea36 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:22.523670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027d841-f26f-485e-941a-41d76557ea36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:22.535558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:22.544352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d027d841-f26f-485e-941a-41d76557ea36 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:22.546432 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d027d841-f26f-485e-941a-41d76557ea36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:22.556404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f47c9b-66ce-4c3b-a328-b2653377a80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:22.557020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f47c9b-66ce-4c3b-a328-b2653377a80b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:22.557297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f47c9b-66ce-4c3b-a328-b2653377a80b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:22.557570 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f47c9b-66ce-4c3b-a328-b2653377a80b None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:22.558292 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f47c9b-66ce-4c3b-a328-b2653377a80b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:22.558617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f47c9b-66ce-4c3b-a328-b2653377a80b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:22.559994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f47c9b-66ce-4c3b-a328-b2653377a80b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:22.569793 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 89/186] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:22.576209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578e196-975f-46b9-b311-b3c4994b4ee4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:22.576209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578e196-975f-46b9-b311-b3c4994b4ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:22.576209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9578e196-975f-46b9-b311-b3c4994b4ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:22.592438 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9578e196-975f-46b9-b311-b3c4994b4ee4 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:22.593621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9578e196-975f-46b9-b311-b3c4994b4ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:22.624636 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 98/187] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:22.625792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027d841-f26f-485e-941a-41d76557ea36 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:22.663767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 90/188] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:22.664612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578e196-975f-46b9-b311-b3c4994b4ee4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:22.736514 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027d841-f26f-485e-941a-41d76557ea36 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:22.762222 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9578e196-975f-46b9-b311-b3c4994b4ee4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:22.765226 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:22.772112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:22.772247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bf2a8-7383-4134-a4fb-243c120e2a45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:22.772740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bf2a8-7383-4134-a4fb-243c120e2a45 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:22.773039 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bf2a8-7383-4134-a4fb-243c120e2a45 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:22.773537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324bf2a8-7383-4134-a4fb-243c120e2a45 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:22.774415 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324bf2a8-7383-4134-a4fb-243c120e2a45 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:22.775928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324bf2a8-7383-4134-a4fb-243c120e2a45 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:22.798679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 99/189] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:08:22 2022] POST /identity/v3/users => generated 297 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:08:22.800750 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e99381-d985-4b9e-95f4-52bad78446d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:22.801593 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e99381-d985-4b9e-95f4-52bad78446d0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:22.801873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e99381-d985-4b9e-95f4-52bad78446d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:22.802164 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e99381-d985-4b9e-95f4-52bad78446d0 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:22.803406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e99381-d985-4b9e-95f4-52bad78446d0 None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:22.803662 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bf2a8-7383-4134-a4fb-243c120e2a45 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:22.805428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e99381-d985-4b9e-95f4-52bad78446d0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:22.807726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 91/190] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:22 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:22.808555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e99381-d985-4b9e-95f4-52bad78446d0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:22.921598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324bf2a8-7383-4134-a4fb-243c120e2a45 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:22.934747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e99381-d985-4b9e-95f4-52bad78446d0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:22.962991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e752e5-45c1-443e-89a9-aaa7dc422382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:22.964070 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e752e5-45c1-443e-89a9-aaa7dc422382 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:22.964361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e752e5-45c1-443e-89a9-aaa7dc422382 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:22.964637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e752e5-45c1-443e-89a9-aaa7dc422382 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:22.965764 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e752e5-45c1-443e-89a9-aaa7dc422382 None admin] RBAC: Adding query filter params (role.id=b99d323b1fad482ead67a8e8501c1c0b, scope.project.id=cf19eb89de594cdaaf28c40785f2dfac, user.id=c37e568c83a64a37acb7f86a4a1011b0) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:22.966076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e752e5-45c1-443e-89a9-aaa7dc422382 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:22.967601 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e752e5-45c1-443e-89a9-aaa7dc422382 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:22.974873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 100/191] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:22 2022] GET /identity/v3/role_assignments?user.id=c37e568c83a64a37acb7f86a4a1011b0&scope.project.id=cf19eb89de594cdaaf28c40785f2dfac&role.id=b99d323b1fad482ead67a8e8501c1c0b => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:22.975526 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e752e5-45c1-443e-89a9-aaa7dc422382 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:22.980593 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c333f-a1cb-463f-ab09-8aa325c23bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:22.981524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c333f-a1cb-463f-ab09-8aa325c23bca None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:22.981973 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c333f-a1cb-463f-ab09-8aa325c23bca None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:22.982454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23c333f-a1cb-463f-ab09-8aa325c23bca None admin] PATH_INFO: `/v3/users/f28a635a833a4cc9be7bb56bf793b0f0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:23.003499 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c333f-a1cb-463f-ab09-8aa325c23bca None admin] RBAC: Authorizing `identity:get_user(user_id=f28a635a833a4cc9be7bb56bf793b0f0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:23.005027 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23c333f-a1cb-463f-ab09-8aa325c23bca None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:23.011668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 92/192] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:22 2022] GET /identity/v3/users/f28a635a833a4cc9be7bb56bf793b0f0 => generated 283 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:23.011668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c333f-a1cb-463f-ab09-8aa325c23bca None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:23.060678 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:23.063419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:23.134439 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e752e5-45c1-443e-89a9-aaa7dc422382 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:23.164253 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23c333f-a1cb-463f-ab09-8aa325c23bca None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:23.177440 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc5785-f788-4911-89f0-8cb69d9b936e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:23.178194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc5785-f788-4911-89f0-8cb69d9b936e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:23.178472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc5785-f788-4911-89f0-8cb69d9b936e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:23.178824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc5785-f788-4911-89f0-8cb69d9b936e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:23.195658 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc5785-f788-4911-89f0-8cb69d9b936e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-aadc5785-f788-4911-89f0-8cb69d9b936e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:23.201155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:23.202080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:23.203168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:23.203168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:23.203168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:23.203168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:23.203168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:23.203168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:23.203168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:23.203168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:23.203168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:23.203168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:23.203168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:23.203168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:23.203168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 101/193] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:08:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:23.207297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc5785-f788-4911-89f0-8cb69d9b936e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:23.211700 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5a12a-2a43-432c-bfee-81b4b9e228a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:23.212358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5a12a-2a43-432c-bfee-81b4b9e228a6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:23.212774 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5a12a-2a43-432c-bfee-81b4b9e228a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:23.213050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c5a12a-2a43-432c-bfee-81b4b9e228a6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:23.227045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c5a12a-2a43-432c-bfee-81b4b9e228a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-22c5a12a-2a43-432c-bfee-81b4b9e228a6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:23.233429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:23.234309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:23.235157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:23.235157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:23.235157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:23.235157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:23.235157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:23.235157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:23.235157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:23.235157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:23.235157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:23.235157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:23.235157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:23.235157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:23.235762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 93/194] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:23.236390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5a12a-2a43-432c-bfee-81b4b9e228a6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:23.336109 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc5785-f788-4911-89f0-8cb69d9b936e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:23.347457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:23.348998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:23.358137 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c5a12a-2a43-432c-bfee-81b4b9e228a6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:23.377792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31abc1-5f5e-4db4-be9e-cbd6d918132d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:23.378425 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31abc1-5f5e-4db4-be9e-cbd6d918132d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:23.378839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31abc1-5f5e-4db4-be9e-cbd6d918132d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:23.379121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f31abc1-5f5e-4db4-be9e-cbd6d918132d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:23.379930 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31abc1-5f5e-4db4-be9e-cbd6d918132d None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=cf19eb89de594cdaaf28c40785f2dfac, user.id=22dd50ff891948b58a7664099f06c392) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:23.380239 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31abc1-5f5e-4db4-be9e-cbd6d918132d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:23.381930 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f31abc1-5f5e-4db4-be9e-cbd6d918132d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:23.388908 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 102/195] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:23 2022] GET /identity/v3/role_assignments?user.id=22dd50ff891948b58a7664099f06c392&scope.project.id=cf19eb89de594cdaaf28c40785f2dfac&role.id=0681632796d144f6a7ac8eca157001ec => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:23.389750 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31abc1-5f5e-4db4-be9e-cbd6d918132d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:23.400382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176114d-9211-45f6-ad52-0f68f63bb111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:23.401040 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176114d-9211-45f6-ad52-0f68f63bb111 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:23.401488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176114d-9211-45f6-ad52-0f68f63bb111 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:23.401763 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d176114d-9211-45f6-ad52-0f68f63bb111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:23.485504 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176114d-9211-45f6-ad52-0f68f63bb111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:23.487167 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d176114d-9211-45f6-ad52-0f68f63bb111 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:23.509550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f31abc1-5f5e-4db4-be9e-cbd6d918132d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:23.559071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57195ac-0636-4791-a601-b997ae21d959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:23.559715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57195ac-0636-4791-a601-b997ae21d959 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:23.560000 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57195ac-0636-4791-a601-b997ae21d959 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:23.560280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57195ac-0636-4791-a601-b997ae21d959 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:23.561126 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57195ac-0636-4791-a601-b997ae21d959 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:23.561438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57195ac-0636-4791-a601-b997ae21d959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:23.563089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57195ac-0636-4791-a601-b997ae21d959 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:23.573199 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 103/196] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:08:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:23.574084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57195ac-0636-4791-a601-b997ae21d959 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:23.613861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:23.646529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:23.660112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 94/197] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:23.660828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176114d-9211-45f6-ad52-0f68f63bb111 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:23.689980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57195ac-0636-4791-a601-b997ae21d959 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:23.729263 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7cc26-b084-4bc6-967b-4987e9d59570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:23.729986 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7cc26-b084-4bc6-967b-4987e9d59570 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:23.730280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7cc26-b084-4bc6-967b-4987e9d59570 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:23.730561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e7cc26-b084-4bc6-967b-4987e9d59570 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:23.731310 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7cc26-b084-4bc6-967b-4987e9d59570 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:23.731623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7cc26-b084-4bc6-967b-4987e9d59570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:23.733248 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e7cc26-b084-4bc6-967b-4987e9d59570 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:23.742472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 104/198] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:23.743323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7cc26-b084-4bc6-967b-4987e9d59570 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:23.784998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d176114d-9211-45f6-ad52-0f68f63bb111 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:23.826162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5c831-35f9-41dd-b98d-2aab6f63d8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:23.826888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5c831-35f9-41dd-b98d-2aab6f63d8d0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:23.827224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5c831-35f9-41dd-b98d-2aab6f63d8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:23.827498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb5c831-35f9-41dd-b98d-2aab6f63d8d0 None admin] PATH_INFO: `/v3/users/f28a635a833a4cc9be7bb56bf793b0f0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:23.828940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5c831-35f9-41dd-b98d-2aab6f63d8d0 None admin] RBAC: Authorizing `identity:get_user(user_id=f28a635a833a4cc9be7bb56bf793b0f0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:23.830562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb5c831-35f9-41dd-b98d-2aab6f63d8d0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:23.832711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 95/199] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:23 2022] GET /identity/v3/users/f28a635a833a4cc9be7bb56bf793b0f0 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:23.833558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5c831-35f9-41dd-b98d-2aab6f63d8d0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:23.853231 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:23.858556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e7cc26-b084-4bc6-967b-4987e9d59570 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:23.900244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311e977-e5a9-4538-8a22-0bc3485025f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:23.900815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311e977-e5a9-4538-8a22-0bc3485025f0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:23.901100 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311e977-e5a9-4538-8a22-0bc3485025f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:23.901375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e311e977-e5a9-4538-8a22-0bc3485025f0 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:23.902686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311e977-e5a9-4538-8a22-0bc3485025f0 None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:23.904274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e311e977-e5a9-4538-8a22-0bc3485025f0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:23.906345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 105/200] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:23 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:23.907027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311e977-e5a9-4538-8a22-0bc3485025f0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:23.908865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:23.954395 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb5c831-35f9-41dd-b98d-2aab6f63d8d0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:23.994036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a8c63-ff48-4d53-9cea-82cb13b9e3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:23.994772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a8c63-ff48-4d53-9cea-82cb13b9e3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:23.995100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a8c63-ff48-4d53-9cea-82cb13b9e3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:23.995377 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95a8c63-ff48-4d53-9cea-82cb13b9e3d9 None admin] PATH_INFO: `/v3/users/1725f0355c2c4b328ecabf7643c01fd2` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:23.999836 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a8c63-ff48-4d53-9cea-82cb13b9e3d9 None admin] RBAC: Authorizing `identity:get_user(user_id=1725f0355c2c4b328ecabf7643c01fd2)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:24.001687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95a8c63-ff48-4d53-9cea-82cb13b9e3d9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:24.003718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 96/201] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:23 2022] GET /identity/v3/users/1725f0355c2c4b328ecabf7643c01fd2 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:24.005321 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a8c63-ff48-4d53-9cea-82cb13b9e3d9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:24.032312 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e311e977-e5a9-4538-8a22-0bc3485025f0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:24.070251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb94538-8b46-4029-a43e-a0a772ca5bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:24.070921 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb94538-8b46-4029-a43e-a0a772ca5bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:24.071260 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb94538-8b46-4029-a43e-a0a772ca5bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:24.071729 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb94538-8b46-4029-a43e-a0a772ca5bb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:24.109007 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:24.121581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95a8c63-ff48-4d53-9cea-82cb13b9e3d9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:24.146524 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb94538-8b46-4029-a43e-a0a772ca5bb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:24.148732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb94538-8b46-4029-a43e-a0a772ca5bb6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:24.153682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:24.161141 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a60e8-ae12-4473-b0c2-112211533895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:24.162191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a60e8-ae12-4473-b0c2-112211533895 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:24.162748 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a60e8-ae12-4473-b0c2-112211533895 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:24.163284 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114a60e8-ae12-4473-b0c2-112211533895 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:24.164957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a60e8-ae12-4473-b0c2-112211533895 None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=9298874051964940922f79dd919bafce, user.id=f28a635a833a4cc9be7bb56bf793b0f0) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:24.165496 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a60e8-ae12-4473-b0c2-112211533895 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:24.167394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114a60e8-ae12-4473-b0c2-112211533895 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:24.173735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 97/202] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:24 2022] GET /identity/v3/role_assignments?user.id=f28a635a833a4cc9be7bb56bf793b0f0&scope.project.id=9298874051964940922f79dd919bafce&role.id=0681632796d144f6a7ac8eca157001ec => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:24.174934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a60e8-ae12-4473-b0c2-112211533895 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:24.266009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 106/203] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:24.278265 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb94538-8b46-4029-a43e-a0a772ca5bb6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:24.310049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114a60e8-ae12-4473-b0c2-112211533895 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:24.349120 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc80abe-be64-4d8f-97c7-1221a28fa073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:24.350128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc80abe-be64-4d8f-97c7-1221a28fa073 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:24.350724 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc80abe-be64-4d8f-97c7-1221a28fa073 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:24.351221 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc80abe-be64-4d8f-97c7-1221a28fa073 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:24.402972 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:24.441753 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb94538-8b46-4029-a43e-a0a772ca5bb6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:24.446153 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:24.457747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc80abe-be64-4d8f-97c7-1221a28fa073 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:24.459285 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbc80abe-be64-4d8f-97c7-1221a28fa073 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:24.485174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bd69a-c461-4f4b-b1c2-f520b85b1787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:24.485834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bd69a-c461-4f4b-b1c2-f520b85b1787 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:24.486166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bd69a-c461-4f4b-b1c2-f520b85b1787 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:24.486449 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bd69a-c461-4f4b-b1c2-f520b85b1787 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:24.487698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bd69a-c461-4f4b-b1c2-f520b85b1787 None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:24.489179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bd69a-c461-4f4b-b1c2-f520b85b1787 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:24.491282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 107/204] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:24 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:24.497067 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bd69a-c461-4f4b-b1c2-f520b85b1787 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:24.611039 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bd69a-c461-4f4b-b1c2-f520b85b1787 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:24.668922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472624d-792c-4b66-b403-7022bea6d4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:24.669548 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472624d-792c-4b66-b403-7022bea6d4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:24.669833 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472624d-792c-4b66-b403-7022bea6d4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:24.670107 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c472624d-792c-4b66-b403-7022bea6d4d0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:24.670932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472624d-792c-4b66-b403-7022bea6d4d0 None admin] RBAC: Adding query filter params (role.id=b99d323b1fad482ead67a8e8501c1c0b, scope.project.id=9298874051964940922f79dd919bafce, user.id=f28a635a833a4cc9be7bb56bf793b0f0) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:24.671247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472624d-792c-4b66-b403-7022bea6d4d0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:24.674199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 98/205] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:24.675503 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c472624d-792c-4b66-b403-7022bea6d4d0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:24.678871 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:24.680129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc80abe-be64-4d8f-97c7-1221a28fa073 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:24.690073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 108/206] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:24 2022] GET /identity/v3/role_assignments?user.id=f28a635a833a4cc9be7bb56bf793b0f0&scope.project.id=9298874051964940922f79dd919bafce&role.id=b99d323b1fad482ead67a8e8501c1c0b => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:24.789679 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:24.802858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc80abe-be64-4d8f-97c7-1221a28fa073 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:24.850308 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5816ca5c-1843-4cde-8204-0c56234cb443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:24.851038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816ca5c-1843-4cde-8204-0c56234cb443 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:24.851319 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816ca5c-1843-4cde-8204-0c56234cb443 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:24.851591 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816ca5c-1843-4cde-8204-0c56234cb443 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:24.852843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816ca5c-1843-4cde-8204-0c56234cb443 None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:24.854334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5816ca5c-1843-4cde-8204-0c56234cb443 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:24.856095 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 99/207] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:24 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:24.862347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472624d-792c-4b66-b403-7022bea6d4d0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:25.002693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c472624d-792c-4b66-b403-7022bea6d4d0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:25.049030 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d405849-66b5-4985-a71a-8bf54937d59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:25.049645 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d405849-66b5-4985-a71a-8bf54937d59b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:25.049923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d405849-66b5-4985-a71a-8bf54937d59b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:25.050113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d405849-66b5-4985-a71a-8bf54937d59b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:25.050945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d405849-66b5-4985-a71a-8bf54937d59b None admin] RBAC: Adding query filter params (role.id=cead600aedc04a92955d0976f7f9e0fd, scope.project.id=cf19eb89de594cdaaf28c40785f2dfac, user.id=1725f0355c2c4b328ecabf7643c01fd2) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:25.051254 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d405849-66b5-4985-a71a-8bf54937d59b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:25.052804 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d405849-66b5-4985-a71a-8bf54937d59b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:25.059311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 109/208] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:24 2022] GET /identity/v3/role_assignments?user.id=1725f0355c2c4b328ecabf7643c01fd2&scope.project.id=cf19eb89de594cdaaf28c40785f2dfac&role.id=cead600aedc04a92955d0976f7f9e0fd => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:25.277236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dec1b-b06b-44d7-9ee9-3fb6f0c3a539 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:25.277734 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dec1b-b06b-44d7-9ee9-3fb6f0c3a539 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:25.277808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29dec1b-b06b-44d7-9ee9-3fb6f0c3a539 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:25.279178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 100/209] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:25.284481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4bd2c-158a-4ceb-9253-cdb2e1b36fac None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:25.284778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4bd2c-158a-4ceb-9253-cdb2e1b36fac None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:25.285059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d4bd2c-158a-4ceb-9253-cdb2e1b36fac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:25.304214 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b3d4bd2c-158a-4ceb-9253-cdb2e1b36fac None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:25.305368 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b3d4bd2c-158a-4ceb-9253-cdb2e1b36fac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:25.366130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:25.376933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 110/210] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:25.400554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dec1b-b06b-44d7-9ee9-3fb6f0c3a539 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:25.516685 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29dec1b-b06b-44d7-9ee9-3fb6f0c3a539 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:25.556468 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48177b49-3991-4fef-8739-b0afa2c6ee68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:25.557035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48177b49-3991-4fef-8739-b0afa2c6ee68 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:25.557319 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48177b49-3991-4fef-8739-b0afa2c6ee68 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:25.557591 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48177b49-3991-4fef-8739-b0afa2c6ee68 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:25.568449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48177b49-3991-4fef-8739-b0afa2c6ee68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-48177b49-3991-4fef-8739-b0afa2c6ee68 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:25.574161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:25.575079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:25.575873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:25.575873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:25.575873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:25.575873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:25.575873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:25.575873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:25.575873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:25.575873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:25.575873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:25.575873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:25.575873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:25.575873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:25.575873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 101/211] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:25.581281 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4bd2c-158a-4ceb-9253-cdb2e1b36fac None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:25.602266 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8850e-cfd6-4caf-ba7a-ead5aaf44c09 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:25.602606 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8850e-cfd6-4caf-ba7a-ead5aaf44c09 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:25.602847 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8850e-cfd6-4caf-ba7a-ead5aaf44c09 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:25.604275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 102/212] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:08:25.609604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87245e4f-9847-4d51-b683-2b9e7a5a0a32 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:25.609891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87245e4f-9847-4d51-b683-2b9e7a5a0a32 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:25.610168 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87245e4f-9847-4d51-b683-2b9e7a5a0a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:25.644137 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-87245e4f-9847-4d51-b683-2b9e7a5a0a32 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:25.645468 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-87245e4f-9847-4d51-b683-2b9e7a5a0a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:25.671097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:25.721172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d4bd2c-158a-4ceb-9253-cdb2e1b36fac None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:25.731618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 103/213] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:25.759070 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87245e4f-9847-4d51-b683-2b9e7a5a0a32 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:25.766444 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6523b2a-4008-4f93-a2d0-615fa9a60d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:25.767314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6523b2a-4008-4f93-a2d0-615fa9a60d89 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:25.767745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6523b2a-4008-4f93-a2d0-615fa9a60d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:25.768166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6523b2a-4008-4f93-a2d0-615fa9a60d89 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:25.769056 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6523b2a-4008-4f93-a2d0-615fa9a60d89 None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:25.769640 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6523b2a-4008-4f93-a2d0-615fa9a60d89 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:25.771224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6523b2a-4008-4f93-a2d0-615fa9a60d89 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:25.782624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 111/214] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:25.788166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6523b2a-4008-4f93-a2d0-615fa9a60d89 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:25.847795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:25.877161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87245e4f-9847-4d51-b683-2b9e7a5a0a32 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:25.898323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6523b2a-4008-4f93-a2d0-615fa9a60d89 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:25.912792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a687af-ea2a-407b-9d8a-ed3957c15640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:25.914356 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a687af-ea2a-407b-9d8a-ed3957c15640 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:25.914852 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a687af-ea2a-407b-9d8a-ed3957c15640 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:25.915363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a687af-ea2a-407b-9d8a-ed3957c15640 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:25.916768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a687af-ea2a-407b-9d8a-ed3957c15640 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:25.918490 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a687af-ea2a-407b-9d8a-ed3957c15640 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:25.925044 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 104/215] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:25.926134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a687af-ea2a-407b-9d8a-ed3957c15640 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:25.936311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81c5eb-1d2e-4dd7-a8d9-8a698f4506a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:25.937096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81c5eb-1d2e-4dd7-a8d9-8a698f4506a3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:25.937403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81c5eb-1d2e-4dd7-a8d9-8a698f4506a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:25.937674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c81c5eb-1d2e-4dd7-a8d9-8a698f4506a3 None admin] PATH_INFO: `/v3/users/30731648be9044808a46feb64f2b265a` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:25.950918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:25.951745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81c5eb-1d2e-4dd7-a8d9-8a698f4506a3 None admin] RBAC: Authorizing `identity:get_user(user_id=30731648be9044808a46feb64f2b265a)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:25.952931 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c81c5eb-1d2e-4dd7-a8d9-8a698f4506a3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:25.954659 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 112/216] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:25 2022] GET /identity/v3/users/30731648be9044808a46feb64f2b265a => generated 297 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:25.960272 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81c5eb-1d2e-4dd7-a8d9-8a698f4506a3 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:26.040119 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a687af-ea2a-407b-9d8a-ed3957c15640 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:26.074923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c81c5eb-1d2e-4dd7-a8d9-8a698f4506a3 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:26.076728 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be6f8c-cfe5-4737-b118-9592e79d6948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:26.077368 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be6f8c-cfe5-4737-b118-9592e79d6948 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:26.077635 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be6f8c-cfe5-4737-b118-9592e79d6948 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:26.077902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2be6f8c-cfe5-4737-b118-9592e79d6948 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:26.078608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be6f8c-cfe5-4737-b118-9592e79d6948 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:26.080078 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2be6f8c-cfe5-4737-b118-9592e79d6948 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:26.091668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:26.112251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 105/217] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:08:25 2022] POST /identity/v3/users => generated 297 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:08:26.117820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dda42-b696-47ff-8fec-6caf4fff9631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:26.118757 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dda42-b696-47ff-8fec-6caf4fff9631 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:26.119304 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dda42-b696-47ff-8fec-6caf4fff9631 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:26.119777 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22dda42-b696-47ff-8fec-6caf4fff9631 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:26.212019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22dda42-b696-47ff-8fec-6caf4fff9631 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:26.214267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22dda42-b696-47ff-8fec-6caf4fff9631 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:26.327350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 113/218] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:26.333378 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be6f8c-cfe5-4737-b118-9592e79d6948 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:26.425326 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:26.452062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2be6f8c-cfe5-4737-b118-9592e79d6948 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:26.491511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d99339-38b0-45e5-9d12-424c7a7660b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:26.492548 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d99339-38b0-45e5-9d12-424c7a7660b6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:26.493014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d99339-38b0-45e5-9d12-424c7a7660b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:26.493457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d99339-38b0-45e5-9d12-424c7a7660b6 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:26.494907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d99339-38b0-45e5-9d12-424c7a7660b6 None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:26.496517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d99339-38b0-45e5-9d12-424c7a7660b6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:26.499008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 106/219] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:26 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:26.505176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dda42-b696-47ff-8fec-6caf4fff9631 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:26.520644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:26.588730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9bab5-dca6-4759-91b0-8208d05caec1 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:26.589008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9bab5-dca6-4759-91b0-8208d05caec1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:26.589279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c9bab5-dca6-4759-91b0-8208d05caec1 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:26.590636 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 107/220] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:08:26.597562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3e693-f2e7-4edb-8821-64c7862d9c02 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:26.597849 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3e693-f2e7-4edb-8821-64c7862d9c02 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:26.598122 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb3e693-f2e7-4edb-8821-64c7862d9c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:26.623476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6eb3e693-f2e7-4edb-8821-64c7862d9c02 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:26.625380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6eb3e693-f2e7-4edb-8821-64c7862d9c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:26.628053 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22dda42-b696-47ff-8fec-6caf4fff9631 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:26.683362 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc2fde-c2de-4bae-9c76-104d29ff3007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:26.683906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc2fde-c2de-4bae-9c76-104d29ff3007 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:26.684185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc2fde-c2de-4bae-9c76-104d29ff3007 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:26.684457 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dc2fde-c2de-4bae-9c76-104d29ff3007 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:26.685250 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc2fde-c2de-4bae-9c76-104d29ff3007 None admin] RBAC: Adding query filter params (role.id=125ef16e078848b2bd772db91d4115d4, scope.project.id=9298874051964940922f79dd919bafce, user.id=30731648be9044808a46feb64f2b265a) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:26.685559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc2fde-c2de-4bae-9c76-104d29ff3007 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:26.687054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0dc2fde-c2de-4bae-9c76-104d29ff3007 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:26.693428 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 114/221] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:26 2022] GET /identity/v3/role_assignments?user.id=30731648be9044808a46feb64f2b265a&scope.project.id=9298874051964940922f79dd919bafce&role.id=125ef16e078848b2bd772db91d4115d4 => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:26.725265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 108/222] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:26.757639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc2fde-c2de-4bae-9c76-104d29ff3007 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:26.862534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:26.888320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0dc2fde-c2de-4bae-9c76-104d29ff3007 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:26.924368 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50779d3-fdda-47b5-b624-b4f2d722791e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:26.925002 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50779d3-fdda-47b5-b624-b4f2d722791e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:26.925281 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50779d3-fdda-47b5-b624-b4f2d722791e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:26.925608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50779d3-fdda-47b5-b624-b4f2d722791e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:26.937411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50779d3-fdda-47b5-b624-b4f2d722791e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d50779d3-fdda-47b5-b624-b4f2d722791e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:26.942725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:26.943604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:26.944406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:26.944406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:26.944406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:26.944406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:26.944406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:26.944406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:26.944406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:26.944406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:26.944406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:26.944406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:26.944406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:26.944406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:26.944406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 115/223] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:08:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:26.949670 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3e693-f2e7-4edb-8821-64c7862d9c02 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:27.084341 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:27.118427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb3e693-f2e7-4edb-8821-64c7862d9c02 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:27.158932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3640381-a782-4af0-a937-3edf54554305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:27.159557 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3640381-a782-4af0-a937-3edf54554305 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:27.159832 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3640381-a782-4af0-a937-3edf54554305 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:27.160102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3640381-a782-4af0-a937-3edf54554305 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:27.160818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3640381-a782-4af0-a937-3edf54554305 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:27.161118 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3640381-a782-4af0-a937-3edf54554305 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:27.162494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3640381-a782-4af0-a937-3edf54554305 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:27.171891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 109/224] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:27.177023 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50779d3-fdda-47b5-b624-b4f2d722791e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:27.241111 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56775da9-1767-43ff-b283-550fe4870306 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:27.241433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56775da9-1767-43ff-b283-550fe4870306 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:27.241666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56775da9-1767-43ff-b283-550fe4870306 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:27.243061 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 110/225] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:08:27.248202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354def0-6b0d-4b45-a41e-2f1ee418515e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:27.248484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354def0-6b0d-4b45-a41e-2f1ee418515e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:27.248756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8354def0-6b0d-4b45-a41e-2f1ee418515e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:27.276958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8354def0-6b0d-4b45-a41e-2f1ee418515e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:27.278173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8354def0-6b0d-4b45-a41e-2f1ee418515e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:27.308496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50779d3-fdda-47b5-b624-b4f2d722791e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:27.345554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2babdd-e146-4646-95fc-0ac99f900ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:27.346310 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2babdd-e146-4646-95fc-0ac99f900ffb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:27.346602 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2babdd-e146-4646-95fc-0ac99f900ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:27.346885 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2babdd-e146-4646-95fc-0ac99f900ffb None admin] PATH_INFO: `/v3/users/f28a635a833a4cc9be7bb56bf793b0f0` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:27.348056 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2babdd-e146-4646-95fc-0ac99f900ffb None admin] RBAC: Authorizing `identity:get_user(user_id=f28a635a833a4cc9be7bb56bf793b0f0)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:27.349613 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2babdd-e146-4646-95fc-0ac99f900ffb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:27.351717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 116/226] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:27 2022] GET /identity/v3/users/f28a635a833a4cc9be7bb56bf793b0f0 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:27.357349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2babdd-e146-4646-95fc-0ac99f900ffb None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:27.362909 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:27.395015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 111/227] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:27.429610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354def0-6b0d-4b45-a41e-2f1ee418515e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:27.530662 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2babdd-e146-4646-95fc-0ac99f900ffb None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:27.531297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:27.602097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8354def0-6b0d-4b45-a41e-2f1ee418515e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:27.604049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58c31a-f52c-4c18-8e71-6c59b08d8260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:27.604952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58c31a-f52c-4c18-8e71-6c59b08d8260 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:27.605298 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58c31a-f52c-4c18-8e71-6c59b08d8260 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:27.605669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa58c31a-f52c-4c18-8e71-6c59b08d8260 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:27.606961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58c31a-f52c-4c18-8e71-6c59b08d8260 None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:27.608524 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa58c31a-f52c-4c18-8e71-6c59b08d8260 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:27.614730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 117/228] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:27 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:27.618474 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58c31a-f52c-4c18-8e71-6c59b08d8260 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:27.649540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb9fff-98a2-4fae-adf6-48b9ec032579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:27.650951 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb9fff-98a2-4fae-adf6-48b9ec032579 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:27.651591 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb9fff-98a2-4fae-adf6-48b9ec032579 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:27.652082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb9fff-98a2-4fae-adf6-48b9ec032579 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:27.675110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb9fff-98a2-4fae-adf6-48b9ec032579 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6dcb9fff-98a2-4fae-adf6-48b9ec032579 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:27.685841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:27.686762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:27.687552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:27.687552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:27.687552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:27.687552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:27.687552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:27.687552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:27.687552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:27.687552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:27.687552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:27.687552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:27.687552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:27.687552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:27.688157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 112/229] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:08:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:27.695716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb9fff-98a2-4fae-adf6-48b9ec032579 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:27.738478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:27.772416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa58c31a-f52c-4c18-8e71-6c59b08d8260 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:27.810817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b3623-13f9-488b-90d0-f4f31ccbaca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:27.810817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b3623-13f9-488b-90d0-f4f31ccbaca5 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:27.810817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b3623-13f9-488b-90d0-f4f31ccbaca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:27.810817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b3623-13f9-488b-90d0-f4f31ccbaca5 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce/users/f28a635a833a4cc9be7bb56bf793b0f0/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:27.812540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b3623-13f9-488b-90d0-f4f31ccbaca5 None admin] RBAC: Authorizing `identity:create_grant(project_id=9298874051964940922f79dd919bafce, user_id=f28a635a833a4cc9be7bb56bf793b0f0, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:27.814200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b3623-13f9-488b-90d0-f4f31ccbaca5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:27.840317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 118/230] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:08:27 2022] PUT /identity/v3/projects/9298874051964940922f79dd919bafce/users/f28a635a833a4cc9be7bb56bf793b0f0/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:08:27.880983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb9fff-98a2-4fae-adf6-48b9ec032579 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:27.912891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:27.924320 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5bfb7-afc1-447a-8ff5-97a29d45a190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:27.925199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5bfb7-afc1-447a-8ff5-97a29d45a190 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:27.925651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5bfb7-afc1-447a-8ff5-97a29d45a190 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:27.926136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb5bfb7-afc1-447a-8ff5-97a29d45a190 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:27.927042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5bfb7-afc1-447a-8ff5-97a29d45a190 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:27.927636 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5bfb7-afc1-447a-8ff5-97a29d45a190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:27.929253 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb5bfb7-afc1-447a-8ff5-97a29d45a190 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:27.939698 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 113/231] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:08:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:27.945622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b3623-13f9-488b-90d0-f4f31ccbaca5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:28.107424 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b3623-13f9-488b-90d0-f4f31ccbaca5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:28.137650 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:28.147237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ddc81-6468-4616-9b34-0bf9147ca74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:28.148529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ddc81-6468-4616-9b34-0bf9147ca74f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:28.148813 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ddc81-6468-4616-9b34-0bf9147ca74f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:28.149084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33ddc81-6468-4616-9b34-0bf9147ca74f None admin] PATH_INFO: `/v3/users/f28a635a833a4cc9be7bb56bf793b0f0` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:28.152220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ddc81-6468-4616-9b34-0bf9147ca74f None admin] RBAC: Authorizing `identity:get_user(user_id=f28a635a833a4cc9be7bb56bf793b0f0)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:28.153771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33ddc81-6468-4616-9b34-0bf9147ca74f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:28.155730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 119/232] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:27 2022] GET /identity/v3/users/f28a635a833a4cc9be7bb56bf793b0f0 => generated 283 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:28.161410 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5bfb7-afc1-447a-8ff5-97a29d45a190 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:28.288637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb5bfb7-afc1-447a-8ff5-97a29d45a190 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:28.324812 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d414e0ca-009d-47a2-90cb-6fca3b9d5de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:28.325803 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414e0ca-009d-47a2-90cb-6fca3b9d5de4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:28.326286 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414e0ca-009d-47a2-90cb-6fca3b9d5de4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:28.326782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d414e0ca-009d-47a2-90cb-6fca3b9d5de4 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:28.328172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414e0ca-009d-47a2-90cb-6fca3b9d5de4 None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:28.329840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d414e0ca-009d-47a2-90cb-6fca3b9d5de4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:28.332082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 114/233] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:28 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:28.343637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ddc81-6468-4616-9b34-0bf9147ca74f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:28.501520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33ddc81-6468-4616-9b34-0bf9147ca74f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:28.552171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de2d18f-e1d0-49ab-a4c1-b451ac2140d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:28.552848 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2d18f-e1d0-49ab-a4c1-b451ac2140d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:28.553130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2d18f-e1d0-49ab-a4c1-b451ac2140d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:28.553405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de2d18f-e1d0-49ab-a4c1-b451ac2140d1 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce/users/f28a635a833a4cc9be7bb56bf793b0f0/roles/b99d323b1fad482ead67a8e8501c1c0b` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:28.556837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2d18f-e1d0-49ab-a4c1-b451ac2140d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=9298874051964940922f79dd919bafce, user_id=f28a635a833a4cc9be7bb56bf793b0f0, role_id=b99d323b1fad482ead67a8e8501c1c0b)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:28.558313 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de2d18f-e1d0-49ab-a4c1-b451ac2140d1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:28.598737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 120/234] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:08:28 2022] PUT /identity/v3/projects/9298874051964940922f79dd919bafce/users/f28a635a833a4cc9be7bb56bf793b0f0/roles/b99d323b1fad482ead67a8e8501c1c0b => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:08:28.816662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff5f20-a657-4d3a-bf81-767d85f7bf04 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:28.817173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff5f20-a657-4d3a-bf81-767d85f7bf04 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:28.817248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ff5f20-a657-4d3a-bf81-767d85f7bf04 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:28.818706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 115/235] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:28.840188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4f48f-c39f-4fff-a979-cfc6a1995b57 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:28.840188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4f48f-c39f-4fff-a979-cfc6a1995b57 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:28.840188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4f48f-c39f-4fff-a979-cfc6a1995b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:28.861686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-16a4f48f-c39f-4fff-a979-cfc6a1995b57 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:28.863287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-16a4f48f-c39f-4fff-a979-cfc6a1995b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:28.925684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:28.938752 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 121/236] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:28.967463 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff5f20-a657-4d3a-bf81-767d85f7bf04 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:29.035500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:29.094901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48880915-855d-40a8-8a64-e46f4a439877 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:29.095179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48880915-855d-40a8-8a64-e46f4a439877 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:29.095372 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48880915-855d-40a8-8a64-e46f4a439877 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:29.097013 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 122/237] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:08:29.098305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ff5f20-a657-4d3a-bf81-767d85f7bf04 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:29.102500 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91af0c6-ac03-459f-8d26-6c0dbb7cb350 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:29.102817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91af0c6-ac03-459f-8d26-6c0dbb7cb350 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:29.103091 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91af0c6-ac03-459f-8d26-6c0dbb7cb350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:29.129076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c91af0c6-ac03-459f-8d26-6c0dbb7cb350 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:29.130256 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c91af0c6-ac03-459f-8d26-6c0dbb7cb350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:29.135338 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dd8e7-bc0a-460c-bd4b-9b79d14fe5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:29.135984 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dd8e7-bc0a-460c-bd4b-9b79d14fe5dc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:29.136278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dd8e7-bc0a-460c-bd4b-9b79d14fe5dc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:29.136533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6dd8e7-bc0a-460c-bd4b-9b79d14fe5dc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:29.137680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6dd8e7-bc0a-460c-bd4b-9b79d14fe5dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:29.139161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6dd8e7-bc0a-460c-bd4b-9b79d14fe5dc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:29.145370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 116/238] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:29.146660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dd8e7-bc0a-460c-bd4b-9b79d14fe5dc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:29.202537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 123/239] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:29.227506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91af0c6-ac03-459f-8d26-6c0dbb7cb350 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:29.256805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6dd8e7-bc0a-460c-bd4b-9b79d14fe5dc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:29.282385 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:29.297685 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04fdba0-cff6-45d3-94d8-54def0c5c7af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:29.298334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fdba0-cff6-45d3-94d8-54def0c5c7af None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:29.298641 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fdba0-cff6-45d3-94d8-54def0c5c7af None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:29.298917 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04fdba0-cff6-45d3-94d8-54def0c5c7af None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:29.299614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fdba0-cff6-45d3-94d8-54def0c5c7af None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:29.301503 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04fdba0-cff6-45d3-94d8-54def0c5c7af None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:29.334232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 117/240] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:08:29 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:08:29.334232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d4cdc-1434-4527-810e-93457e12ea3e None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:29.334232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d4cdc-1434-4527-810e-93457e12ea3e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:29.334232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d4cdc-1434-4527-810e-93457e12ea3e None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:29.334232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 118/241] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:29.340278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ac2c8-02ec-40f2-b718-7b75c914578c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:29.340562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ac2c8-02ec-40f2-b718-7b75c914578c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:29.340828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ac2c8-02ec-40f2-b718-7b75c914578c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:29.371771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5b7ac2c8-02ec-40f2-b718-7b75c914578c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:29.373100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5b7ac2c8-02ec-40f2-b718-7b75c914578c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:29.425565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91af0c6-ac03-459f-8d26-6c0dbb7cb350 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:29.458788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 119/242] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:29.467618 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:29.504921 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d8827-f043-4f42-8fc5-af10f66314dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:29.505511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ac2c8-02ec-40f2-b718-7b75c914578c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:29.505619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d8827-f043-4f42-8fc5-af10f66314dd None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:29.505868 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d8827-f043-4f42-8fc5-af10f66314dd None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:29.506143 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d8827-f043-4f42-8fc5-af10f66314dd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:29.524418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185d8827-f043-4f42-8fc5-af10f66314dd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-185d8827-f043-4f42-8fc5-af10f66314dd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:29.530135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:29.531078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:29.532099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:29.532099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:29.532099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:29.532099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:29.532099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:29.532099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:29.532099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:29.532099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:29.532099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:29.532099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:29.532099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:29.532099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:29.532099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 124/243] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:08:29.537243 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d8827-f043-4f42-8fc5-af10f66314dd None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:29.644670 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ac2c8-02ec-40f2-b718-7b75c914578c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:29.660417 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:29.661852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185d8827-f043-4f42-8fc5-af10f66314dd None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:29.691617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527be6a8-b249-4d4c-b877-c8e0d4455edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:29.692285 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527be6a8-b249-4d4c-b877-c8e0d4455edb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:29.692726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527be6a8-b249-4d4c-b877-c8e0d4455edb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:29.693011 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527be6a8-b249-4d4c-b877-c8e0d4455edb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:29.705865 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9a95d-9825-4617-96d2-12cb4833f263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:29.706364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527be6a8-b249-4d4c-b877-c8e0d4455edb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:29.706546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9a95d-9825-4617-96d2-12cb4833f263 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:29.708600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9a95d-9825-4617-96d2-12cb4833f263 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:29.708893 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a9a95d-9825-4617-96d2-12cb4833f263 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:29.709633 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9a95d-9825-4617-96d2-12cb4833f263 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:29.709944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9a95d-9825-4617-96d2-12cb4833f263 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-527be6a8-b249-4d4c-b877-c8e0d4455edb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:29.711961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:29.712825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:29.713871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:29.713871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:29.713871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:29.713871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:29.713871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:29.713871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:29.713871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:29.713871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:29.713871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:29.713871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:29.713871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:29.713871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:29.714469 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a9a95d-9825-4617-96d2-12cb4833f263 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:29.714538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 120/244] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:29.722431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 125/245] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:29.723464 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527be6a8-b249-4d4c-b877-c8e0d4455edb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:29.730063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9a95d-9825-4617-96d2-12cb4833f263 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:29.789144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:29.877254 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a9a95d-9825-4617-96d2-12cb4833f263 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:29.885750 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527be6a8-b249-4d4c-b877-c8e0d4455edb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:29.920482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a24ccd-3265-4f51-8db2-d19b5f863592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:29.921613 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24ccd-3265-4f51-8db2-d19b5f863592 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:29.922222 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24ccd-3265-4f51-8db2-d19b5f863592 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:29.922753 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a24ccd-3265-4f51-8db2-d19b5f863592 None admin] PATH_INFO: `/v3/users/250990068f7c4e3d8349ec3fff5560d5` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:29.932505 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14724bbe-c73e-4a59-86b9-871269dbaa6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:29.933487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724bbe-c73e-4a59-86b9-871269dbaa6e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:29.933963 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724bbe-c73e-4a59-86b9-871269dbaa6e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:29.934642 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14724bbe-c73e-4a59-86b9-871269dbaa6e None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:29.935582 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14724bbe-c73e-4a59-86b9-871269dbaa6e None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:29.936164 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14724bbe-c73e-4a59-86b9-871269dbaa6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:29.937988 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a24ccd-3265-4f51-8db2-d19b5f863592 None admin] RBAC: Authorizing `identity:get_user(user_id=250990068f7c4e3d8349ec3fff5560d5)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:29.938101 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14724bbe-c73e-4a59-86b9-871269dbaa6e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:29.939501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a24ccd-3265-4f51-8db2-d19b5f863592 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:29.941524 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 126/246] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:29 2022] GET /identity/v3/users/250990068f7c4e3d8349ec3fff5560d5 => generated 297 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:29.947811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a24ccd-3265-4f51-8db2-d19b5f863592 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:29.957330 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 121/247] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:29.964095 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14724bbe-c73e-4a59-86b9-871269dbaa6e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:30.012520 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:30.086101 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a24ccd-3265-4f51-8db2-d19b5f863592 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:30.091752 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:30.110470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14724bbe-c73e-4a59-86b9-871269dbaa6e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:30.143158 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5304c-03c2-4986-9f9c-e6547832f2fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:30.144199 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5304c-03c2-4986-9f9c-e6547832f2fc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:30.144488 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5304c-03c2-4986-9f9c-e6547832f2fc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:30.144765 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a5304c-03c2-4986-9f9c-e6547832f2fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:30.153449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586430ca-1f86-4c7c-a0f8-65c3579712cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:30.154102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586430ca-1f86-4c7c-a0f8-65c3579712cb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:30.154388 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586430ca-1f86-4c7c-a0f8-65c3579712cb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:30.154721 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586430ca-1f86-4c7c-a0f8-65c3579712cb None admin] PATH_INFO: `/v3/users/30731648be9044808a46feb64f2b265a` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:30.155903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586430ca-1f86-4c7c-a0f8-65c3579712cb None admin] RBAC: Authorizing `identity:get_user(user_id=30731648be9044808a46feb64f2b265a)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:30.157426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586430ca-1f86-4c7c-a0f8-65c3579712cb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:30.159274 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 122/248] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:29 2022] GET /identity/v3/users/30731648be9044808a46feb64f2b265a => generated 297 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:30.164782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586430ca-1f86-4c7c-a0f8-65c3579712cb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:30.228119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5304c-03c2-4986-9f9c-e6547832f2fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:30.229560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a5304c-03c2-4986-9f9c-e6547832f2fc None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:30.315988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:30.322958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586430ca-1f86-4c7c-a0f8-65c3579712cb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:30.335861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:30.341832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 127/249] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:30.347408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5304c-03c2-4986-9f9c-e6547832f2fc None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:30.400456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b1c19-2e77-4c00-aab8-ca910882e2f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:30.400995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b1c19-2e77-4c00-aab8-ca910882e2f3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:30.401280 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b1c19-2e77-4c00-aab8-ca910882e2f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:30.402164 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0b1c19-2e77-4c00-aab8-ca910882e2f3 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:30.407348 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b1c19-2e77-4c00-aab8-ca910882e2f3 None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:30.409718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0b1c19-2e77-4c00-aab8-ca910882e2f3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:30.411442 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 123/250] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:30 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:30.417708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b1c19-2e77-4c00-aab8-ca910882e2f3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:30.555037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a5304c-03c2-4986-9f9c-e6547832f2fc None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:30.575854 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0b1c19-2e77-4c00-aab8-ca910882e2f3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:30.614495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc701d5-60ac-4071-8bc8-0771ee6bbacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:30.615240 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc701d5-60ac-4071-8bc8-0771ee6bbacc None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:30.615545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc701d5-60ac-4071-8bc8-0771ee6bbacc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:30.615800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc701d5-60ac-4071-8bc8-0771ee6bbacc None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce/users/30731648be9044808a46feb64f2b265a/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:30.618155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d65d84c-65ef-45d7-a2eb-be73e5e40603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:30.619111 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65d84c-65ef-45d7-a2eb-be73e5e40603 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:30.619587 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65d84c-65ef-45d7-a2eb-be73e5e40603 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:30.620075 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d65d84c-65ef-45d7-a2eb-be73e5e40603 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:30.621559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65d84c-65ef-45d7-a2eb-be73e5e40603 None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:30.623277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d65d84c-65ef-45d7-a2eb-be73e5e40603 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:30.625179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 128/251] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:30 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:30.630610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc701d5-60ac-4071-8bc8-0771ee6bbacc None admin] RBAC: Authorizing `identity:create_grant(project_id=9298874051964940922f79dd919bafce, user_id=30731648be9044808a46feb64f2b265a, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:30.630610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc701d5-60ac-4071-8bc8-0771ee6bbacc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:30.631130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d512aa-9c4d-47b5-9029-fe340c22f323 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:30.631639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d512aa-9c4d-47b5-9029-fe340c22f323 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:30.632142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d512aa-9c4d-47b5-9029-fe340c22f323 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:30.633705 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 129/252] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:30.635732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d512aa-9c4d-47b5-9029-fe340c22f323 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:30.659702 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 124/253] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:08:30 2022] PUT /identity/v3/projects/9298874051964940922f79dd919bafce/users/30731648be9044808a46feb64f2b265a/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:08:30.660889 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dda89-9f7a-475e-b89e-776e9fa9e3a4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:30.661193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dda89-9f7a-475e-b89e-776e9fa9e3a4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:30.661451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06dda89-9f7a-475e-b89e-776e9fa9e3a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:30.702194 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f06dda89-9f7a-475e-b89e-776e9fa9e3a4 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:30.705206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f06dda89-9f7a-475e-b89e-776e9fa9e3a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:30.749909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:30.756398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:30.823870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d512aa-9c4d-47b5-9029-fe340c22f323 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:30.843243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 125/254] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:30.870142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dda89-9f7a-475e-b89e-776e9fa9e3a4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:30.881854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71164330-fd85-4f05-9f6b-22172991fbeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:30.882533 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71164330-fd85-4f05-9f6b-22172991fbeb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:30.882840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71164330-fd85-4f05-9f6b-22172991fbeb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:30.883114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71164330-fd85-4f05-9f6b-22172991fbeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:30.883939 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71164330-fd85-4f05-9f6b-22172991fbeb None admin] RBAC: Adding query filter params (role.id=cead600aedc04a92955d0976f7f9e0fd, scope.project.id=9298874051964940922f79dd919bafce, user.id=250990068f7c4e3d8349ec3fff5560d5) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:30.884436 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71164330-fd85-4f05-9f6b-22172991fbeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:30.885842 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71164330-fd85-4f05-9f6b-22172991fbeb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:30.898253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 130/255] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:30 2022] GET /identity/v3/role_assignments?user.id=250990068f7c4e3d8349ec3fff5560d5&scope.project.id=9298874051964940922f79dd919bafce&role.id=cead600aedc04a92955d0976f7f9e0fd => generated 259 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:31.009891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06dda89-9f7a-475e-b89e-776e9fa9e3a4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:31.050227 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156c1c8-efec-4f30-a0c2-b7dc740c8a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:31.050952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156c1c8-efec-4f30-a0c2-b7dc740c8a2c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:31.051376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156c1c8-efec-4f30-a0c2-b7dc740c8a2c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:31.051721 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156c1c8-efec-4f30-a0c2-b7dc740c8a2c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:31.063755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156c1c8-efec-4f30-a0c2-b7dc740c8a2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-3156c1c8-efec-4f30-a0c2-b7dc740c8a2c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:31.068818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:31.070298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:31.071166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:31.071166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:31.071166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:31.071166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:31.071166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:31.071166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:31.071166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:31.071166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:31.071166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:31.071166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:31.071166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:31.071166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:31.071166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 126/256] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:08:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:08:31.079775 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71164330-fd85-4f05-9f6b-22172991fbeb None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:31.223615 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71164330-fd85-4f05-9f6b-22172991fbeb None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:31.254288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:31.261472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da161bd-ec43-4dee-8a69-330692c843fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:31.262096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da161bd-ec43-4dee-8a69-330692c843fa None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:31.262378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da161bd-ec43-4dee-8a69-330692c843fa None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:31.262677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da161bd-ec43-4dee-8a69-330692c843fa None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:31.263398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da161bd-ec43-4dee-8a69-330692c843fa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:31.263703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da161bd-ec43-4dee-8a69-330692c843fa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:31.265157 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da161bd-ec43-4dee-8a69-330692c843fa None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:31.274897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 131/257] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:31.280657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156c1c8-efec-4f30-a0c2-b7dc740c8a2c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:31.323781 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:31.432767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156c1c8-efec-4f30-a0c2-b7dc740c8a2c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:31.480481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1af5f3-b43f-4cde-8333-bff6367dcb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:31.481192 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1af5f3-b43f-4cde-8333-bff6367dcb5c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:31.481474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1af5f3-b43f-4cde-8333-bff6367dcb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:31.481746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1af5f3-b43f-4cde-8333-bff6367dcb5c None admin] PATH_INFO: `/v3/users/f28a635a833a4cc9be7bb56bf793b0f0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:31.483016 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1af5f3-b43f-4cde-8333-bff6367dcb5c None admin] RBAC: Authorizing `identity:get_user(user_id=f28a635a833a4cc9be7bb56bf793b0f0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:31.484472 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1af5f3-b43f-4cde-8333-bff6367dcb5c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:31.488982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb09ae5-f52b-4ca6-b918-55eb9f3b2c66 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:31.489274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb09ae5-f52b-4ca6-b918-55eb9f3b2c66 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:31.489547 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb09ae5-f52b-4ca6-b918-55eb9f3b2c66 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:31.490970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 132/259] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:31.491090 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 127/259] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:31 2022] GET /identity/v3/users/f28a635a833a4cc9be7bb56bf793b0f0 => generated 283 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:31.496250 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb09ae5-f52b-4ca6-b918-55eb9f3b2c66 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:31.499617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd171fe-5885-47ab-9140-276fb0e7719a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:31.499908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd171fe-5885-47ab-9140-276fb0e7719a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:31.500187 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd171fe-5885-47ab-9140-276fb0e7719a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:31.536934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-edd171fe-5885-47ab-9140-276fb0e7719a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:31.538391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-edd171fe-5885-47ab-9140-276fb0e7719a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:31.648573 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 128/260] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:31.688958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd171fe-5885-47ab-9140-276fb0e7719a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:31.720041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:31.738770 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb09ae5-f52b-4ca6-b918-55eb9f3b2c66 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:31.825441 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307269c-4f62-4ae7-8aa5-27bfb28e0ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:31.826071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307269c-4f62-4ae7-8aa5-27bfb28e0ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:31.826349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307269c-4f62-4ae7-8aa5-27bfb28e0ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:31.826638 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b307269c-4f62-4ae7-8aa5-27bfb28e0ae0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:31.912723 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd171fe-5885-47ab-9140-276fb0e7719a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:31.983075 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:31.990263 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307269c-4f62-4ae7-8aa5-27bfb28e0ae0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:31.992225 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b307269c-4f62-4ae7-8aa5-27bfb28e0ae0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:32.011903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a836fa4-8ff9-456a-a1d7-d6e0cea7bd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:32.012575 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a836fa4-8ff9-456a-a1d7-d6e0cea7bd7c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:32.012856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a836fa4-8ff9-456a-a1d7-d6e0cea7bd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:32.013198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a836fa4-8ff9-456a-a1d7-d6e0cea7bd7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:32.063254 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a836fa4-8ff9-456a-a1d7-d6e0cea7bd7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8a836fa4-8ff9-456a-a1d7-d6e0cea7bd7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:32.068305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:32.069177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:32.070957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:32.070957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:32.070957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:32.070957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:32.070957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:32.070957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:32.070957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:32.070957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:32.070957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:32.070957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:32.070957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:32.070957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:32.070957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 129/261] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:08:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:08:32.079753 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a836fa4-8ff9-456a-a1d7-d6e0cea7bd7c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:32.169463 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 133/262] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 673 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:32.175568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307269c-4f62-4ae7-8aa5-27bfb28e0ae0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:32.296638 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:32.341322 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a836fa4-8ff9-456a-a1d7-d6e0cea7bd7c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:32.406941 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:32.419830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b307269c-4f62-4ae7-8aa5-27bfb28e0ae0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:32.441219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5fdc3-d825-40c4-b47f-8102bb459da4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:32.441872 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5fdc3-d825-40c4-b47f-8102bb459da4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:32.442144 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5fdc3-d825-40c4-b47f-8102bb459da4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:32.442409 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e5fdc3-d825-40c4-b47f-8102bb459da4 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:32.443164 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5fdc3-d825-40c4-b47f-8102bb459da4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:32.443459 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5fdc3-d825-40c4-b47f-8102bb459da4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:32.445421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e5fdc3-d825-40c4-b47f-8102bb459da4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:32.470429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 130/263] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:08:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:32.476818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5fdc3-d825-40c4-b47f-8102bb459da4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:32.495352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f72b90-e4f9-42a8-a7ea-00eb7f07bcbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:32.496018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f72b90-e4f9-42a8-a7ea-00eb7f07bcbc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:32.496306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f72b90-e4f9-42a8-a7ea-00eb7f07bcbc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:32.496585 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f72b90-e4f9-42a8-a7ea-00eb7f07bcbc None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:32.503373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f72b90-e4f9-42a8-a7ea-00eb7f07bcbc None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:32.505163 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f72b90-e4f9-42a8-a7ea-00eb7f07bcbc None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:32.507646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 134/264] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:32 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:32.513769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f72b90-e4f9-42a8-a7ea-00eb7f07bcbc None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:32.680858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e5fdc3-d825-40c4-b47f-8102bb459da4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:32.719007 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f72b90-e4f9-42a8-a7ea-00eb7f07bcbc None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:32.752294 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e034708-7952-4df0-82a1-cd8ea10f702d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:32.752956 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e034708-7952-4df0-82a1-cd8ea10f702d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:32.753237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e034708-7952-4df0-82a1-cd8ea10f702d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:32.753514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e034708-7952-4df0-82a1-cd8ea10f702d None admin] PATH_INFO: `/v3/users/f28a635a833a4cc9be7bb56bf793b0f0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:32.754985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e034708-7952-4df0-82a1-cd8ea10f702d None admin] RBAC: Authorizing `identity:get_user(user_id=f28a635a833a4cc9be7bb56bf793b0f0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:32.756458 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e034708-7952-4df0-82a1-cd8ea10f702d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:32.763798 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 131/265] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:32 2022] GET /identity/v3/users/f28a635a833a4cc9be7bb56bf793b0f0 => generated 283 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:32.767565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e034708-7952-4df0-82a1-cd8ea10f702d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:32.781249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:32.793588 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc1831c-4b3d-429c-b626-5d5c55551fe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:32.794236 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1831c-4b3d-429c-b626-5d5c55551fe4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:32.794500 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1831c-4b3d-429c-b626-5d5c55551fe4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:32.794797 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc1831c-4b3d-429c-b626-5d5c55551fe4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:32.796037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1831c-4b3d-429c-b626-5d5c55551fe4 None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=9298874051964940922f79dd919bafce, user.id=f28a635a833a4cc9be7bb56bf793b0f0) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:32.796358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1831c-4b3d-429c-b626-5d5c55551fe4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:32.797840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc1831c-4b3d-429c-b626-5d5c55551fe4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:32.817278 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 135/266] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:32 2022] GET /identity/v3/role_assignments?user.id=f28a635a833a4cc9be7bb56bf793b0f0&scope.project.id=9298874051964940922f79dd919bafce&role.id=0681632796d144f6a7ac8eca157001ec => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:32.818687 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b6267-2812-4626-9c94-c7429c6de50d None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:32.818978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b6267-2812-4626-9c94-c7429c6de50d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:32.819255 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070b6267-2812-4626-9c94-c7429c6de50d None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:32.820498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 136/267] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:32.828080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a996be8-f6ca-4829-a4b0-d4fcee1232ca None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:32.828622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a996be8-f6ca-4829-a4b0-d4fcee1232ca None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:32.829104 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a996be8-f6ca-4829-a4b0-d4fcee1232ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:32.871736 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-6a996be8-f6ca-4829-a4b0-d4fcee1232ca None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:32.873366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6a996be8-f6ca-4829-a4b0-d4fcee1232ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:32.901579 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e034708-7952-4df0-82a1-cd8ea10f702d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:32.920348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:32.940422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a394db-da5a-4fe0-81ee-6551b2caa196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:32.941480 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a394db-da5a-4fe0-81ee-6551b2caa196 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:32.941960 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a394db-da5a-4fe0-81ee-6551b2caa196 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:32.942429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a394db-da5a-4fe0-81ee-6551b2caa196 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:33.040899 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 137/268] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:33.042018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b73e3-f04f-4f88-88cd-e091d4e2e6d5 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:33.042311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b73e3-f04f-4f88-88cd-e091d4e2e6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:33.042669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611b73e3-f04f-4f88-88cd-e091d4e2e6d5 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:33.045086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a394db-da5a-4fe0-81ee-6551b2caa196 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:33.046561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a394db-da5a-4fe0-81ee-6551b2caa196 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:33.048059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 138/269] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:33.049651 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf37f1f-d3c4-485f-8131-1377c35e5dcd None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:33.049930 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf37f1f-d3c4-485f-8131-1377c35e5dcd None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:33.050201 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf37f1f-d3c4-485f-8131-1377c35e5dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:33.060314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:33.087953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2cf37f1f-d3c4-485f-8131-1377c35e5dcd None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:33.089615 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2cf37f1f-d3c4-485f-8131-1377c35e5dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:33.164641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 139/270] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:33.165543 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf37f1f-d3c4-485f-8131-1377c35e5dcd None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:33.188267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 132/271] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 14:08:33.197441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a394db-da5a-4fe0-81ee-6551b2caa196 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:33.289222 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:33.306189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf37f1f-d3c4-485f-8131-1377c35e5dcd None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:33.320276 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a394db-da5a-4fe0-81ee-6551b2caa196 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:33.343094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbdaee-868f-4c41-a750-f5a14d58c0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:33.344113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbdaee-868f-4c41-a750-f5a14d58c0ab None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:33.344600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbdaee-868f-4c41-a750-f5a14d58c0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:33.345103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cbdaee-868f-4c41-a750-f5a14d58c0ab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:33.346458 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbdaee-868f-4c41-a750-f5a14d58c0ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:33.348165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cbdaee-868f-4c41-a750-f5a14d58c0ab None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:33.349968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 140/272] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:33.351476 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbdaee-868f-4c41-a750-f5a14d58c0ab None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:33.361970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14acc1-946a-45b7-92f1-fc5d74e62a35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:33.362644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14acc1-946a-45b7-92f1-fc5d74e62a35 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:33.362922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14acc1-946a-45b7-92f1-fc5d74e62a35 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:33.363286 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef14acc1-946a-45b7-92f1-fc5d74e62a35 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:33.364797 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14acc1-946a-45b7-92f1-fc5d74e62a35 None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:33.366902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef14acc1-946a-45b7-92f1-fc5d74e62a35 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:33.373689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 133/273] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:33 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:33.373689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:33.373689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14acc1-946a-45b7-92f1-fc5d74e62a35 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:33.471216 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cbdaee-868f-4c41-a750-f5a14d58c0ab None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:33.500927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef14acc1-946a-45b7-92f1-fc5d74e62a35 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:33.509804 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ec347-6b06-4545-a03b-24ffa12911c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:33.510912 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ec347-6b06-4545-a03b-24ffa12911c9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:33.511399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ec347-6b06-4545-a03b-24ffa12911c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:33.511875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ec347-6b06-4545-a03b-24ffa12911c9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:33.524042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ec347-6b06-4545-a03b-24ffa12911c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-c04ec347-6b06-4545-a03b-24ffa12911c9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:33.529714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:33.530637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:33.531429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:33.531429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:33.531429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:33.531429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:33.531429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:33.531429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:33.531429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:33.531429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:33.531429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:33.531429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:33.531429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:33.531429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:33.539529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 141/274] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:33.540863 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ec347-6b06-4545-a03b-24ffa12911c9 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:33.541930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c89498-2fa8-4144-8f0a-d28d8b038f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:33.542558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c89498-2fa8-4144-8f0a-d28d8b038f11 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:33.542876 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c89498-2fa8-4144-8f0a-d28d8b038f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:33.543148 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c89498-2fa8-4144-8f0a-d28d8b038f11 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:33.543824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c89498-2fa8-4144-8f0a-d28d8b038f11 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:33.545266 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c89498-2fa8-4144-8f0a-d28d8b038f11 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:33.562112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:33.578622 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 134/275] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:08:33 2022] POST /identity/v3/users => generated 293 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:08:33.580239 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c89498-2fa8-4144-8f0a-d28d8b038f11 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:33.619947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:33.684989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ec347-6b06-4545-a03b-24ffa12911c9 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:33.703193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c89498-2fa8-4144-8f0a-d28d8b038f11 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:33.726400 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c45bfa-459c-4ff7-a6b5-41faa6650e9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:33.727530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c45bfa-459c-4ff7-a6b5-41faa6650e9c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:33.728022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c45bfa-459c-4ff7-a6b5-41faa6650e9c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:33.728552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c45bfa-459c-4ff7-a6b5-41faa6650e9c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:33.729688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c45bfa-459c-4ff7-a6b5-41faa6650e9c None admin] RBAC: Adding query filter params (role.id=b99d323b1fad482ead67a8e8501c1c0b, scope.project.id=9298874051964940922f79dd919bafce, user.id=f28a635a833a4cc9be7bb56bf793b0f0) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:33.730309 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c45bfa-459c-4ff7-a6b5-41faa6650e9c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:33.732069 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c45bfa-459c-4ff7-a6b5-41faa6650e9c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:33.743936 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3fce6-210b-4f4d-bbea-fb26e760fb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:33.744423 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3fce6-210b-4f4d-bbea-fb26e760fb8d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:33.744830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3fce6-210b-4f4d-bbea-fb26e760fb8d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:33.745282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3fce6-210b-4f4d-bbea-fb26e760fb8d None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:33.746275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3fce6-210b-4f4d-bbea-fb26e760fb8d None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:33.746571 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3fce6-210b-4f4d-bbea-fb26e760fb8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:33.748226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3fce6-210b-4f4d-bbea-fb26e760fb8d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:33.748448 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 142/276] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:33 2022] GET /identity/v3/role_assignments?user.id=f28a635a833a4cc9be7bb56bf793b0f0&scope.project.id=9298874051964940922f79dd919bafce&role.id=b99d323b1fad482ead67a8e8501c1c0b => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:33.750230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d4c4c-5257-4c89-9789-543f3211244b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:33.755047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d4c4c-5257-4c89-9789-543f3211244b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:33.755703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8d4c4c-5257-4c89-9789-543f3211244b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:33.757495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 143/277] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:33.759102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 135/278] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:33.765599 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d4c4c-5257-4c89-9789-543f3211244b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:33.767310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b9f49-4dfa-4350-ab88-c19a808d46f3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:33.767609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b9f49-4dfa-4350-ab88-c19a808d46f3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:33.767891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356b9f49-4dfa-4350-ab88-c19a808d46f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:33.798147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-356b9f49-4dfa-4350-ab88-c19a808d46f3 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:33.799538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-356b9f49-4dfa-4350-ab88-c19a808d46f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:33.879912 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:33.911475 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 136/279] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:33.911799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8d4c4c-5257-4c89-9789-543f3211244b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:33.935467 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b9f49-4dfa-4350-ab88-c19a808d46f3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:33.962718 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad1a15a-d07a-430c-a8d7-00de56b79039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:33.963677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a15a-d07a-430c-a8d7-00de56b79039 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:33.964010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a15a-d07a-430c-a8d7-00de56b79039 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:33.964290 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad1a15a-d07a-430c-a8d7-00de56b79039 None admin] PATH_INFO: `/v3/users/42ffbe50c71c424eaa76b1565c013f8e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:33.973335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:33.987638 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a15a-d07a-430c-a8d7-00de56b79039 None admin] RBAC: Authorizing `identity:get_user(user_id=42ffbe50c71c424eaa76b1565c013f8e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:33.989067 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad1a15a-d07a-430c-a8d7-00de56b79039 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:33.990840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 144/280] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:33 2022] GET /identity/v3/users/42ffbe50c71c424eaa76b1565c013f8e => generated 293 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:33.992087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a691420-5a9e-4b44-9995-d8861e441e0d None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:33.992370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a691420-5a9e-4b44-9995-d8861e441e0d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:33.992642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a691420-5a9e-4b44-9995-d8861e441e0d None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:33.993858 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 145/281] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:34.000367 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ec3a6-709f-43a4-9026-2248971eb656 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:34.000367 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ec3a6-709f-43a4-9026-2248971eb656 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:34.000638 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000ec3a6-709f-43a4-9026-2248971eb656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:34.023918 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-000ec3a6-709f-43a4-9026-2248971eb656 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:34.025742 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-000ec3a6-709f-43a4-9026-2248971eb656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:34.076653 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356b9f49-4dfa-4350-ab88-c19a808d46f3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:34.115858 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 146/282] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:34.116804 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ec3a6-709f-43a4-9026-2248971eb656 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:34.122649 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc34623-093e-498e-a344-530fb0e0f2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:34.123522 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc34623-093e-498e-a344-530fb0e0f2a1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:34.123998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc34623-093e-498e-a344-530fb0e0f2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:34.128583 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc34623-093e-498e-a344-530fb0e0f2a1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:34.146317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc34623-093e-498e-a344-530fb0e0f2a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ebc34623-093e-498e-a344-530fb0e0f2a1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:34.152232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:34.153116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:34.153891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:34.153891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:34.153891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:34.153891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:34.153891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:34.153891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:34.153891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:34.153891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:34.153891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:34.153891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:34.153891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:34.153891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:34.156601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 137/283] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:08:34.157668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc34623-093e-498e-a344-530fb0e0f2a1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:34.211475 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:34.251792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:34.260783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000ec3a6-709f-43a4-9026-2248971eb656 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:34.273325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc34623-093e-498e-a344-530fb0e0f2a1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:34.308851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff86155-c464-4734-908b-c28a61f10758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:34.309489 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff86155-c464-4734-908b-c28a61f10758 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:34.309772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff86155-c464-4734-908b-c28a61f10758 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:34.310071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff86155-c464-4734-908b-c28a61f10758 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:34.310867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff86155-c464-4734-908b-c28a61f10758 None admin] RBAC: Adding query filter params (role.id=125ef16e078848b2bd772db91d4115d4, user.id=42ffbe50c71c424eaa76b1565c013f8e, scope.system=all) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:34.311141 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3073f3-652c-4f25-a260-8671bbfcc8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:34.311266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff86155-c464-4734-908b-c28a61f10758 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:34.312089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3073f3-652c-4f25-a260-8671bbfcc8f1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:34.312562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3073f3-652c-4f25-a260-8671bbfcc8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:34.312678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff86155-c464-4734-908b-c28a61f10758 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:34.313131 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3073f3-652c-4f25-a260-8671bbfcc8f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:34.319123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 147/284] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Aug 1 14:08:34 2022] GET /identity/v3/role_assignments?user.id=42ffbe50c71c424eaa76b1565c013f8e&scope.system=all&role.id=125ef16e078848b2bd772db91d4115d4 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:34.319811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff86155-c464-4734-908b-c28a61f10758 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:34.334292 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3073f3-652c-4f25-a260-8671bbfcc8f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-4d3073f3-652c-4f25-a260-8671bbfcc8f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:34.337566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:34.338794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:34.340039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:34.340039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:34.340039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:34.340039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:34.340039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:34.340039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:34.340039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:34.340039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:34.340039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:34.340039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:34.340039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:34.340039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:34.340039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 138/285] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:34.355997 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3073f3-652c-4f25-a260-8671bbfcc8f1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:34.489442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff86155-c464-4734-908b-c28a61f10758 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:34.530492 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:34.539395 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9233f-ede7-497c-8d91-ab9789bb4320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:34.540349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9233f-ede7-497c-8d91-ab9789bb4320 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:34.540847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9233f-ede7-497c-8d91-ab9789bb4320 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:34.541360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a9233f-ede7-497c-8d91-ab9789bb4320 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:34.542270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9233f-ede7-497c-8d91-ab9789bb4320 None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:34.542840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9233f-ede7-497c-8d91-ab9789bb4320 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:34.544418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a9233f-ede7-497c-8d91-ab9789bb4320 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:34.548835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3073f3-652c-4f25-a260-8671bbfcc8f1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:34.569958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 148/286] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:34.573772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9233f-ede7-497c-8d91-ab9789bb4320 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:34.609074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb40c17-381c-4cbb-81fd-39f9bd152087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:34.610083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb40c17-381c-4cbb-81fd-39f9bd152087 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:34.610561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb40c17-381c-4cbb-81fd-39f9bd152087 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:34.611072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb40c17-381c-4cbb-81fd-39f9bd152087 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:34.612062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb40c17-381c-4cbb-81fd-39f9bd152087 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:34.612583 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb40c17-381c-4cbb-81fd-39f9bd152087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:34.614484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb40c17-381c-4cbb-81fd-39f9bd152087 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:34.624445 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 139/287] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:34.630385 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb40c17-381c-4cbb-81fd-39f9bd152087 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:34.634980 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:34.787040 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb40c17-381c-4cbb-81fd-39f9bd152087 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:34.828223 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a9233f-ede7-497c-8d91-ab9789bb4320 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:34.831147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c23703-9a06-41b0-9438-d92964f9d061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:34.831871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c23703-9a06-41b0-9438-d92964f9d061 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:34.832149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c23703-9a06-41b0-9438-d92964f9d061 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:34.832420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c23703-9a06-41b0-9438-d92964f9d061 None admin] PATH_INFO: `/v3/users/250990068f7c4e3d8349ec3fff5560d5` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:34.835038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c23703-9a06-41b0-9438-d92964f9d061 None admin] RBAC: Authorizing `identity:get_user(user_id=250990068f7c4e3d8349ec3fff5560d5)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:34.836486 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c23703-9a06-41b0-9438-d92964f9d061 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:34.842749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 140/288] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:34 2022] GET /identity/v3/users/250990068f7c4e3d8349ec3fff5560d5 => generated 297 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:34.844084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c23703-9a06-41b0-9438-d92964f9d061 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:34.874238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807523c-98f4-4d8f-a020-0cd375d120c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:34.875684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807523c-98f4-4d8f-a020-0cd375d120c8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:34.876156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807523c-98f4-4d8f-a020-0cd375d120c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:34.876437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a807523c-98f4-4d8f-a020-0cd375d120c8 None admin] PATH_INFO: `/v3/users/30731648be9044808a46feb64f2b265a` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:34.879765 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807523c-98f4-4d8f-a020-0cd375d120c8 None admin] RBAC: Authorizing `identity:get_user(user_id=30731648be9044808a46feb64f2b265a)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:34.881236 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a807523c-98f4-4d8f-a020-0cd375d120c8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:34.887830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 149/289] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:34 2022] GET /identity/v3/users/30731648be9044808a46feb64f2b265a => generated 297 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:34.894334 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807523c-98f4-4d8f-a020-0cd375d120c8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:34.942668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:34.981847 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c23703-9a06-41b0-9438-d92964f9d061 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:35.032007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccc52b-efa8-48d8-965a-ea8790924614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:35.032673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccc52b-efa8-48d8-965a-ea8790924614 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:35.032960 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccc52b-efa8-48d8-965a-ea8790924614 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:35.033240 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dccc52b-efa8-48d8-965a-ea8790924614 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:35.034544 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccc52b-efa8-48d8-965a-ea8790924614 None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:35.036203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dccc52b-efa8-48d8-965a-ea8790924614 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:35.051122 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:35.059557 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 141/290] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:34 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:35.063367 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccc52b-efa8-48d8-965a-ea8790924614 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:35.108288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a807523c-98f4-4d8f-a020-0cd375d120c8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:35.187538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f74f3e-8d6b-4707-89cc-a099422a19fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:35.188205 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f74f3e-8d6b-4707-89cc-a099422a19fa None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:35.188523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f74f3e-8d6b-4707-89cc-a099422a19fa None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:35.188828 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f74f3e-8d6b-4707-89cc-a099422a19fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:35.274336 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dccc52b-efa8-48d8-965a-ea8790924614 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:35.313034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f74f3e-8d6b-4707-89cc-a099422a19fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:35.314812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f74f3e-8d6b-4707-89cc-a099422a19fa None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:35.342433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6217832-396f-4a67-9f0d-fada9e0714bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:35.343392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6217832-396f-4a67-9f0d-fada9e0714bc None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:35.343882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6217832-396f-4a67-9f0d-fada9e0714bc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:35.344397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6217832-396f-4a67-9f0d-fada9e0714bc None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce/users/250990068f7c4e3d8349ec3fff5560d5/roles/cead600aedc04a92955d0976f7f9e0fd` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:35.346665 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6217832-396f-4a67-9f0d-fada9e0714bc None admin] RBAC: Authorizing `identity:create_grant(project_id=9298874051964940922f79dd919bafce, user_id=250990068f7c4e3d8349ec3fff5560d5, role_id=cead600aedc04a92955d0976f7f9e0fd)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:35.354600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6217832-396f-4a67-9f0d-fada9e0714bc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:35.376098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:35.377942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:35.384596 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 142/291] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:08:35 2022] PUT /identity/v3/projects/9298874051964940922f79dd919bafce/users/250990068f7c4e3d8349ec3fff5560d5/roles/cead600aedc04a92955d0976f7f9e0fd => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:08:35.425087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 150/292] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 14:08:35.430793 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6217832-396f-4a67-9f0d-fada9e0714bc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:35.603632 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6217832-396f-4a67-9f0d-fada9e0714bc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:35.655856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cad0ac-31b9-496a-b242-70a3c26da54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:35.656531 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cad0ac-31b9-496a-b242-70a3c26da54d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:35.656816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cad0ac-31b9-496a-b242-70a3c26da54d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:35.657091 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cad0ac-31b9-496a-b242-70a3c26da54d None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:35.658333 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cad0ac-31b9-496a-b242-70a3c26da54d None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:35.659841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cad0ac-31b9-496a-b242-70a3c26da54d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:35.661578 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 143/293] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:35 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:35.669019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f74f3e-8d6b-4707-89cc-a099422a19fa None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:35.801188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f74f3e-8d6b-4707-89cc-a099422a19fa None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:35.847393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b691de70-bff3-43eb-a238-8e40174b99d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:35.848022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691de70-bff3-43eb-a238-8e40174b99d1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:35.848299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691de70-bff3-43eb-a238-8e40174b99d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:35.848570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b691de70-bff3-43eb-a238-8e40174b99d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:35.849364 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691de70-bff3-43eb-a238-8e40174b99d1 None admin] RBAC: Adding query filter params (role.id=125ef16e078848b2bd772db91d4115d4, scope.project.id=9298874051964940922f79dd919bafce, user.id=30731648be9044808a46feb64f2b265a) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:35.849670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691de70-bff3-43eb-a238-8e40174b99d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:35.851246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b691de70-bff3-43eb-a238-8e40174b99d1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:35.860507 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 151/294] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:35 2022] GET /identity/v3/role_assignments?user.id=30731648be9044808a46feb64f2b265a&scope.project.id=9298874051964940922f79dd919bafce&role.id=125ef16e078848b2bd772db91d4115d4 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:36.112934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c355f-8f63-42f2-a4a5-7bcb8344c900 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:36.113276 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c355f-8f63-42f2-a4a5-7bcb8344c900 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:36.113519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c355f-8f63-42f2-a4a5-7bcb8344c900 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:36.114929 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 144/295] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:36.120889 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2cb10-737b-4bc3-adcc-0a500bae1998 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:36.121364 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2cb10-737b-4bc3-adcc-0a500bae1998 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:36.121438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb2cb10-737b-4bc3-adcc-0a500bae1998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:36.148165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-fbb2cb10-737b-4bc3-adcc-0a500bae1998 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:36.149363 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fbb2cb10-737b-4bc3-adcc-0a500bae1998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:36.168249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:36.223022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 152/296] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:36.245535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c355f-8f63-42f2-a4a5-7bcb8344c900 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:36.265502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4506f-5366-4317-9952-c17700304c30 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:36.265802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4506f-5366-4317-9952-c17700304c30 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:36.266057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee4506f-5366-4317-9952-c17700304c30 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:36.268248 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 153/297] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:08:36.275641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b55856-62c8-49db-94f3-603ef0302f06 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:36.275920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b55856-62c8-49db-94f3-603ef0302f06 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:36.276197 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b55856-62c8-49db-94f3-603ef0302f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:36.297662 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c5b55856-62c8-49db-94f3-603ef0302f06 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:36.298888 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c5b55856-62c8-49db-94f3-603ef0302f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:36.342076 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:36.388237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c355f-8f63-42f2-a4a5-7bcb8344c900 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:36.398672 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 154/298] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:36.419800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b55856-62c8-49db-94f3-603ef0302f06 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:36.429762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c4bea-f0c5-4d82-9ea5-b2bb1a5ea054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:36.430527 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c4bea-f0c5-4d82-9ea5-b2bb1a5ea054 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:36.430897 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c4bea-f0c5-4d82-9ea5-b2bb1a5ea054 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:36.431176 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2c4bea-f0c5-4d82-9ea5-b2bb1a5ea054 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:36.432489 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c4bea-f0c5-4d82-9ea5-b2bb1a5ea054 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:36.434064 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2c4bea-f0c5-4d82-9ea5-b2bb1a5ea054 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:36.436318 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 145/299] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:36.441846 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c4bea-f0c5-4d82-9ea5-b2bb1a5ea054 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:36.528529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:36.546269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b55856-62c8-49db-94f3-603ef0302f06 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:36.570403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2c4bea-f0c5-4d82-9ea5-b2bb1a5ea054 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:36.582819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317f222-0571-418c-82ee-b502ecedaa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:36.583664 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317f222-0571-418c-82ee-b502ecedaa96 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:36.584052 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317f222-0571-418c-82ee-b502ecedaa96 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:36.584458 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317f222-0571-418c-82ee-b502ecedaa96 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:36.596142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317f222-0571-418c-82ee-b502ecedaa96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-9317f222-0571-418c-82ee-b502ecedaa96 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:36.601299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:36.603050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:36.605022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:36.605022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:36.605022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:36.605022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:36.605022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:36.605022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:36.605022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:36.605022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:36.605022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:36.605022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:36.605022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:36.605022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:36.608579 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 155/300] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:36 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:08:36.609662 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317f222-0571-418c-82ee-b502ecedaa96 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:36.611851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b44e21c-6e4a-468f-b5d2-24d41ecfe5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:36.612698 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44e21c-6e4a-468f-b5d2-24d41ecfe5fe None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:36.613342 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44e21c-6e4a-468f-b5d2-24d41ecfe5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:36.613815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b44e21c-6e4a-468f-b5d2-24d41ecfe5fe None admin] PATH_INFO: `/v3/groups` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:36.615583 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44e21c-6e4a-468f-b5d2-24d41ecfe5fe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:36.617950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b44e21c-6e4a-468f-b5d2-24d41ecfe5fe None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:36.626147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:36.646700 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 146/301] 10.222.0.70 () {60 vars in 1134 bytes} [Mon Aug 1 14:08:36 2022] POST /identity/v3/groups => generated 229 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:08:36.686988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c57a47-157c-499f-b1d7-70dce5c3696f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:36.687446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c57a47-157c-499f-b1d7-70dce5c3696f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:36.687796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c57a47-157c-499f-b1d7-70dce5c3696f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:36.689932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 147/302] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:36.696903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca87c7-23d0-4444-a219-2e9c16f4924d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:36.697332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca87c7-23d0-4444-a219-2e9c16f4924d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:36.697751 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ca87c7-23d0-4444-a219-2e9c16f4924d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:36.719756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-52ca87c7-23d0-4444-a219-2e9c16f4924d None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:36.721278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-52ca87c7-23d0-4444-a219-2e9c16f4924d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:36.744306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317f222-0571-418c-82ee-b502ecedaa96 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:36.791702 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26b7e7-9479-4f50-9b52-56699231a4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:36.792846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26b7e7-9479-4f50-9b52-56699231a4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:36.793743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26b7e7-9479-4f50-9b52-56699231a4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:36.794173 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b26b7e7-9479-4f50-9b52-56699231a4d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:36.795423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26b7e7-9479-4f50-9b52-56699231a4d6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:36.796161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26b7e7-9479-4f50-9b52-56699231a4d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:36.798677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b26b7e7-9479-4f50-9b52-56699231a4d6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:36.808784 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 156/303] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:36.809410 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 148/304] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:36.819509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26b7e7-9479-4f50-9b52-56699231a4d6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:36.828839 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca87c7-23d0-4444-a219-2e9c16f4924d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:36.833468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:36.969531 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b26b7e7-9479-4f50-9b52-56699231a4d6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:36.972809 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ca87c7-23d0-4444-a219-2e9c16f4924d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:37.014729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:37.020872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4a107-00aa-4903-ac1f-7806c2e37190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:37.022083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4a107-00aa-4903-ac1f-7806c2e37190 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:37.022408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4a107-00aa-4903-ac1f-7806c2e37190 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:37.022798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e4a107-00aa-4903-ac1f-7806c2e37190 None admin] PATH_INFO: `/v3/users/5359a9d57aae414fb51e25cb60994a29` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:37.027473 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55007602-ba78-424d-9874-6f2d6e655c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:37.028126 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55007602-ba78-424d-9874-6f2d6e655c0b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:37.028404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55007602-ba78-424d-9874-6f2d6e655c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:37.028679 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55007602-ba78-424d-9874-6f2d6e655c0b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:37.041785 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4a107-00aa-4903-ac1f-7806c2e37190 None admin] RBAC: Authorizing `identity:get_user(user_id=5359a9d57aae414fb51e25cb60994a29)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:37.043767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55007602-ba78-424d-9874-6f2d6e655c0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:37.043877 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e4a107-00aa-4903-ac1f-7806c2e37190 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-55007602-ba78-424d-9874-6f2d6e655c0b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:37.049147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:37.050089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:37.051267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:37.051267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:37.051267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:37.051267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:37.051267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:37.051267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:37.051267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:37.051267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:37.051267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:37.051267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:37.051267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:37.051267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:37.051897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 157/305] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:36 2022] GET /identity/v3/users/5359a9d57aae414fb51e25cb60994a29 => generated 293 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:37.051897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4a107-00aa-4903-ac1f-7806c2e37190 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:37.053878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 149/306] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:37.059635 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55007602-ba78-424d-9874-6f2d6e655c0b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:37.140861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:37.191984 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55007602-ba78-424d-9874-6f2d6e655c0b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:37.197138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e4a107-00aa-4903-ac1f-7806c2e37190 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:37.234544 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655f966-ac13-47b6-956e-2390e09d5a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:37.235133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f966-ac13-47b6-956e-2390e09d5a40 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:37.235411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f966-ac13-47b6-956e-2390e09d5a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:37.235687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2655f966-ac13-47b6-956e-2390e09d5a40 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:37.236403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655f966-ac13-47b6-956e-2390e09d5a40 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:37.236706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655f966-ac13-47b6-956e-2390e09d5a40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:37.238111 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2655f966-ac13-47b6-956e-2390e09d5a40 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:37.239565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eca73-0665-4e52-a216-6f353a74acba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:37.240869 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eca73-0665-4e52-a216-6f353a74acba None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:37.241444 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eca73-0665-4e52-a216-6f353a74acba None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:37.241923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94eca73-0665-4e52-a216-6f353a74acba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:37.242949 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eca73-0665-4e52-a216-6f353a74acba None admin] RBAC: Adding query filter params (role.id=cead600aedc04a92955d0976f7f9e0fd, user.id=5359a9d57aae414fb51e25cb60994a29, scope.system=all) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:37.243498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eca73-0665-4e52-a216-6f353a74acba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:37.246016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94eca73-0665-4e52-a216-6f353a74acba None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:37.251799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 150/307] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:37.252848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655f966-ac13-47b6-956e-2390e09d5a40 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:37.257859 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 158/308] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Aug 1 14:08:37 2022] GET /identity/v3/role_assignments?user.id=5359a9d57aae414fb51e25cb60994a29&scope.system=all&role.id=cead600aedc04a92955d0976f7f9e0fd => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:37.309160 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:37.368484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2655f966-ac13-47b6-956e-2390e09d5a40 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:37.406631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f53a4f-e0e3-425b-b21f-5b2820cfe725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:37.407298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f53a4f-e0e3-425b-b21f-5b2820cfe725 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:37.407581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f53a4f-e0e3-425b-b21f-5b2820cfe725 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:37.407855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f53a4f-e0e3-425b-b21f-5b2820cfe725 None admin] PATH_INFO: `/v3/users/42ffbe50c71c424eaa76b1565c013f8e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:37.409069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f53a4f-e0e3-425b-b21f-5b2820cfe725 None admin] RBAC: Authorizing `identity:get_user(user_id=42ffbe50c71c424eaa76b1565c013f8e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:37.410534 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f53a4f-e0e3-425b-b21f-5b2820cfe725 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:37.412799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 151/309] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:37 2022] GET /identity/v3/users/42ffbe50c71c424eaa76b1565c013f8e => generated 293 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:37.418908 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eca73-0665-4e52-a216-6f353a74acba None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:37.532879 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94eca73-0665-4e52-a216-6f353a74acba None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:37.565984 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:37.575008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d6791-7aae-4f2a-9e16-f66d9c9bde02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:37.575684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d6791-7aae-4f2a-9e16-f66d9c9bde02 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:37.575965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d6791-7aae-4f2a-9e16-f66d9c9bde02 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:37.576241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d6791-7aae-4f2a-9e16-f66d9c9bde02 None admin] PATH_INFO: `/v3/system/users/42ffbe50c71c424eaa76b1565c013f8e/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:37.577720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d6791-7aae-4f2a-9e16-f66d9c9bde02 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=42ffbe50c71c424eaa76b1565c013f8e, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:37.579158 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616d6791-7aae-4f2a-9e16-f66d9c9bde02 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:37.590865 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 159/310] 10.222.0.70 () {58 vars in 1334 bytes} [Mon Aug 1 14:08:37 2022] PUT /identity/v3/system/users/42ffbe50c71c424eaa76b1565c013f8e/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:08:37.888523 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6c7a9-4329-474d-ad63-a9711687858d None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:37.888898 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6c7a9-4329-474d-ad63-a9711687858d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:37.889095 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa6c7a9-4329-474d-ad63-a9711687858d None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:37.890614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 152/311] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:37.895832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e7d4d-46bd-4c7f-843a-30ec14914414 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:37.896126 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e7d4d-46bd-4c7f-843a-30ec14914414 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:37.896409 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66e7d4d-46bd-4c7f-843a-30ec14914414 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:37.915743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d66e7d4d-46bd-4c7f-843a-30ec14914414 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:37.916944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d66e7d4d-46bd-4c7f-843a-30ec14914414 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:37.988635 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 160/312] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:38.011757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6c7a9-4329-474d-ad63-a9711687858d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:38.118428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa6c7a9-4329-474d-ad63-a9711687858d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:38.134948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:38.154671 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eb74e-2edf-4029-8860-04dba2347dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:38.155244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eb74e-2edf-4029-8860-04dba2347dff None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:38.155532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eb74e-2edf-4029-8860-04dba2347dff None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:38.156038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9eb74e-2edf-4029-8860-04dba2347dff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:38.171695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9eb74e-2edf-4029-8860-04dba2347dff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8e9eb74e-2edf-4029-8860-04dba2347dff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:38.177281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:38.178134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:38.179843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:38.179843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:38.179843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:38.179843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:38.179843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:38.179843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:38.179843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:38.179843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:38.179843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:38.179843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:38.179843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:38.179843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:38.179843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 153/313] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:38.184869 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e7d4d-46bd-4c7f-843a-30ec14914414 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:38.329359 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66e7d4d-46bd-4c7f-843a-30ec14914414 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:38.354776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:38.378606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e732c-6274-43d5-9f1e-4752a9cac5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:38.378793 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e732c-6274-43d5-9f1e-4752a9cac5d0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:38.379000 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e732c-6274-43d5-9f1e-4752a9cac5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:38.382596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e732c-6274-43d5-9f1e-4752a9cac5d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:38.382596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e732c-6274-43d5-9f1e-4752a9cac5d0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:38.382596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e732c-6274-43d5-9f1e-4752a9cac5d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:38.382596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e732c-6274-43d5-9f1e-4752a9cac5d0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:38.391407 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 161/314] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:38.397025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eb74e-2edf-4029-8860-04dba2347dff None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:38.502923 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9eb74e-2edf-4029-8860-04dba2347dff None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:38.540479 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a28788-13c9-4263-b8c1-1fe66080c347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:38.541414 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a28788-13c9-4263-b8c1-1fe66080c347 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:38.541823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a28788-13c9-4263-b8c1-1fe66080c347 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:38.542222 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a28788-13c9-4263-b8c1-1fe66080c347 None admin] PATH_INFO: `/v3/users/250990068f7c4e3d8349ec3fff5560d5` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:38.543654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a28788-13c9-4263-b8c1-1fe66080c347 None admin] RBAC: Authorizing `identity:get_user(user_id=250990068f7c4e3d8349ec3fff5560d5)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:38.545274 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a28788-13c9-4263-b8c1-1fe66080c347 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:38.547044 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 154/315] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:38 2022] GET /identity/v3/users/250990068f7c4e3d8349ec3fff5560d5 => generated 297 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:38.552816 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e732c-6274-43d5-9f1e-4752a9cac5d0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:38.662852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e732c-6274-43d5-9f1e-4752a9cac5d0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:38.699334 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd9062-8018-4097-be55-3f847712e441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:38.700320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd9062-8018-4097-be55-3f847712e441 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:38.700806 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd9062-8018-4097-be55-3f847712e441 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:38.701297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bd9062-8018-4097-be55-3f847712e441 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:38.757198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:38.775988 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd9062-8018-4097-be55-3f847712e441 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:38.777758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bd9062-8018-4097-be55-3f847712e441 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:38.800604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2d587-93c8-42c9-a3d5-9b505399e48e None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:38.800894 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2d587-93c8-42c9-a3d5-9b505399e48e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:38.801151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a2d587-93c8-42c9-a3d5-9b505399e48e None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:38.802488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 155/316] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:38.807905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33dca2-0d04-4b31-b031-36ce1ef08a68 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:38.808186 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33dca2-0d04-4b31-b031-36ce1ef08a68 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:38.808459 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b33dca2-0d04-4b31-b031-36ce1ef08a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:38.836697 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4b33dca2-0d04-4b31-b031-36ce1ef08a68 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:38.839869 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4b33dca2-0d04-4b31-b031-36ce1ef08a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:38.898074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:38.954944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 156/317] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:38.978099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 162/318] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:38.985597 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33dca2-0d04-4b31-b031-36ce1ef08a68 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:38.987785 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd9062-8018-4097-be55-3f847712e441 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:39.117280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:39.125144 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b33dca2-0d04-4b31-b031-36ce1ef08a68 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:39.135382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bd9062-8018-4097-be55-3f847712e441 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:39.164032 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c05a0-8ee3-4230-aaf7-a341e947dc3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:39.165033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c05a0-8ee3-4230-aaf7-a341e947dc3b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:39.165511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c05a0-8ee3-4230-aaf7-a341e947dc3b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:39.166031 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889c05a0-8ee3-4230-aaf7-a341e947dc3b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:39.167562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c05a0-8ee3-4230-aaf7-a341e947dc3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:39.169851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889c05a0-8ee3-4230-aaf7-a341e947dc3b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:39.171253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac34cc-9f24-4741-a4fd-e370aa9ffba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:39.171977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac34cc-9f24-4741-a4fd-e370aa9ffba7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:39.172257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac34cc-9f24-4741-a4fd-e370aa9ffba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:39.172524 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dac34cc-9f24-4741-a4fd-e370aa9ffba7 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:39.173244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 157/319] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:39.178114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac34cc-9f24-4741-a4fd-e370aa9ffba7 None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:39.178623 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c05a0-8ee3-4230-aaf7-a341e947dc3b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:39.179641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dac34cc-9f24-4741-a4fd-e370aa9ffba7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:39.186355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 163/320] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:38 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:39.188336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac34cc-9f24-4741-a4fd-e370aa9ffba7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:39.239823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:39.308348 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889c05a0-8ee3-4230-aaf7-a341e947dc3b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:39.331761 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dac34cc-9f24-4741-a4fd-e370aa9ffba7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:39.354272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f906471-12c9-4f43-ac93-37c3ff538a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:39.355015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f906471-12c9-4f43-ac93-37c3ff538a74 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:39.355389 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f906471-12c9-4f43-ac93-37c3ff538a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:39.356252 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f906471-12c9-4f43-ac93-37c3ff538a74 None admin] PATH_INFO: `/v3/groups` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:39.356974 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f906471-12c9-4f43-ac93-37c3ff538a74 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:39.359042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f906471-12c9-4f43-ac93-37c3ff538a74 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:39.372412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74fd747-5678-425f-b2f2-5c9ace5a0bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:39.373365 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fd747-5678-425f-b2f2-5c9ace5a0bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:39.373791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fd747-5678-425f-b2f2-5c9ace5a0bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:39.374206 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74fd747-5678-425f-b2f2-5c9ace5a0bb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:39.375958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fd747-5678-425f-b2f2-5c9ace5a0bb9 None admin] RBAC: Adding query filter params (role.id=cead600aedc04a92955d0976f7f9e0fd, scope.project.id=9298874051964940922f79dd919bafce, user.id=250990068f7c4e3d8349ec3fff5560d5) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:39.376419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fd747-5678-425f-b2f2-5c9ace5a0bb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:39.378331 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74fd747-5678-425f-b2f2-5c9ace5a0bb9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:39.382714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 158/321] 10.222.0.70 () {60 vars in 1134 bytes} [Mon Aug 1 14:08:39 2022] POST /identity/v3/groups => generated 226 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:08:39.391137 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 164/322] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:08:39 2022] GET /identity/v3/role_assignments?user.id=250990068f7c4e3d8349ec3fff5560d5&scope.project.id=9298874051964940922f79dd919bafce&role.id=cead600aedc04a92955d0976f7f9e0fd => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:39.506495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0bbbb-67b1-4cee-ac83-1f9400ffcba4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:39.507532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0bbbb-67b1-4cee-ac83-1f9400ffcba4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:39.508062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a0bbbb-67b1-4cee-ac83-1f9400ffcba4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:39.510114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 159/323] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:39.515882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b7aff-8fd0-462e-b7a1-38061ba75d18 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:39.516189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b7aff-8fd0-462e-b7a1-38061ba75d18 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:39.516439 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052b7aff-8fd0-462e-b7a1-38061ba75d18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:39.537180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-052b7aff-8fd0-462e-b7a1-38061ba75d18 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:39.538525 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-052b7aff-8fd0-462e-b7a1-38061ba75d18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:39.551639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:39.615361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 165/324] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:39.639677 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0bbbb-67b1-4cee-ac83-1f9400ffcba4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:39.761290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a0bbbb-67b1-4cee-ac83-1f9400ffcba4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:39.762893 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:39.767318 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b093ed9-b93f-48f9-8c46-58655cb72d76 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:39.767751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b093ed9-b93f-48f9-8c46-58655cb72d76 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:39.768039 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b093ed9-b93f-48f9-8c46-58655cb72d76 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:39.769754 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 166/325] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:39.775244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0991e-0730-4572-995e-ab792edbc923 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:39.775530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0991e-0730-4572-995e-ab792edbc923 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:39.775817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0991e-0730-4572-995e-ab792edbc923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:39.798062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7cd0991e-0730-4572-995e-ab792edbc923 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:39.799375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7cd0991e-0730-4572-995e-ab792edbc923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:39.799932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea896f-d223-4f2a-881a-bb601a3874b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:39.800582 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea896f-d223-4f2a-881a-bb601a3874b8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:39.800914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea896f-d223-4f2a-881a-bb601a3874b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:39.801210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ea896f-d223-4f2a-881a-bb601a3874b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:39.816209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ea896f-d223-4f2a-881a-bb601a3874b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-55ea896f-d223-4f2a-881a-bb601a3874b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:39.821892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:39.823042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:39.823853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:39.823853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:39.823853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:39.823853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:39.823853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:39.823853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:39.823853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:39.823853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:39.823853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:39.823853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:39.823853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:39.823853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:39.823853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 160/326] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:39.828934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea896f-d223-4f2a-881a-bb601a3874b8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:39.889501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 167/327] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:39.919755 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0991e-0730-4572-995e-ab792edbc923 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:39.968236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ea896f-d223-4f2a-881a-bb601a3874b8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:40.025650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9310a-f08c-48a0-88c8-baa1979a595b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:40.026552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9310a-f08c-48a0-88c8-baa1979a595b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:40.026552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9310a-f08c-48a0-88c8-baa1979a595b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:40.026843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9310a-f08c-48a0-88c8-baa1979a595b None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:40.027566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9310a-f08c-48a0-88c8-baa1979a595b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:40.028458 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9310a-f08c-48a0-88c8-baa1979a595b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:40.029858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9310a-f08c-48a0-88c8-baa1979a595b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:40.030566 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:40.044198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 161/328] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:40.048921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9310a-f08c-48a0-88c8-baa1979a595b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:40.070446 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0991e-0730-4572-995e-ab792edbc923 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:40.084205 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:40.118996 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518120c0-98ec-4ce2-9889-a28347e32224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:40.120073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518120c0-98ec-4ce2-9889-a28347e32224 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:40.120355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518120c0-98ec-4ce2-9889-a28347e32224 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:40.120718 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518120c0-98ec-4ce2-9889-a28347e32224 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:40.132550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518120c0-98ec-4ce2-9889-a28347e32224 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-518120c0-98ec-4ce2-9889-a28347e32224 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:40.138161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:40.139090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:40.140187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:40.140187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:40.140187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:40.140187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:40.140187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:40.140187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:40.140187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:40.140187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:40.140187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:40.140187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:40.140187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:40.140187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:40.140187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 168/329] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:40.145922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518120c0-98ec-4ce2-9889-a28347e32224 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:40.177804 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9310a-f08c-48a0-88c8-baa1979a595b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:40.216356 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f0af6-421d-43c3-be00-d101449e6f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:40.217302 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f0af6-421d-43c3-be00-d101449e6f92 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:40.217952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f0af6-421d-43c3-be00-d101449e6f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:40.218499 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f0af6-421d-43c3-be00-d101449e6f92 None admin] PATH_INFO: `/v3/users/5359a9d57aae414fb51e25cb60994a29` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:40.220975 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f0af6-421d-43c3-be00-d101449e6f92 None admin] RBAC: Authorizing `identity:get_user(user_id=5359a9d57aae414fb51e25cb60994a29)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:40.222759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f0af6-421d-43c3-be00-d101449e6f92 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:40.229365 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 162/330] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:40 2022] GET /identity/v3/users/5359a9d57aae414fb51e25cb60994a29 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:40.230975 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f0af6-421d-43c3-be00-d101449e6f92 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:40.265403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518120c0-98ec-4ce2-9889-a28347e32224 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:40.304319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222bee9-20d1-4d8b-9b39-e23d0f259781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:40.305132 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222bee9-20d1-4d8b-9b39-e23d0f259781 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:40.305515 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222bee9-20d1-4d8b-9b39-e23d0f259781 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:40.305854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d222bee9-20d1-4d8b-9b39-e23d0f259781 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:40.306806 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222bee9-20d1-4d8b-9b39-e23d0f259781 None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:40.307253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222bee9-20d1-4d8b-9b39-e23d0f259781 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:40.308647 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d222bee9-20d1-4d8b-9b39-e23d0f259781 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:40.311299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:40.319452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 169/331] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:40.325244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222bee9-20d1-4d8b-9b39-e23d0f259781 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:40.340421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:40.350149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f0af6-421d-43c3-be00-d101449e6f92 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:40.385793 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f33e2-4775-4bf5-a9bb-8662a9530cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:40.386956 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f33e2-4775-4bf5-a9bb-8662a9530cc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:40.386956 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f33e2-4775-4bf5-a9bb-8662a9530cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:40.387360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2f33e2-4775-4bf5-a9bb-8662a9530cc2 None admin] PATH_INFO: `/v3/system/users/5359a9d57aae414fb51e25cb60994a29/roles/cead600aedc04a92955d0976f7f9e0fd` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:40.389198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f33e2-4775-4bf5-a9bb-8662a9530cc2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5359a9d57aae414fb51e25cb60994a29, role_id=cead600aedc04a92955d0976f7f9e0fd)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:40.391232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2f33e2-4775-4bf5-a9bb-8662a9530cc2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:40.406731 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 163/332] 10.222.0.70 () {58 vars in 1334 bytes} [Mon Aug 1 14:08:40 2022] PUT /identity/v3/system/users/5359a9d57aae414fb51e25cb60994a29/roles/cead600aedc04a92955d0976f7f9e0fd => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:08:40.450931 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d222bee9-20d1-4d8b-9b39-e23d0f259781 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:40.489348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5caee529-d3b8-48ac-8ae2-ef81054a89d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:40.490308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caee529-d3b8-48ac-8ae2-ef81054a89d3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:40.490760 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caee529-d3b8-48ac-8ae2-ef81054a89d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:40.491773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5caee529-d3b8-48ac-8ae2-ef81054a89d3 None admin] PATH_INFO: `/v3/users/42ffbe50c71c424eaa76b1565c013f8e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:40.493256 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caee529-d3b8-48ac-8ae2-ef81054a89d3 None admin] RBAC: Authorizing `identity:get_user(user_id=42ffbe50c71c424eaa76b1565c013f8e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:40.494928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5caee529-d3b8-48ac-8ae2-ef81054a89d3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:40.497019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 170/333] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:40 2022] GET /identity/v3/users/42ffbe50c71c424eaa76b1565c013f8e => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:40.503113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f33e2-4775-4bf5-a9bb-8662a9530cc2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:40.620915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2f33e2-4775-4bf5-a9bb-8662a9530cc2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:40.658493 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c11c3e-6bf4-4a36-8cf2-58164d5ec557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:40.659364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c11c3e-6bf4-4a36-8cf2-58164d5ec557 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:40.659806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c11c3e-6bf4-4a36-8cf2-58164d5ec557 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:40.660217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c11c3e-6bf4-4a36-8cf2-58164d5ec557 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:40.661198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c11c3e-6bf4-4a36-8cf2-58164d5ec557 None admin] RBAC: Adding query filter params (role.id=125ef16e078848b2bd772db91d4115d4, user.id=42ffbe50c71c424eaa76b1565c013f8e, scope.system=all) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:40.661653 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c11c3e-6bf4-4a36-8cf2-58164d5ec557 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:40.663845 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c11c3e-6bf4-4a36-8cf2-58164d5ec557 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:40.676408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 164/334] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Aug 1 14:08:40 2022] GET /identity/v3/role_assignments?user.id=42ffbe50c71c424eaa76b1565c013f8e&scope.system=all&role.id=125ef16e078848b2bd772db91d4115d4 => generated 510 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:41.985684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa907c67-eea3-4b5f-b3be-767904050f3f None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:41.986192 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa907c67-eea3-4b5f-b3be-767904050f3f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:41.986266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa907c67-eea3-4b5f-b3be-767904050f3f None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:41.987890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 171/335] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:41.993695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef6721-d77a-4697-b41b-1f5ed1d6cb6d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:41.994145 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef6721-d77a-4697-b41b-1f5ed1d6cb6d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:41.994246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef6721-d77a-4697-b41b-1f5ed1d6cb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:42.019586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-43ef6721-d77a-4697-b41b-1f5ed1d6cb6d None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:42.020807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-43ef6721-d77a-4697-b41b-1f5ed1d6cb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:42.033101 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:42.108605 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 165/336] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:42.141139 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa907c67-eea3-4b5f-b3be-767904050f3f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:42.221854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:42.269609 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa907c67-eea3-4b5f-b3be-767904050f3f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:42.312430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148c10-3abd-4fec-b906-6209cb7c6cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:42.313078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148c10-3abd-4fec-b906-6209cb7c6cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:42.313366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148c10-3abd-4fec-b906-6209cb7c6cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:42.313641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c148c10-3abd-4fec-b906-6209cb7c6cc3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:42.328469 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c148c10-3abd-4fec-b906-6209cb7c6cc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-2c148c10-3abd-4fec-b906-6209cb7c6cc3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:42.334165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:42.335709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:42.336480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:42.336480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:42.336480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:42.336480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:42.336480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:42.336480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:42.336480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:42.336480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:42.336480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:42.336480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:42.336480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:42.336480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:42.336480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 172/337] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:08:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:42.343581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef6721-d77a-4697-b41b-1f5ed1d6cb6d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:42.469408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ef6721-d77a-4697-b41b-1f5ed1d6cb6d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:42.512496 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd951a-8183-4181-a384-54bc09ee8ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:42.513121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd951a-8183-4181-a384-54bc09ee8ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:42.513403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd951a-8183-4181-a384-54bc09ee8ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:42.513681 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dd951a-8183-4181-a384-54bc09ee8ff7 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:42.514402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd951a-8183-4181-a384-54bc09ee8ff7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:42.514778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd951a-8183-4181-a384-54bc09ee8ff7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:42.516160 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dd951a-8183-4181-a384-54bc09ee8ff7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:42.529662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 166/338] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:08:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:42.535106 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148c10-3abd-4fec-b906-6209cb7c6cc3 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:42.659084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c148c10-3abd-4fec-b906-6209cb7c6cc3 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:42.694727 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:42.704759 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548a8c82-868a-4617-8e4e-64da474f4a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:42.705712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a8c82-868a-4617-8e4e-64da474f4a68 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:42.706204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a8c82-868a-4617-8e4e-64da474f4a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:42.706791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548a8c82-868a-4617-8e4e-64da474f4a68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:42.789785 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a8c82-868a-4617-8e4e-64da474f4a68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:42.791607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548a8c82-868a-4617-8e4e-64da474f4a68 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:42.919574 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 173/339] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:42.925518 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd951a-8183-4181-a384-54bc09ee8ff7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:42.937349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:42.940606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157ff84-5a5d-4f58-b197-eb5d6b615b4a None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:42.941214 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157ff84-5a5d-4f58-b197-eb5d6b615b4a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:42.942079 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c157ff84-5a5d-4f58-b197-eb5d6b615b4a None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:42.943722 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 174/340] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:42.949036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a67a3a-82f9-43f8-991e-9039c793497d None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:42.949567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a67a3a-82f9-43f8-991e-9039c793497d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:42.950048 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a67a3a-82f9-43f8-991e-9039c793497d None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:42.951870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 175/341] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:42.955352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e6ab4-b188-403b-8900-e35eede3ba04 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:42.955873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e6ab4-b188-403b-8900-e35eede3ba04 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:42.956353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582e6ab4-b188-403b-8900-e35eede3ba04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:42.995556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-582e6ab4-b188-403b-8900-e35eede3ba04 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:42.997535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-582e6ab4-b188-403b-8900-e35eede3ba04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:43.051411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:43.106228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dd951a-8183-4181-a384-54bc09ee8ff7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:43.152008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daee096d-12fe-46a7-8633-8a437b32677a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:43.152674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee096d-12fe-46a7-8633-8a437b32677a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:43.152952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee096d-12fe-46a7-8633-8a437b32677a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:43.153227 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daee096d-12fe-46a7-8633-8a437b32677a None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:43.154680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee096d-12fe-46a7-8633-8a437b32677a None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:43.156620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daee096d-12fe-46a7-8633-8a437b32677a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:43.158655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 167/342] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:42 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:43.160360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6293677-2821-4a60-81bb-d0eb82271ea3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:43.160645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6293677-2821-4a60-81bb-d0eb82271ea3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:43.160918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6293677-2821-4a60-81bb-d0eb82271ea3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:43.180546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 176/343] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:43.184269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e6ab4-b188-403b-8900-e35eede3ba04 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:43.186281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e6293677-2821-4a60-81bb-d0eb82271ea3 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:43.187812 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e6293677-2821-4a60-81bb-d0eb82271ea3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:43.275271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 168/344] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:43.276463 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6293677-2821-4a60-81bb-d0eb82271ea3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:43.280761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:43.335437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582e6ab4-b188-403b-8900-e35eede3ba04 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:43.399364 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a75149-8005-474a-a372-f6dbe9a2eddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:43.400040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a75149-8005-474a-a372-f6dbe9a2eddb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:43.400321 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a75149-8005-474a-a372-f6dbe9a2eddb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:43.400594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a75149-8005-474a-a372-f6dbe9a2eddb None admin] PATH_INFO: `/v3/groups/da82c36951824613849a61b4be988917` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:43.401964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6293677-2821-4a60-81bb-d0eb82271ea3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:43.407319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a75149-8005-474a-a372-f6dbe9a2eddb None admin] RBAC: Authorizing `identity:get_group(group_id=da82c36951824613849a61b4be988917)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:43.408822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a75149-8005-474a-a372-f6dbe9a2eddb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:43.410497 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 177/345] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 1 14:08:43 2022] GET /identity/v3/groups/da82c36951824613849a61b4be988917 => generated 226 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:43.411300 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a75149-8005-474a-a372-f6dbe9a2eddb None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:43.441884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe500a-16b9-43cb-8b4b-613233bf81f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:43.442957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe500a-16b9-43cb-8b4b-613233bf81f1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:43.443495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe500a-16b9-43cb-8b4b-613233bf81f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:43.444526 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebe500a-16b9-43cb-8b4b-613233bf81f1 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:43.455943 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebe500a-16b9-43cb-8b4b-613233bf81f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:43.458764 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-4ebe500a-16b9-43cb-8b4b-613233bf81f1 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:43.461988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:43.463462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:43.464271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:43.464271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:43.464271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:43.464271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:43.464271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:43.464271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:43.464271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:43.464271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:43.464271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:43.464271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:43.464271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:43.464271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:43.466813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 169/346] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:43.467825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe500a-16b9-43cb-8b4b-613233bf81f1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:43.535795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:43.555714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a75149-8005-474a-a372-f6dbe9a2eddb None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:43.577691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebe500a-16b9-43cb-8b4b-613233bf81f1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:43.594669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ba5da-1105-4303-adfc-200122982f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:43.595443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ba5da-1105-4303-adfc-200122982f11 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:43.595625 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ba5da-1105-4303-adfc-200122982f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:43.595886 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330ba5da-1105-4303-adfc-200122982f11 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:43.607798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330ba5da-1105-4303-adfc-200122982f11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-330ba5da-1105-4303-adfc-200122982f11 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:43.613946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:43.614891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:43.616430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:43.616430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:43.616430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:43.616430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:43.616430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:43.616430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:43.616430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:43.616430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:43.616430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:43.616430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:43.616430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:43.616430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:43.616430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 178/347] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:43.621198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ba5da-1105-4303-adfc-200122982f11 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:43.623098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1781df-9b97-485d-8418-af4c1437fee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:43.624035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1781df-9b97-485d-8418-af4c1437fee8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:43.624539 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1781df-9b97-485d-8418-af4c1437fee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:43.625015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1781df-9b97-485d-8418-af4c1437fee8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:43.626027 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1781df-9b97-485d-8418-af4c1437fee8 None admin] RBAC: Adding query filter params (group.id=da82c36951824613849a61b4be988917, role.id=b99d323b1fad482ead67a8e8501c1c0b, scope.project.id=cf19eb89de594cdaaf28c40785f2dfac) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:43.626541 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1781df-9b97-485d-8418-af4c1437fee8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:43.628316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1781df-9b97-485d-8418-af4c1437fee8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:43.635528 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 170/348] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 1 14:08:43 2022] GET /identity/v3/role_assignments?group.id=da82c36951824613849a61b4be988917&scope.project.id=cf19eb89de594cdaaf28c40785f2dfac&role.id=b99d323b1fad482ead67a8e8501c1c0b => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:43.636999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a615e-fbb8-4637-9014-7417f5b1dba4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:43.637489 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a615e-fbb8-4637-9014-7417f5b1dba4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:43.638013 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a615e-fbb8-4637-9014-7417f5b1dba4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:43.639561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 171/349] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:43.640567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a615e-fbb8-4637-9014-7417f5b1dba4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:43.746992 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:43.757915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a615e-fbb8-4637-9014-7417f5b1dba4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:43.774772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330ba5da-1105-4303-adfc-200122982f11 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:43.789798 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:43.798315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e01c4-8f84-4a28-a9a4-697414c56d93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:43.802657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e01c4-8f84-4a28-a9a4-697414c56d93 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:43.802657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e01c4-8f84-4a28-a9a4-697414c56d93 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:43.802657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e01c4-8f84-4a28-a9a4-697414c56d93 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:43.802657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e01c4-8f84-4a28-a9a4-697414c56d93 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:43.802657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e01c4-8f84-4a28-a9a4-697414c56d93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:43.802657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e01c4-8f84-4a28-a9a4-697414c56d93 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:43.816203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 172/350] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:43.817591 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd14389-16c6-46bf-afa2-3653f8e83a1c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:43.817973 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd14389-16c6-46bf-afa2-3653f8e83a1c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:43.818323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd14389-16c6-46bf-afa2-3653f8e83a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:43.837386 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7cd14389-16c6-46bf-afa2-3653f8e83a1c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:43.838616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bb5d1-eda0-45ca-997a-a318821967ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:43.839052 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7cd14389-16c6-46bf-afa2-3653f8e83a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:43.839646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bb5d1-eda0-45ca-997a-a318821967ae None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:43.840099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bb5d1-eda0-45ca-997a-a318821967ae None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:43.840560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8bb5d1-eda0-45ca-997a-a318821967ae None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:43.841457 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bb5d1-eda0-45ca-997a-a318821967ae None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:43.841933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bb5d1-eda0-45ca-997a-a318821967ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:43.843546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8bb5d1-eda0-45ca-997a-a318821967ae None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:43.861569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 179/351] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:43.862896 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bb5d1-eda0-45ca-997a-a318821967ae None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:43.918360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 173/352] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:43.919584 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd14389-16c6-46bf-afa2-3653f8e83a1c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:44.057541 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8bb5d1-eda0-45ca-997a-a318821967ae None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:44.072254 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd14389-16c6-46bf-afa2-3653f8e83a1c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:44.103492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:44.108464 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bb1d2-e3c5-4e18-989e-7e8d291fc986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:44.109092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bb1d2-e3c5-4e18-989e-7e8d291fc986 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:44.109383 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bb1d2-e3c5-4e18-989e-7e8d291fc986 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:44.109638 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bb1d2-e3c5-4e18-989e-7e8d291fc986 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:44.120544 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bc7a8c-a5dd-48c5-9cf4-024e6f7b8291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:44.121845 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc7a8c-a5dd-48c5-9cf4-024e6f7b8291 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:44.122329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc7a8c-a5dd-48c5-9cf4-024e6f7b8291 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:44.122908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bc7a8c-a5dd-48c5-9cf4-024e6f7b8291 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:44.127716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:44.203181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bb1d2-e3c5-4e18-989e-7e8d291fc986 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:44.204932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bb1d2-e3c5-4e18-989e-7e8d291fc986 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:44.213979 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc7a8c-a5dd-48c5-9cf4-024e6f7b8291 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:44.215758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bc7a8c-a5dd-48c5-9cf4-024e6f7b8291 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:44.328926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 180/353] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:44.331072 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bb1d2-e3c5-4e18-989e-7e8d291fc986 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:44.346655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 174/354] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:44.353682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294ff31-54eb-44bb-a9bc-f7f32686f1e2 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:44.353920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294ff31-54eb-44bb-a9bc-f7f32686f1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:44.354212 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d294ff31-54eb-44bb-a9bc-f7f32686f1e2 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:44.355785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 175/355] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:44.356521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294ff31-54eb-44bb-a9bc-f7f32686f1e2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:44.389931 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:44.398856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:44.478696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bb1d2-e3c5-4e18-989e-7e8d291fc986 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:44.515217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d294ff31-54eb-44bb-a9bc-f7f32686f1e2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:44.524717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc112dbc-59a8-4028-bbd0-a318f2732e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:44.525720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc112dbc-59a8-4028-bbd0-a318f2732e3b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:44.526009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc112dbc-59a8-4028-bbd0-a318f2732e3b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:44.526287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc112dbc-59a8-4028-bbd0-a318f2732e3b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:44.539989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc112dbc-59a8-4028-bbd0-a318f2732e3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-dc112dbc-59a8-4028-bbd0-a318f2732e3b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:44.546612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:44.547499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:44.548274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:44.548274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:44.548274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:44.548274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:44.548274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:44.548274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:44.548274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:44.548274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:44.548274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:44.548274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:44.548274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 01 14:08:44.548274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:44.548274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 181/356] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:44.549266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc112dbc-59a8-4028-bbd0-a318f2732e3b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:44.557894 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33595c66-ed75-4b6b-813f-329e233da08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:44.558553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33595c66-ed75-4b6b-813f-329e233da08a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:44.558876 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33595c66-ed75-4b6b-813f-329e233da08a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:44.559149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33595c66-ed75-4b6b-813f-329e233da08a None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:44.560325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33595c66-ed75-4b6b-813f-329e233da08a None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:44.561768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33595c66-ed75-4b6b-813f-329e233da08a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:44.564559 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 176/357] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:44 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:44.565800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d808d6-b71a-4e80-a219-165f9f42f3df None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:44.566083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d808d6-b71a-4e80-a219-165f9f42f3df None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:44.566349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d808d6-b71a-4e80-a219-165f9f42f3df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:44.588772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e0d808d6-b71a-4e80-a219-165f9f42f3df None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:44.589968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e0d808d6-b71a-4e80-a219-165f9f42f3df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:44.674638 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 177/358] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:44.683853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03b415-ffc7-411f-8bf1-83a1a6bdaaa9 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:44.684202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03b415-ffc7-411f-8bf1-83a1a6bdaaa9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:44.684479 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c03b415-ffc7-411f-8bf1-83a1a6bdaaa9 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:44.690666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 178/359] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:44 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:44.690666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03b415-ffc7-411f-8bf1-83a1a6bdaaa9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:44.691514 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc112dbc-59a8-4028-bbd0-a318f2732e3b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:44.696309 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:44.711234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:44.743767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6b098-7e2f-4a4b-ab2c-99524874aa72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:44.744421 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b098-7e2f-4a4b-ab2c-99524874aa72 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:44.744697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b098-7e2f-4a4b-ab2c-99524874aa72 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:44.744966 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6b098-7e2f-4a4b-ab2c-99524874aa72 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:44.746136 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6b098-7e2f-4a4b-ab2c-99524874aa72 None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:44.747641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e6b098-7e2f-4a4b-ab2c-99524874aa72 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:44.749376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 182/360] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:44 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:44.750132 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6b098-7e2f-4a4b-ab2c-99524874aa72 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:44.822981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c03b415-ffc7-411f-8bf1-83a1a6bdaaa9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:44.865349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226fc6f3-6d26-47e2-a977-6dc975420dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:44.866633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fc6f3-6d26-47e2-a977-6dc975420dfd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:44.866992 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fc6f3-6d26-47e2-a977-6dc975420dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:44.867343 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226fc6f3-6d26-47e2-a977-6dc975420dfd None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:44.868136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fc6f3-6d26-47e2-a977-6dc975420dfd None admin] RBAC: Adding query filter params (name=reader) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:44.868447 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fc6f3-6d26-47e2-a977-6dc975420dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:44.869889 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226fc6f3-6d26-47e2-a977-6dc975420dfd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:44.876579 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6b098-7e2f-4a4b-ab2c-99524874aa72 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:44.880564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 179/361] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:44.882801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419eafd-0a8d-4226-8022-24f1b5f0b6fc None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:44.883301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419eafd-0a8d-4226-8022-24f1b5f0b6fc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:44.883791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0419eafd-0a8d-4226-8022-24f1b5f0b6fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:44.902746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0419eafd-0a8d-4226-8022-24f1b5f0b6fc None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:44.904392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0419eafd-0a8d-4226-8022-24f1b5f0b6fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:44.913929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92c215-43a0-4863-b38f-3f169f54531a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:44.914697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92c215-43a0-4863-b38f-3f169f54531a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:44.915051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92c215-43a0-4863-b38f-3f169f54531a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:44.915391 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa92c215-43a0-4863-b38f-3f169f54531a None admin] PATH_INFO: `/v3/groups/da82c36951824613849a61b4be988917` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:44.917036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92c215-43a0-4863-b38f-3f169f54531a None admin] RBAC: Authorizing `identity:get_group(group_id=da82c36951824613849a61b4be988917)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:44.918510 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa92c215-43a0-4863-b38f-3f169f54531a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:44.921124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 183/362] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 1 14:08:44 2022] GET /identity/v3/groups/da82c36951824613849a61b4be988917 => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:44.922143 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92c215-43a0-4863-b38f-3f169f54531a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:44.976751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:45.020995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 180/363] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:45.022626 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419eafd-0a8d-4226-8022-24f1b5f0b6fc None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:45.034838 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:45.062521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa92c215-43a0-4863-b38f-3f169f54531a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:45.119073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfadc7-d665-4539-809d-95945c98796f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:45.119073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfadc7-d665-4539-809d-95945c98796f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:45.119363 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfadc7-d665-4539-809d-95945c98796f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:45.119611 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dfadc7-d665-4539-809d-95945c98796f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:45.135964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dfadc7-d665-4539-809d-95945c98796f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-81dfadc7-d665-4539-809d-95945c98796f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:45.140994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:45.141870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:45.142829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:45.142829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:45.142829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:45.142829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:45.142829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:45.142829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:45.142829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:45.142829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:45.142829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:45.142829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:45.142829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:45.142829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:45.142829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 184/364] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:08:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:45.144151 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfadc7-d665-4539-809d-95945c98796f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:45.159349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0419eafd-0a8d-4226-8022-24f1b5f0b6fc None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:45.199842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0ac88-d5e9-44e7-acbc-bcaeb4a16150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:45.200494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0ac88-d5e9-44e7-acbc-bcaeb4a16150 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:45.200781 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0ac88-d5e9-44e7-acbc-bcaeb4a16150 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:45.201062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b0ac88-d5e9-44e7-acbc-bcaeb4a16150 None admin] PATH_INFO: `/v3/groups/da82c36951824613849a61b4be988917` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:45.202209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0ac88-d5e9-44e7-acbc-bcaeb4a16150 None admin] RBAC: Authorizing `identity:get_group(group_id=da82c36951824613849a61b4be988917)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:45.203792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b0ac88-d5e9-44e7-acbc-bcaeb4a16150 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:45.205578 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 181/365] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 1 14:08:45 2022] GET /identity/v3/groups/da82c36951824613849a61b4be988917 => generated 226 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:45.206152 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0ac88-d5e9-44e7-acbc-bcaeb4a16150 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:45.260336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:45.266238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dfadc7-d665-4539-809d-95945c98796f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:45.309843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e907ab-515e-4946-8343-e2e0c4b13ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:45.310494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e907ab-515e-4946-8343-e2e0c4b13ec5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:45.310800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e907ab-515e-4946-8343-e2e0c4b13ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:45.311098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e907ab-515e-4946-8343-e2e0c4b13ec5 None admin] PATH_INFO: `/v3/users/5359a9d57aae414fb51e25cb60994a29` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:45.311707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:45.313525 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e907ab-515e-4946-8343-e2e0c4b13ec5 None admin] RBAC: Authorizing `identity:get_user(user_id=5359a9d57aae414fb51e25cb60994a29)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:45.315092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e907ab-515e-4946-8343-e2e0c4b13ec5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:45.317034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 185/366] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:08:45 2022] GET /identity/v3/users/5359a9d57aae414fb51e25cb60994a29 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:45.318221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e907ab-515e-4946-8343-e2e0c4b13ec5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:45.346720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b0ac88-d5e9-44e7-acbc-bcaeb4a16150 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:45.393057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cac3c5-b3e4-42dc-b57d-19b82315aab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:45.393930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cac3c5-b3e4-42dc-b57d-19b82315aab8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:45.394213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cac3c5-b3e4-42dc-b57d-19b82315aab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:45.394488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80cac3c5-b3e4-42dc-b57d-19b82315aab8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:45.395351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cac3c5-b3e4-42dc-b57d-19b82315aab8 None admin] RBAC: Adding query filter params (group.id=da82c36951824613849a61b4be988917, role.id=125ef16e078848b2bd772db91d4115d4, scope.project.id=9298874051964940922f79dd919bafce) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:45.395665 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cac3c5-b3e4-42dc-b57d-19b82315aab8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:45.397235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80cac3c5-b3e4-42dc-b57d-19b82315aab8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:45.404351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 182/367] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 1 14:08:45 2022] GET /identity/v3/role_assignments?group.id=da82c36951824613849a61b4be988917&scope.project.id=9298874051964940922f79dd919bafce&role.id=125ef16e078848b2bd772db91d4115d4 => generated 260 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:45.404984 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cac3c5-b3e4-42dc-b57d-19b82315aab8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:45.456837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e907ab-515e-4946-8343-e2e0c4b13ec5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:45.502609 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204610c-3adb-4096-9d7b-504e50b16a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:45.503293 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204610c-3adb-4096-9d7b-504e50b16a21 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:45.503575 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204610c-3adb-4096-9d7b-504e50b16a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:45.503847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9204610c-3adb-4096-9d7b-504e50b16a21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:45.517596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9204610c-3adb-4096-9d7b-504e50b16a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-9204610c-3adb-4096-9d7b-504e50b16a21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:45.523523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:45.524461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:45.525837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:45.525837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:45.525837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:45.525837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:45.525837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:45.525837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:45.525837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:45.525837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:45.525837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:45.525837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:45.525837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:45.525837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:45.526463 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 186/368] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:08:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:45.526991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204610c-3adb-4096-9d7b-504e50b16a21 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:45.563386 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80cac3c5-b3e4-42dc-b57d-19b82315aab8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:45.566665 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:45.619084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67cd9e-4c0b-45d7-80f8-183521b20edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:45.620067 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67cd9e-4c0b-45d7-80f8-183521b20edd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:45.620735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67cd9e-4c0b-45d7-80f8-183521b20edd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:45.621207 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e67cd9e-4c0b-45d7-80f8-183521b20edd None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:45.622138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67cd9e-4c0b-45d7-80f8-183521b20edd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:45.622662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67cd9e-4c0b-45d7-80f8-183521b20edd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:45.624221 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e67cd9e-4c0b-45d7-80f8-183521b20edd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:45.634217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 183/369] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:08:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:45.635720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67cd9e-4c0b-45d7-80f8-183521b20edd None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:45.641728 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:45.678088 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9204610c-3adb-4096-9d7b-504e50b16a21 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:45.720861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a795084-5abf-4ba3-b02d-63e5a19a7955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:45.721815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a795084-5abf-4ba3-b02d-63e5a19a7955 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:45.722395 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a795084-5abf-4ba3-b02d-63e5a19a7955 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:45.723472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a795084-5abf-4ba3-b02d-63e5a19a7955 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:45.724585 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a795084-5abf-4ba3-b02d-63e5a19a7955 None admin] RBAC: Adding query filter params (group.id=da82c36951824613849a61b4be988917, role.id=125ef16e078848b2bd772db91d4115d4, scope.project.id=cf19eb89de594cdaaf28c40785f2dfac) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:45.725648 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a795084-5abf-4ba3-b02d-63e5a19a7955 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:45.727341 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a795084-5abf-4ba3-b02d-63e5a19a7955 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:45.735536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 187/370] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 1 14:08:45 2022] GET /identity/v3/role_assignments?group.id=da82c36951824613849a61b4be988917&scope.project.id=cf19eb89de594cdaaf28c40785f2dfac&role.id=125ef16e078848b2bd772db91d4115d4 => generated 260 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:45.736780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a795084-5abf-4ba3-b02d-63e5a19a7955 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:45.775518 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e67cd9e-4c0b-45d7-80f8-183521b20edd None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:45.827969 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e72bdb-9fb8-4ccc-b5c0-97ad45256970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:45.828610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e72bdb-9fb8-4ccc-b5c0-97ad45256970 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:45.828890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e72bdb-9fb8-4ccc-b5c0-97ad45256970 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:45.829162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e72bdb-9fb8-4ccc-b5c0-97ad45256970 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:45.830318 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e72bdb-9fb8-4ccc-b5c0-97ad45256970 None admin] RBAC: Adding query filter params (role.id=cead600aedc04a92955d0976f7f9e0fd, user.id=5359a9d57aae414fb51e25cb60994a29, scope.system=all) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:45.830664 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e72bdb-9fb8-4ccc-b5c0-97ad45256970 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:45.832795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e72bdb-9fb8-4ccc-b5c0-97ad45256970 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:45.854520 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 184/371] 10.222.0.70 () {56 vars in 1308 bytes} [Mon Aug 1 14:08:45 2022] GET /identity/v3/role_assignments?user.id=5359a9d57aae414fb51e25cb60994a29&scope.system=all&role.id=cead600aedc04a92955d0976f7f9e0fd => generated 510 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:45.855598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e72bdb-9fb8-4ccc-b5c0-97ad45256970 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:45.955067 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:45.956911 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:46.004273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a795084-5abf-4ba3-b02d-63e5a19a7955 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:46.009333 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e72bdb-9fb8-4ccc-b5c0-97ad45256970 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:46.069811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b215722-f5f9-4306-a492-413c6be4ee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:46.070983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b215722-f5f9-4306-a492-413c6be4ee20 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:46.071401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b215722-f5f9-4306-a492-413c6be4ee20 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:46.071808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b215722-f5f9-4306-a492-413c6be4ee20 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:46.079900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0c3d8-c2b5-41b4-989f-dce08e55cdbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:46.080726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0c3d8-c2b5-41b4-989f-dce08e55cdbe None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:46.081099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0c3d8-c2b5-41b4-989f-dce08e55cdbe None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:46.081470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f0c3d8-c2b5-41b4-989f-dce08e55cdbe None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:46.082302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0c3d8-c2b5-41b4-989f-dce08e55cdbe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:46.082760 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0c3d8-c2b5-41b4-989f-dce08e55cdbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:46.084263 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f0c3d8-c2b5-41b4-989f-dce08e55cdbe None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:46.102461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 188/372] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:46.108122 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0c3d8-c2b5-41b4-989f-dce08e55cdbe None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:46.175322 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b215722-f5f9-4306-a492-413c6be4ee20 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:46.177416 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b215722-f5f9-4306-a492-413c6be4ee20 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:46.265462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:46.282990 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f0c3d8-c2b5-41b4-989f-dce08e55cdbe None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:46.320475 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 185/373] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:46.321831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cff0bb-a0df-4785-9e4d-ee50aee8dcf1 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:46.322220 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cff0bb-a0df-4785-9e4d-ee50aee8dcf1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:46.322503 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cff0bb-a0df-4785-9e4d-ee50aee8dcf1 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:46.324076 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 186/374] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:46.326029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cff0bb-a0df-4785-9e4d-ee50aee8dcf1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:46.332510 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebdfb4-c18a-4455-a1e6-5e4726cc484d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:46.333158 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebdfb4-c18a-4455-a1e6-5e4726cc484d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:46.333441 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebdfb4-c18a-4455-a1e6-5e4726cc484d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:46.333716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ebdfb4-c18a-4455-a1e6-5e4726cc484d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:46.369224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:46.426655 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebdfb4-c18a-4455-a1e6-5e4726cc484d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:46.429161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ebdfb4-c18a-4455-a1e6-5e4726cc484d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:46.469413 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cff0bb-a0df-4785-9e4d-ee50aee8dcf1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:46.518450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c86b90b-65e4-4062-b06a-a75d8a35e546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:46.519425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86b90b-65e4-4062-b06a-a75d8a35e546 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:46.519898 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86b90b-65e4-4062-b06a-a75d8a35e546 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:46.520481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c86b90b-65e4-4062-b06a-a75d8a35e546 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:46.522487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86b90b-65e4-4062-b06a-a75d8a35e546 None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:46.524617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c86b90b-65e4-4062-b06a-a75d8a35e546 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:46.528285 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 187/375] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:46 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:46.529699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e1e7c-e1fb-4097-b2e6-9b89c960b7e2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:46.531762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e1e7c-e1fb-4097-b2e6-9b89c960b7e2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:46.532234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86e1e7c-e1fb-4097-b2e6-9b89c960b7e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:46.566488 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 189/376] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:46.569484 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebdfb4-c18a-4455-a1e6-5e4726cc484d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:46.570700 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b86e1e7c-e1fb-4097-b2e6-9b89c960b7e2 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:46.573401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b86e1e7c-e1fb-4097-b2e6-9b89c960b7e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:46.607133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:46.634748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:46.670037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 188/377] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:46.671533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e1e7c-e1fb-4097-b2e6-9b89c960b7e2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:46.691181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ebdfb4-c18a-4455-a1e6-5e4726cc484d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:46.730833 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e6a1-dcf7-4e76-aee3-a1f1a93c9004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:46.731841 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e6a1-dcf7-4e76-aee3-a1f1a93c9004 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:46.731841 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e6a1-dcf7-4e76-aee3-a1f1a93c9004 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:46.732196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac4e6a1-dcf7-4e76-aee3-a1f1a93c9004 None admin] PATH_INFO: `/v3/groups/da82c36951824613849a61b4be988917` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:46.733444 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e6a1-dcf7-4e76-aee3-a1f1a93c9004 None admin] RBAC: Authorizing `identity:get_group(group_id=da82c36951824613849a61b4be988917)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:46.735177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac4e6a1-dcf7-4e76-aee3-a1f1a93c9004 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:46.738027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 190/378] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 1 14:08:46 2022] GET /identity/v3/groups/da82c36951824613849a61b4be988917 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:46.738979 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e6a1-dcf7-4e76-aee3-a1f1a93c9004 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:46.809054 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86e1e7c-e1fb-4097-b2e6-9b89c960b7e2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:46.853225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c67fd-23da-4b7b-9bb0-25321b589e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:46.854212 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c67fd-23da-4b7b-9bb0-25321b589e35 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:46.854975 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c67fd-23da-4b7b-9bb0-25321b589e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:46.855474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c67fd-23da-4b7b-9bb0-25321b589e35 None admin] PATH_INFO: `/v3/projects/e6b4d136938b4489ad1103924c0d158f` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:46.857486 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c67fd-23da-4b7b-9bb0-25321b589e35 None admin] RBAC: Authorizing `identity:get_project(project_id=e6b4d136938b4489ad1103924c0d158f)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:46.859406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c67fd-23da-4b7b-9bb0-25321b589e35 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:46.862361 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 189/379] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:46 2022] GET /identity/v3/projects/e6b4d136938b4489ad1103924c0d158f => generated 344 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:46.863349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c67fd-23da-4b7b-9bb0-25321b589e35 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:46.863810 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac4e6a1-dcf7-4e76-aee3-a1f1a93c9004 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:46.887308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:46.915297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:46.916442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdefe0-b415-4e60-adc8-beffd0922329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:46.917266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdefe0-b415-4e60-adc8-beffd0922329 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:46.917739 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdefe0-b415-4e60-adc8-beffd0922329 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:46.918377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35cdefe0-b415-4e60-adc8-beffd0922329 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:46.932552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35cdefe0-b415-4e60-adc8-beffd0922329 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-35cdefe0-b415-4e60-adc8-beffd0922329 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:46.937811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:46.938856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:46.939679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:46.939679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:46.939679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:46.939679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:46.939679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:46.939679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:46.939679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:46.939679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:46.939679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:46.939679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:46.939679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:46.939679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:46.939679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 191/380] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:08:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:46.940386 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdefe0-b415-4e60-adc8-beffd0922329 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:47.000140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c67fd-23da-4b7b-9bb0-25321b589e35 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:47.047621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0438cb6-cbd1-4857-82c2-f413ed9a0ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:47.049161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0438cb6-cbd1-4857-82c2-f413ed9a0ffa None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:47.049643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0438cb6-cbd1-4857-82c2-f413ed9a0ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:47.050226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0438cb6-cbd1-4857-82c2-f413ed9a0ffa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:47.051381 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0438cb6-cbd1-4857-82c2-f413ed9a0ffa None admin] RBAC: Adding query filter params (group.id=da82c36951824613849a61b4be988917, role.id=b99d323b1fad482ead67a8e8501c1c0b, scope.project.id=9298874051964940922f79dd919bafce) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:47.052113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0438cb6-cbd1-4857-82c2-f413ed9a0ffa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:47.054489 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0438cb6-cbd1-4857-82c2-f413ed9a0ffa None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:47.058942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35cdefe0-b415-4e60-adc8-beffd0922329 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:47.062985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 190/381] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 1 14:08:46 2022] GET /identity/v3/role_assignments?group.id=da82c36951824613849a61b4be988917&scope.project.id=9298874051964940922f79dd919bafce&role.id=b99d323b1fad482ead67a8e8501c1c0b => generated 260 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:47.063992 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0438cb6-cbd1-4857-82c2-f413ed9a0ffa None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:47.107176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98dda1-b564-4809-8527-dce7da58f37e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:47.107709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98dda1-b564-4809-8527-dce7da58f37e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:47.107879 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98dda1-b564-4809-8527-dce7da58f37e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:47.108352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c98dda1-b564-4809-8527-dce7da58f37e None admin] PATH_INFO: `/v3/groups/cbf6af7484b6400d84984ad686066afe` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:47.114537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98dda1-b564-4809-8527-dce7da58f37e None admin] RBAC: Authorizing `identity:get_group(group_id=cbf6af7484b6400d84984ad686066afe)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:47.116273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c98dda1-b564-4809-8527-dce7da58f37e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:47.119284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 192/382] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 1 14:08:46 2022] GET /identity/v3/groups/cbf6af7484b6400d84984ad686066afe => generated 229 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:47.126821 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98dda1-b564-4809-8527-dce7da58f37e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:47.198982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:47.204486 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0438cb6-cbd1-4857-82c2-f413ed9a0ffa None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:47.206232 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:47.249779 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2dc0c-caf9-459b-a56b-c2e13b81f3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:47.250928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2dc0c-caf9-459b-a56b-c2e13b81f3fc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:47.251370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2dc0c-caf9-459b-a56b-c2e13b81f3fc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:47.251795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2dc0c-caf9-459b-a56b-c2e13b81f3fc None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:47.252952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2dc0c-caf9-459b-a56b-c2e13b81f3fc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:47.253407 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2dc0c-caf9-459b-a56b-c2e13b81f3fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:47.255538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2dc0c-caf9-459b-a56b-c2e13b81f3fc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:47.265759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 191/383] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:08:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:47.271510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2dc0c-caf9-459b-a56b-c2e13b81f3fc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:47.359179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c98dda1-b564-4809-8527-dce7da58f37e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:47.400069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2dc0c-caf9-459b-a56b-c2e13b81f3fc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:47.404630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293af0cc-c3da-48c5-b5af-98c8f2b86da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:47.405750 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293af0cc-c3da-48c5-b5af-98c8f2b86da7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:47.405750 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293af0cc-c3da-48c5-b5af-98c8f2b86da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:47.405929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293af0cc-c3da-48c5-b5af-98c8f2b86da7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:47.406605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293af0cc-c3da-48c5-b5af-98c8f2b86da7 None admin] RBAC: Adding query filter params (group.id=cbf6af7484b6400d84984ad686066afe, role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=e6b4d136938b4489ad1103924c0d158f) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:47.407041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293af0cc-c3da-48c5-b5af-98c8f2b86da7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:47.408570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293af0cc-c3da-48c5-b5af-98c8f2b86da7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:47.416170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 193/384] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 1 14:08:47 2022] GET /identity/v3/role_assignments?group.id=cbf6af7484b6400d84984ad686066afe&scope.project.id=e6b4d136938b4489ad1103924c0d158f&role.id=0681632796d144f6a7ac8eca157001ec => generated 260 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:47.443024 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db44af5-3522-42ea-9251-59f27cbd2983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:47.444089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db44af5-3522-42ea-9251-59f27cbd2983 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:47.444605 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db44af5-3522-42ea-9251-59f27cbd2983 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:47.445097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db44af5-3522-42ea-9251-59f27cbd2983 None admin] PATH_INFO: `/v3/groups/da82c36951824613849a61b4be988917` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:47.446740 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db44af5-3522-42ea-9251-59f27cbd2983 None admin] RBAC: Authorizing `identity:get_group(group_id=da82c36951824613849a61b4be988917)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:47.448485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db44af5-3522-42ea-9251-59f27cbd2983 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:47.450764 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 192/385] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 1 14:08:47 2022] GET /identity/v3/groups/da82c36951824613849a61b4be988917 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:47.456090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293af0cc-c3da-48c5-b5af-98c8f2b86da7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:47.574164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293af0cc-c3da-48c5-b5af-98c8f2b86da7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:47.584825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:47.614778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b54c61-d4a0-47cf-ab91-df2999d966c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:47.616476 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b54c61-d4a0-47cf-ab91-df2999d966c1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:47.617075 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b54c61-d4a0-47cf-ab91-df2999d966c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:47.617604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b54c61-d4a0-47cf-ab91-df2999d966c1 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:47.619078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b54c61-d4a0-47cf-ab91-df2999d966c1 None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:47.620819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b54c61-d4a0-47cf-ab91-df2999d966c1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:47.622760 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 194/386] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:47 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:47.629006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db44af5-3522-42ea-9251-59f27cbd2983 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:47.668995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:47.737712 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db44af5-3522-42ea-9251-59f27cbd2983 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:47.774253 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75a30cb-ce43-4106-b422-70ec1a8ae9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:47.775336 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a30cb-ce43-4106-b422-70ec1a8ae9fb None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:47.775840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a30cb-ce43-4106-b422-70ec1a8ae9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:47.776345 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75a30cb-ce43-4106-b422-70ec1a8ae9fb None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac/groups/da82c36951824613849a61b4be988917/roles/b99d323b1fad482ead67a8e8501c1c0b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:47.778784 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a30cb-ce43-4106-b422-70ec1a8ae9fb None admin] RBAC: Authorizing `identity:create_grant(project_id=cf19eb89de594cdaaf28c40785f2dfac, group_id=da82c36951824613849a61b4be988917, role_id=b99d323b1fad482ead67a8e8501c1c0b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:47.780444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75a30cb-ce43-4106-b422-70ec1a8ae9fb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:47.798625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 193/387] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Aug 1 14:08:47 2022] PUT /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac/groups/da82c36951824613849a61b4be988917/roles/b99d323b1fad482ead67a8e8501c1c0b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:08:48.047058 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd3be3-27fc-444d-b227-7b80169852a7 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:48.047398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd3be3-27fc-444d-b227-7b80169852a7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:48.047669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2dd3be3-27fc-444d-b227-7b80169852a7 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:48.049368 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 195/388] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:48.055450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30888ce9-49fb-4776-85ab-9ba2c8d2e585 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:48.055740 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30888ce9-49fb-4776-85ab-9ba2c8d2e585 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:48.056016 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30888ce9-49fb-4776-85ab-9ba2c8d2e585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:48.076675 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-30888ce9-49fb-4776-85ab-9ba2c8d2e585 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:48.077870 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-30888ce9-49fb-4776-85ab-9ba2c8d2e585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:48.155647 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 194/389] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:48.185458 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd3be3-27fc-444d-b227-7b80169852a7 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:48.336131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2dd3be3-27fc-444d-b227-7b80169852a7 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:48.383283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70c4e0-3f8f-4906-ba20-3bec5a1e7cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:48.383932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70c4e0-3f8f-4906-ba20-3bec5a1e7cdc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:48.384211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70c4e0-3f8f-4906-ba20-3bec5a1e7cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:48.384482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70c4e0-3f8f-4906-ba20-3bec5a1e7cdc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:48.399403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70c4e0-3f8f-4906-ba20-3bec5a1e7cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-1e70c4e0-3f8f-4906-ba20-3bec5a1e7cdc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:48.404737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:48.405608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:48.407015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:48.407015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:48.407015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:48.407015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:48.407015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:48.407015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:48.407015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:48.407015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:48.407015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:48.407015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:48.407015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:48.407015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:48.407015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 196/390] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:48.411798 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30888ce9-49fb-4776-85ab-9ba2c8d2e585 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:48.437468 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:48.579647 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30888ce9-49fb-4776-85ab-9ba2c8d2e585 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:48.629420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be4f7d3-f2e8-4734-8701-6c1a6ab26dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:48.629970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4f7d3-f2e8-4734-8701-6c1a6ab26dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:48.630248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4f7d3-f2e8-4734-8701-6c1a6ab26dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:48.630519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be4f7d3-f2e8-4734-8701-6c1a6ab26dd4 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:48.631827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4f7d3-f2e8-4734-8701-6c1a6ab26dd4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:48.632136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4f7d3-f2e8-4734-8701-6c1a6ab26dd4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:48.633518 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be4f7d3-f2e8-4734-8701-6c1a6ab26dd4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:48.646376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 195/391] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:48.651800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70c4e0-3f8f-4906-ba20-3bec5a1e7cdc None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:48.735462 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:48.759735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a50a8-8f4b-41f1-99bb-a5abb822a14e None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:48.760053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a50a8-8f4b-41f1-99bb-a5abb822a14e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:48.760300 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a50a8-8f4b-41f1-99bb-a5abb822a14e None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:48.761909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 196/392] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:48.767396 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32a3e1-ac4b-451d-bdbd-1bd83bffc89e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:48.767700 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32a3e1-ac4b-451d-bdbd-1bd83bffc89e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:48.767953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff32a3e1-ac4b-451d-bdbd-1bd83bffc89e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:48.815587 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ff32a3e1-ac4b-451d-bdbd-1bd83bffc89e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:48.816793 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ff32a3e1-ac4b-451d-bdbd-1bd83bffc89e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:48.817690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70c4e0-3f8f-4906-ba20-3bec5a1e7cdc None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:48.878680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b07525-86a8-4595-a22e-1df24af4cd51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:48.879333 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b07525-86a8-4595-a22e-1df24af4cd51 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:48.879664 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b07525-86a8-4595-a22e-1df24af4cd51 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:48.879878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b07525-86a8-4595-a22e-1df24af4cd51 None admin] PATH_INFO: `/v3/groups/da82c36951824613849a61b4be988917` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:48.883847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b07525-86a8-4595-a22e-1df24af4cd51 None admin] RBAC: Authorizing `identity:get_group(group_id=da82c36951824613849a61b4be988917)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:48.885326 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b07525-86a8-4595-a22e-1df24af4cd51 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:48.886965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 197/393] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 1 14:08:48 2022] GET /identity/v3/groups/da82c36951824613849a61b4be988917 => generated 226 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:48.899420 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b07525-86a8-4595-a22e-1df24af4cd51 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:48.925991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 197/394] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:48.959799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32a3e1-ac4b-451d-bdbd-1bd83bffc89e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:48.963321 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:49.051064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b07525-86a8-4595-a22e-1df24af4cd51 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:49.054224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:49.090948 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a5c03-633a-4db4-9697-3da933800fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:49.091593 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a5c03-633a-4db4-9697-3da933800fae None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:49.091869 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a5c03-633a-4db4-9697-3da933800fae None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:49.092139 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281a5c03-633a-4db4-9697-3da933800fae None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:49.093439 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a5c03-633a-4db4-9697-3da933800fae None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:49.094924 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281a5c03-633a-4db4-9697-3da933800fae None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:49.097769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 198/395] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:48 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:49.106237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a5c03-633a-4db4-9697-3da933800fae None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:49.177538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff32a3e1-ac4b-451d-bdbd-1bd83bffc89e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:49.249094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5c5b2-5731-4521-924e-80840af6127b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:49.249849 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5c5b2-5731-4521-924e-80840af6127b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:49.250179 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5c5b2-5731-4521-924e-80840af6127b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:49.250452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5c5b2-5731-4521-924e-80840af6127b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:49.272612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281a5c03-633a-4db4-9697-3da933800fae None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:49.276833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff5c5b2-5731-4521-924e-80840af6127b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8ff5c5b2-5731-4521-924e-80840af6127b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:49.281967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:49.282877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:49.283666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:49.283666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:49.283666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:49.283666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:49.283666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:49.283666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:49.283666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:49.283666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:49.283666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:49.283666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:49.283666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:49.283666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:49.283666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 198/396] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:08:49.289349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5c5b2-5731-4521-924e-80840af6127b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:49.322400 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f49060-dd75-4864-ac8f-ae1ea34df2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:49.323235 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f49060-dd75-4864-ac8f-ae1ea34df2f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:49.323515 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f49060-dd75-4864-ac8f-ae1ea34df2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:49.323789 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f49060-dd75-4864-ac8f-ae1ea34df2f8 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce/groups/da82c36951824613849a61b4be988917/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:49.325834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f49060-dd75-4864-ac8f-ae1ea34df2f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=9298874051964940922f79dd919bafce, group_id=da82c36951824613849a61b4be988917, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:49.327745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f49060-dd75-4864-ac8f-ae1ea34df2f8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:49.353567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 199/397] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Aug 1 14:08:49 2022] PUT /identity/v3/projects/9298874051964940922f79dd919bafce/groups/da82c36951824613849a61b4be988917/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:08:49.390691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:49.439997 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5c5b2-5731-4521-924e-80840af6127b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:49.486235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f7c5b-e3ca-48d7-aca0-669fe6ed56f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:49.486897 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f7c5b-e3ca-48d7-aca0-669fe6ed56f8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:49.487176 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f7c5b-e3ca-48d7-aca0-669fe6ed56f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:49.487449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f7c5b-e3ca-48d7-aca0-669fe6ed56f8 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:49.488174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f7c5b-e3ca-48d7-aca0-669fe6ed56f8 None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:49.488482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f7c5b-e3ca-48d7-aca0-669fe6ed56f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:49.489947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f7c5b-e3ca-48d7-aca0-669fe6ed56f8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:49.499604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 199/398] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:49.504947 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f49060-dd75-4864-ac8f-ae1ea34df2f8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:49.559160 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:49.648201 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f49060-dd75-4864-ac8f-ae1ea34df2f8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:49.684808 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8dbaca-0ecc-46c4-a72b-7f6c42ce3354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:49.685462 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dbaca-0ecc-46c4-a72b-7f6c42ce3354 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:49.685751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dbaca-0ecc-46c4-a72b-7f6c42ce3354 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:49.686027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8dbaca-0ecc-46c4-a72b-7f6c42ce3354 None admin] PATH_INFO: `/v3/groups/da82c36951824613849a61b4be988917` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:49.687249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dbaca-0ecc-46c4-a72b-7f6c42ce3354 None admin] RBAC: Authorizing `identity:get_group(group_id=da82c36951824613849a61b4be988917)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:49.688754 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8dbaca-0ecc-46c4-a72b-7f6c42ce3354 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:49.690780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 200/399] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 1 14:08:49 2022] GET /identity/v3/groups/da82c36951824613849a61b4be988917 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:49.696333 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f7c5b-e3ca-48d7-aca0-669fe6ed56f8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:49.779738 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754ec08-d4fc-4960-a25c-80f054cd3e86 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:49.780057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754ec08-d4fc-4960-a25c-80f054cd3e86 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:49.780304 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6754ec08-d4fc-4960-a25c-80f054cd3e86 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:49.782669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 201/400] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:08:49.790286 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826cfa5-fc0b-4e40-901e-dee4688b15c1 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:49.790589 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826cfa5-fc0b-4e40-901e-dee4688b15c1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:49.790892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4826cfa5-fc0b-4e40-901e-dee4688b15c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:49.828103 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f7c5b-e3ca-48d7-aca0-669fe6ed56f8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:49.829313 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4826cfa5-fc0b-4e40-901e-dee4688b15c1 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:49.830512 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4826cfa5-fc0b-4e40-901e-dee4688b15c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:49.857662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:49.869928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c83d974-bd05-4492-96f5-1c7389d34347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:49.870600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d974-bd05-4492-96f5-1c7389d34347 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:49.870880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d974-bd05-4492-96f5-1c7389d34347 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:49.871155 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c83d974-bd05-4492-96f5-1c7389d34347 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:49.872815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83d974-bd05-4492-96f5-1c7389d34347 None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:49.874558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c83d974-bd05-4492-96f5-1c7389d34347 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:49.877375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 200/401] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:49 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:49.878788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d0f33-66c6-44d1-b705-c9e6426ddb15 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:49.879071 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d0f33-66c6-44d1-b705-c9e6426ddb15 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:49.879345 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15d0f33-66c6-44d1-b705-c9e6426ddb15 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:49.881723 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 201/402] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:49.886068 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d0f33-66c6-44d1-b705-c9e6426ddb15 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:49.928622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 202/403] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:49.930238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c43fe-fa10-41ae-a12e-132ecd66cf40 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:49.930770 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c43fe-fa10-41ae-a12e-132ecd66cf40 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:49.931241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c43fe-fa10-41ae-a12e-132ecd66cf40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:49.952846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-382c43fe-fa10-41ae-a12e-132ecd66cf40 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:49.954517 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-382c43fe-fa10-41ae-a12e-132ecd66cf40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:49.981741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:50.011943 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15d0f33-66c6-44d1-b705-c9e6426ddb15 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:50.033568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 203/404] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:50.038991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c43fe-fa10-41ae-a12e-132ecd66cf40 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:50.051433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c4f2d-363b-4d74-bd6a-d673cbcd1367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:50.052113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c4f2d-363b-4d74-bd6a-d673cbcd1367 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:50.052394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c4f2d-363b-4d74-bd6a-d673cbcd1367 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:50.052677 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581c4f2d-363b-4d74-bd6a-d673cbcd1367 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac/groups/da82c36951824613849a61b4be988917/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:50.058611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c4f2d-363b-4d74-bd6a-d673cbcd1367 None admin] RBAC: Authorizing `identity:create_grant(project_id=cf19eb89de594cdaaf28c40785f2dfac, group_id=da82c36951824613849a61b4be988917, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:50.058611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581c4f2d-363b-4d74-bd6a-d673cbcd1367 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:50.073976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 202/405] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Aug 1 14:08:49 2022] PUT /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac/groups/da82c36951824613849a61b4be988917/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:08:50.078301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c4f2d-363b-4d74-bd6a-d673cbcd1367 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:50.152983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:50.229040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c43fe-fa10-41ae-a12e-132ecd66cf40 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:50.249317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581c4f2d-363b-4d74-bd6a-d673cbcd1367 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:50.291187 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132de81-6326-4d54-8599-b7e2edd702fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:50.292855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132de81-6326-4d54-8599-b7e2edd702fc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:50.293540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132de81-6326-4d54-8599-b7e2edd702fc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:50.294730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e132de81-6326-4d54-8599-b7e2edd702fc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:50.306287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de12587-aeec-4983-b2f2-ee7f11ddbb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:50.307165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de12587-aeec-4983-b2f2-ee7f11ddbb88 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:50.307451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de12587-aeec-4983-b2f2-ee7f11ddbb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:50.307726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de12587-aeec-4983-b2f2-ee7f11ddbb88 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:50.309194 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e132de81-6326-4d54-8599-b7e2edd702fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e132de81-6326-4d54-8599-b7e2edd702fc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:50.315246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:50.316245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:50.317029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:50.317029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:50.317029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:50.317029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:50.317029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:50.317029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:50.317029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:50.317029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:50.317029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:50.317029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:50.317029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:50.317029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:50.319293 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de12587-aeec-4983-b2f2-ee7f11ddbb88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:50.320535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 203/406] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:08:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-3de12587-aeec-4983-b2f2-ee7f11ddbb88 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:50.324399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:50.325295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:50.326164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:50.326164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:50.326164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:50.326164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:50.326164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:50.326164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:50.326164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:50.326164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:50.326164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:50.326164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:50.326164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:50.326164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:50.326164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 204/407] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:08:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:50.329428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132de81-6326-4d54-8599-b7e2edd702fc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:50.331322 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de12587-aeec-4983-b2f2-ee7f11ddbb88 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:50.356922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:50.443394 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de12587-aeec-4983-b2f2-ee7f11ddbb88 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:50.445654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e132de81-6326-4d54-8599-b7e2edd702fc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:50.460980 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:50.481770 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59e629-2d98-49b6-a42c-2c3f11cd46c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:50.482401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59e629-2d98-49b6-a42c-2c3f11cd46c4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:50.482679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59e629-2d98-49b6-a42c-2c3f11cd46c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:50.482953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df59e629-2d98-49b6-a42c-2c3f11cd46c4 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:50.483728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59e629-2d98-49b6-a42c-2c3f11cd46c4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:50.484033 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59e629-2d98-49b6-a42c-2c3f11cd46c4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:50.485632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df59e629-2d98-49b6-a42c-2c3f11cd46c4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:50.486103 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e97501-bfb6-4123-97b4-a4dd50021a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:50.487060 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e97501-bfb6-4123-97b4-a4dd50021a8f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:50.487550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e97501-bfb6-4123-97b4-a4dd50021a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:50.488102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e97501-bfb6-4123-97b4-a4dd50021a8f None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:50.489038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e97501-bfb6-4123-97b4-a4dd50021a8f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:50.489552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e97501-bfb6-4123-97b4-a4dd50021a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:50.491825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e97501-bfb6-4123-97b4-a4dd50021a8f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:50.495382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 205/408] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:50.500935 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 204/409] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:08:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:50.504623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59e629-2d98-49b6-a42c-2c3f11cd46c4 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:50.506880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e97501-bfb6-4123-97b4-a4dd50021a8f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:50.616224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e97501-bfb6-4123-97b4-a4dd50021a8f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:50.654921 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:50.655922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bb4d2-0680-4596-917e-d96b86e9a359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:50.656894 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bb4d2-0680-4596-917e-d96b86e9a359 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:50.657391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bb4d2-0680-4596-917e-d96b86e9a359 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:50.657859 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bb4d2-0680-4596-917e-d96b86e9a359 None admin] PATH_INFO: `/v3/groups/da82c36951824613849a61b4be988917` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:50.659397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7bb4d2-0680-4596-917e-d96b86e9a359 None admin] RBAC: Authorizing `identity:get_group(group_id=da82c36951824613849a61b4be988917)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:50.661220 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7bb4d2-0680-4596-917e-d96b86e9a359 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:50.664651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 205/410] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 1 14:08:50 2022] GET /identity/v3/groups/da82c36951824613849a61b4be988917 => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:50.670226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bb4d2-0680-4596-917e-d96b86e9a359 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:50.687845 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df59e629-2d98-49b6-a42c-2c3f11cd46c4 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:50.724559 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:50.728020 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c31e600-21d7-4192-951d-7c05cae999c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:50.728711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31e600-21d7-4192-951d-7c05cae999c7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:50.728994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31e600-21d7-4192-951d-7c05cae999c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:50.729350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c31e600-21d7-4192-951d-7c05cae999c7 None admin] PATH_INFO: `/v3/groups/cbf6af7484b6400d84984ad686066afe` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:50.731038 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31e600-21d7-4192-951d-7c05cae999c7 None admin] RBAC: Authorizing `identity:get_group(group_id=cbf6af7484b6400d84984ad686066afe)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:50.733552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c31e600-21d7-4192-951d-7c05cae999c7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:50.735641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 206/411] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 1 14:08:50 2022] GET /identity/v3/groups/cbf6af7484b6400d84984ad686066afe => generated 229 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:50.737112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00769c67-647b-43f4-9256-c04f317df6b9 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:50.737392 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00769c67-647b-43f4-9256-c04f317df6b9 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:50.737664 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00769c67-647b-43f4-9256-c04f317df6b9 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:50.742691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 207/412] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:50.743886 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00769c67-647b-43f4-9256-c04f317df6b9 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:50.789957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bb4d2-0680-4596-917e-d96b86e9a359 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:50.830304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7ceda1-ae7e-42cc-aea9-9af78e3c8c05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:50.830985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ceda1-ae7e-42cc-aea9-9af78e3c8c05 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:50.831369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ceda1-ae7e-42cc-aea9-9af78e3c8c05 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:50.831646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7ceda1-ae7e-42cc-aea9-9af78e3c8c05 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:50.832830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ceda1-ae7e-42cc-aea9-9af78e3c8c05 None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:50.834938 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7ceda1-ae7e-42cc-aea9-9af78e3c8c05 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:50.837041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 206/413] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:50 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:50.838539 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931d22a-b99f-40ae-9fa5-5cafcb3f361d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:50.838947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931d22a-b99f-40ae-9fa5-5cafcb3f361d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:50.839228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2931d22a-b99f-40ae-9fa5-5cafcb3f361d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:50.857580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00769c67-647b-43f4-9256-c04f317df6b9 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:50.858211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2931d22a-b99f-40ae-9fa5-5cafcb3f361d None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:50.859546 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2931d22a-b99f-40ae-9fa5-5cafcb3f361d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:50.892695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a2370-5b7e-4b23-8dd9-fd84ed93ddf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:50.893384 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a2370-5b7e-4b23-8dd9-fd84ed93ddf4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:50.893612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a2370-5b7e-4b23-8dd9-fd84ed93ddf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:50.893921 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a2370-5b7e-4b23-8dd9-fd84ed93ddf4 None admin] PATH_INFO: `/v3/projects/e6b4d136938b4489ad1103924c0d158f` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:50.895327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a2370-5b7e-4b23-8dd9-fd84ed93ddf4 None admin] RBAC: Authorizing `identity:get_project(project_id=e6b4d136938b4489ad1103924c0d158f)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:50.897412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486a2370-5b7e-4b23-8dd9-fd84ed93ddf4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:50.899445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 208/414] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:50 2022] GET /identity/v3/projects/e6b4d136938b4489ad1103924c0d158f => generated 344 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:50.900197 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a2370-5b7e-4b23-8dd9-fd84ed93ddf4 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:50.920405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:50.939593 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 207/415] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:50.940624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931d22a-b99f-40ae-9fa5-5cafcb3f361d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:50.999747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:51.034108 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a2370-5b7e-4b23-8dd9-fd84ed93ddf4 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:51.069694 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2931d22a-b99f-40ae-9fa5-5cafcb3f361d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:51.073103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8498cb-0fbe-4923-8780-905185a06dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:51.073638 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8498cb-0fbe-4923-8780-905185a06dac None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:51.073920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8498cb-0fbe-4923-8780-905185a06dac None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:51.074191 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8498cb-0fbe-4923-8780-905185a06dac None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce/groups/da82c36951824613849a61b4be988917/roles/b99d323b1fad482ead67a8e8501c1c0b` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:51.076426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8498cb-0fbe-4923-8780-905185a06dac None admin] RBAC: Authorizing `identity:create_grant(project_id=9298874051964940922f79dd919bafce, group_id=da82c36951824613849a61b4be988917, role_id=b99d323b1fad482ead67a8e8501c1c0b)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:51.077881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8498cb-0fbe-4923-8780-905185a06dac None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:51.095582 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 209/416] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Aug 1 14:08:50 2022] PUT /identity/v3/projects/9298874051964940922f79dd919bafce/groups/da82c36951824613849a61b4be988917/roles/b99d323b1fad482ead67a8e8501c1c0b => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:08:51.096787 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8498cb-0fbe-4923-8780-905185a06dac None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:51.112897 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcc727-85a3-4398-a385-bec8e59351f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:51.114050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcc727-85a3-4398-a385-bec8e59351f1 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:51.114536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcc727-85a3-4398-a385-bec8e59351f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:51.115177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbcc727-85a3-4398-a385-bec8e59351f1 None admin] PATH_INFO: `/v3/projects/e6b4d136938b4489ad1103924c0d158f/groups/cbf6af7484b6400d84984ad686066afe/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:51.117641 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcc727-85a3-4398-a385-bec8e59351f1 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6b4d136938b4489ad1103924c0d158f, group_id=cbf6af7484b6400d84984ad686066afe, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:51.119728 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbcc727-85a3-4398-a385-bec8e59351f1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:51.144136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 208/417] 10.222.0.70 () {58 vars in 1442 bytes} [Mon Aug 1 14:08:50 2022] PUT /identity/v3/projects/e6b4d136938b4489ad1103924c0d158f/groups/cbf6af7484b6400d84984ad686066afe/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:08:51.235474 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:51.263116 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8498cb-0fbe-4923-8780-905185a06dac None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:51.301969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11522bcf-3a19-43a7-bb8e-6264f43228e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:51.302842 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11522bcf-3a19-43a7-bb8e-6264f43228e9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:51.303664 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11522bcf-3a19-43a7-bb8e-6264f43228e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:51.303945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11522bcf-3a19-43a7-bb8e-6264f43228e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:51.319166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11522bcf-3a19-43a7-bb8e-6264f43228e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-11522bcf-3a19-43a7-bb8e-6264f43228e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:51.324689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:51.325630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:51.326435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:51.326435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:51.326435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:51.326435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:51.326435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:51.326435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:51.326435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:51.326435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:51.326435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:51.326435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:51.326435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:51.326435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:51.326435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 210/418] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:08:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:51.335395 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcc727-85a3-4398-a385-bec8e59351f1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:51.455425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbcc727-85a3-4398-a385-bec8e59351f1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:51.457260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:51.498589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80672851-36c4-4909-946d-881e7502b920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:51.499222 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80672851-36c4-4909-946d-881e7502b920 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:51.499506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80672851-36c4-4909-946d-881e7502b920 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:51.499785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80672851-36c4-4909-946d-881e7502b920 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:51.500790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80672851-36c4-4909-946d-881e7502b920 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:51.503063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80672851-36c4-4909-946d-881e7502b920 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:51.504472 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80672851-36c4-4909-946d-881e7502b920 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:51.513453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 209/419] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:08:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:51.523680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11522bcf-3a19-43a7-bb8e-6264f43228e9 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:51.687112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11522bcf-3a19-43a7-bb8e-6264f43228e9 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:51.737798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc58aa4-78ff-497e-9e23-0035716dfeb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:51.738426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc58aa4-78ff-497e-9e23-0035716dfeb0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:51.738737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc58aa4-78ff-497e-9e23-0035716dfeb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:51.739015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc58aa4-78ff-497e-9e23-0035716dfeb0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:51.748097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:51.823533 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc58aa4-78ff-497e-9e23-0035716dfeb0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:51.825077 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc58aa4-78ff-497e-9e23-0035716dfeb0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:51.881143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6885a-dcce-42ff-a458-fbe36bf984e7 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:51.881450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6885a-dcce-42ff-a458-fbe36bf984e7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:51.881705 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e6885a-dcce-42ff-a458-fbe36bf984e7 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:51.883441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 210/420] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:08:51.888892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c25f1-8451-424e-8663-0961fea59f35 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:51.889179 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c25f1-8451-424e-8663-0961fea59f35 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:51.889461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05c25f1-8451-424e-8663-0961fea59f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:51.941759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d05c25f1-8451-424e-8663-0961fea59f35 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:51.943080 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d05c25f1-8451-424e-8663-0961fea59f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:51.943843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 211/421] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:51.951865 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc58aa4-78ff-497e-9e23-0035716dfeb0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:51.995518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:52.063563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc58aa4-78ff-497e-9e23-0035716dfeb0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:52.069239 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 211/422] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:52.106152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af593d1-66a9-45fd-8923-9e7eb208c3ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:52.106762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af593d1-66a9-45fd-8923-9e7eb208c3ab None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:52.107046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af593d1-66a9-45fd-8923-9e7eb208c3ab None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:52.107317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af593d1-66a9-45fd-8923-9e7eb208c3ab None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:52.107627 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c25f1-8451-424e-8663-0961fea59f35 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:52.108513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af593d1-66a9-45fd-8923-9e7eb208c3ab None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:52.109993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af593d1-66a9-45fd-8923-9e7eb208c3ab None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:52.112122 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 212/423] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:51 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:52.118191 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af593d1-66a9-45fd-8923-9e7eb208c3ab None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:52.235833 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af593d1-66a9-45fd-8923-9e7eb208c3ab None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:52.244214 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:52.283120 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05c25f1-8451-424e-8663-0961fea59f35 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:52.286728 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:52.300234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945a7c7-9979-4600-90ae-30ea50b90034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:52.300922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945a7c7-9979-4600-90ae-30ea50b90034 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:52.301200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945a7c7-9979-4600-90ae-30ea50b90034 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:52.301468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4945a7c7-9979-4600-90ae-30ea50b90034 None admin] PATH_INFO: `/v3/groups/da82c36951824613849a61b4be988917` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:52.302732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945a7c7-9979-4600-90ae-30ea50b90034 None admin] RBAC: Authorizing `identity:get_group(group_id=da82c36951824613849a61b4be988917)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:52.304185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4945a7c7-9979-4600-90ae-30ea50b90034 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:52.306093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 213/424] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 1 14:08:52 2022] GET /identity/v3/groups/da82c36951824613849a61b4be988917 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:52.315540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945a7c7-9979-4600-90ae-30ea50b90034 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:52.321859 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23850e1d-0c39-4cc1-aa6a-ebcde4a913cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:52.322785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23850e1d-0c39-4cc1-aa6a-ebcde4a913cf None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:52.323213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23850e1d-0c39-4cc1-aa6a-ebcde4a913cf None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:52.323656 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23850e1d-0c39-4cc1-aa6a-ebcde4a913cf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:52.335369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23850e1d-0c39-4cc1-aa6a-ebcde4a913cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-23850e1d-0c39-4cc1-aa6a-ebcde4a913cf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:52.341002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:52.341915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:52.342742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:52.342742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:52.342742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:52.342742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:52.342742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:52.342742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:52.342742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:52.342742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:52.342742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:52.342742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:52.342742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:52.342742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:52.345387 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 212/425] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:52.351391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23850e1d-0c39-4cc1-aa6a-ebcde4a913cf None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:52.498690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4945a7c7-9979-4600-90ae-30ea50b90034 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:52.533103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e92db52d-1280-4651-b8d8-dd54ef48ffa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:52.533736 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92db52d-1280-4651-b8d8-dd54ef48ffa6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:52.534017 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92db52d-1280-4651-b8d8-dd54ef48ffa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:52.534286 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92db52d-1280-4651-b8d8-dd54ef48ffa6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:52.535116 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92db52d-1280-4651-b8d8-dd54ef48ffa6 None admin] RBAC: Adding query filter params (group.id=da82c36951824613849a61b4be988917, role.id=b99d323b1fad482ead67a8e8501c1c0b, scope.project.id=cf19eb89de594cdaaf28c40785f2dfac) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:52.535422 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92db52d-1280-4651-b8d8-dd54ef48ffa6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:52.536872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e92db52d-1280-4651-b8d8-dd54ef48ffa6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:52.552260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23850e1d-0c39-4cc1-aa6a-ebcde4a913cf None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:52.553914 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 214/426] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 1 14:08:52 2022] GET /identity/v3/role_assignments?group.id=da82c36951824613849a61b4be988917&scope.project.id=cf19eb89de594cdaaf28c40785f2dfac&role.id=b99d323b1fad482ead67a8e8501c1c0b => generated 611 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:52.614062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0049265-a226-4af8-861b-8f9257557a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:52.615020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0049265-a226-4af8-861b-8f9257557a5c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:52.615417 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0049265-a226-4af8-861b-8f9257557a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:52.615775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0049265-a226-4af8-861b-8f9257557a5c None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:52.616610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0049265-a226-4af8-861b-8f9257557a5c None admin] RBAC: Adding query filter params (name=member) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:52.617029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0049265-a226-4af8-861b-8f9257557a5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:52.618545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0049265-a226-4af8-861b-8f9257557a5c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:52.624179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ace74-6900-4e04-a145-c6af68b8eea8 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:52.624484 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ace74-6900-4e04-a145-c6af68b8eea8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:52.624735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910ace74-6900-4e04-a145-c6af68b8eea8 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:52.626102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 215/427] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:08:52.636567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687fb22-f3d8-44d2-ac48-3a267523dd79 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:52.636866 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687fb22-f3d8-44d2-ac48-3a267523dd79 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:52.637114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1687fb22-f3d8-44d2-ac48-3a267523dd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:52.638301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 213/428] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:52.644069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0049265-a226-4af8-861b-8f9257557a5c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:52.669891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:52.679658 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1687fb22-f3d8-44d2-ac48-3a267523dd79 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:52.680862 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1687fb22-f3d8-44d2-ac48-3a267523dd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:52.756903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0049265-a226-4af8-861b-8f9257557a5c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:52.766936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:52.802532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b959de-7b41-4bd5-9a6f-7c3fc7eee14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:52.803574 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b959de-7b41-4bd5-9a6f-7c3fc7eee14b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:52.804089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b959de-7b41-4bd5-9a6f-7c3fc7eee14b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:52.804586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b959de-7b41-4bd5-9a6f-7c3fc7eee14b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:52.813787 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 216/429] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:52.839629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687fb22-f3d8-44d2-ac48-3a267523dd79 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:52.882364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b959de-7b41-4bd5-9a6f-7c3fc7eee14b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:52.884346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b959de-7b41-4bd5-9a6f-7c3fc7eee14b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:52.902906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:52.960761 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1687fb22-f3d8-44d2-ac48-3a267523dd79 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:53.002672 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 214/430] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 14:08:53.003053 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfbecf-b358-4192-a4f6-7eec55c7b336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:53.003950 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfbecf-b358-4192-a4f6-7eec55c7b336 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:53.004454 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfbecf-b358-4192-a4f6-7eec55c7b336 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:53.004927 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dfbecf-b358-4192-a4f6-7eec55c7b336 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:53.012307 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b959de-7b41-4bd5-9a6f-7c3fc7eee14b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:53.027035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04dfbecf-b358-4192-a4f6-7eec55c7b336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-04dfbecf-b358-4192-a4f6-7eec55c7b336 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:53.035131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:53.036034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:53.036809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:53.036809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:53.036809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:53.036809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:53.036809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:53.036809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:53.036809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:53.036809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:53.036809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:53.036809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:53.036809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 01 14:08:53.036809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:53.040087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 217/431] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:53.045882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfbecf-b358-4192-a4f6-7eec55c7b336 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:53.076776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:53.125590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b959de-7b41-4bd5-9a6f-7c3fc7eee14b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:53.143290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:53.155759 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dfbecf-b358-4192-a4f6-7eec55c7b336 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:53.164402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01938946-14cb-420b-acb6-92c86ae5c1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:53.165122 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01938946-14cb-420b-acb6-92c86ae5c1c0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:53.165512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01938946-14cb-420b-acb6-92c86ae5c1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:53.165853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01938946-14cb-420b-acb6-92c86ae5c1c0 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:53.167222 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01938946-14cb-420b-acb6-92c86ae5c1c0 None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:53.168851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01938946-14cb-420b-acb6-92c86ae5c1c0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:53.170353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 215/432] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:53 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:53.176347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01938946-14cb-420b-acb6-92c86ae5c1c0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:53.194710 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055194e2-ca83-4c77-a625-42bdfe582385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:53.195692 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055194e2-ca83-4c77-a625-42bdfe582385 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:53.196182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055194e2-ca83-4c77-a625-42bdfe582385 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:53.196633 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055194e2-ca83-4c77-a625-42bdfe582385 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:53.197606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055194e2-ca83-4c77-a625-42bdfe582385 None admin] RBAC: Adding query filter params (name=member) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:53.198114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055194e2-ca83-4c77-a625-42bdfe582385 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:53.199799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055194e2-ca83-4c77-a625-42bdfe582385 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:53.216037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 218/433] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:08:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:53.217239 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055194e2-ca83-4c77-a625-42bdfe582385 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:53.314809 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01938946-14cb-420b-acb6-92c86ae5c1c0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:53.333624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:53.347852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055194e2-ca83-4c77-a625-42bdfe582385 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:53.358156 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85e0e9-9ffd-45b0-ad8e-b07c2f257ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:53.359230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85e0e9-9ffd-45b0-ad8e-b07c2f257ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:53.359712 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85e0e9-9ffd-45b0-ad8e-b07c2f257ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:53.360183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa85e0e9-9ffd-45b0-ad8e-b07c2f257ad1 None admin] PATH_INFO: `/v3/groups/da82c36951824613849a61b4be988917` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:53.361641 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85e0e9-9ffd-45b0-ad8e-b07c2f257ad1 None admin] RBAC: Authorizing `identity:get_group(group_id=da82c36951824613849a61b4be988917)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:53.363646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa85e0e9-9ffd-45b0-ad8e-b07c2f257ad1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:53.365999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 216/434] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 1 14:08:53 2022] GET /identity/v3/groups/da82c36951824613849a61b4be988917 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:53.372231 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85e0e9-9ffd-45b0-ad8e-b07c2f257ad1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:53.391539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5b3a9-f3ec-4693-8393-6a6fe9d29581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:53.392168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5b3a9-f3ec-4693-8393-6a6fe9d29581 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:53.392594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5b3a9-f3ec-4693-8393-6a6fe9d29581 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:53.393128 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb5b3a9-f3ec-4693-8393-6a6fe9d29581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:53.444908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:53.481636 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5b3a9-f3ec-4693-8393-6a6fe9d29581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:53.484091 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb5b3a9-f3ec-4693-8393-6a6fe9d29581 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:53.509033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa85e0e9-9ffd-45b0-ad8e-b07c2f257ad1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:53.552781 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7b1eae-a238-47dc-8c16-5b347dd69a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:53.553425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b1eae-a238-47dc-8c16-5b347dd69a60 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:53.553772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b1eae-a238-47dc-8c16-5b347dd69a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:53.553941 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7b1eae-a238-47dc-8c16-5b347dd69a60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:53.554757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b1eae-a238-47dc-8c16-5b347dd69a60 None admin] RBAC: Adding query filter params (group.id=da82c36951824613849a61b4be988917, role.id=125ef16e078848b2bd772db91d4115d4, scope.project.id=9298874051964940922f79dd919bafce) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:53.555057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b1eae-a238-47dc-8c16-5b347dd69a60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:53.556457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7b1eae-a238-47dc-8c16-5b347dd69a60 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:53.570683 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 217/435] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 1 14:08:53 2022] GET /identity/v3/role_assignments?group.id=da82c36951824613849a61b4be988917&scope.project.id=9298874051964940922f79dd919bafce&role.id=125ef16e078848b2bd772db91d4115d4 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:53.570683 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce9db1-26a0-4a05-bf9c-6e3d98b65b9e None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:53.570683 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce9db1-26a0-4a05-bf9c-6e3d98b65b9e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:53.570683 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ce9db1-26a0-4a05-bf9c-6e3d98b65b9e None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:53.570683 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 218/436] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:53.571431 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc06ab-b57c-47a3-8426-c4dd6c02e016 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:53.571722 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc06ab-b57c-47a3-8426-c4dd6c02e016 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:53.572001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fc06ab-b57c-47a3-8426-c4dd6c02e016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:53.595255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d8fc06ab-b57c-47a3-8426-c4dd6c02e016 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:53.596837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d8fc06ab-b57c-47a3-8426-c4dd6c02e016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:53.604529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:53.625332 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 219/437] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:08:53.627386 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5b3a9-f3ec-4693-8393-6a6fe9d29581 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:53.688650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 219/438] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:53.690193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3ac2c-ecf5-4d29-b939-a8dbe8cab0b4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:53.690547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3ac2c-ecf5-4d29-b939-a8dbe8cab0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:53.690911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d3ac2c-ecf5-4d29-b939-a8dbe8cab0b4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:53.692405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 220/439] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:53.698488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab61ab1-3a84-48d4-b9eb-fb9657afe694 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:53.698831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab61ab1-3a84-48d4-b9eb-fb9657afe694 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:53.699108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab61ab1-3a84-48d4-b9eb-fb9657afe694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:53.719880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1ab61ab1-3a84-48d4-b9eb-fb9657afe694 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:53.721080 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1ab61ab1-3a84-48d4-b9eb-fb9657afe694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:53.754670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb5b3a9-f3ec-4693-8393-6a6fe9d29581 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:53.775652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:53.793331 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c32740-d91f-4b38-9456-a36c13fe8da0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:53.793990 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c32740-d91f-4b38-9456-a36c13fe8da0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:53.794279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c32740-d91f-4b38-9456-a36c13fe8da0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:53.794557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c32740-d91f-4b38-9456-a36c13fe8da0 None admin] PATH_INFO: `/v3/projects/cf19eb89de594cdaaf28c40785f2dfac` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:53.795836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c32740-d91f-4b38-9456-a36c13fe8da0 None admin] RBAC: Authorizing `identity:get_project(project_id=cf19eb89de594cdaaf28c40785f2dfac)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:53.797289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c32740-d91f-4b38-9456-a36c13fe8da0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:53.799003 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 220/440] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:53 2022] GET /identity/v3/projects/cf19eb89de594cdaaf28c40785f2dfac => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:53.799767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c32740-d91f-4b38-9456-a36c13fe8da0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:53.805445 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 221/441] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:53.806279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab61ab1-3a84-48d4-b9eb-fb9657afe694 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:53.867905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:53.907669 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab61ab1-3a84-48d4-b9eb-fb9657afe694 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:53.909749 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c32740-d91f-4b38-9456-a36c13fe8da0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:53.942219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be14cf-4a1b-42df-8675-6f21a38f3030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:53.942903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be14cf-4a1b-42df-8675-6f21a38f3030 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:53.943389 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be14cf-4a1b-42df-8675-6f21a38f3030 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:53.944437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be14cf-4a1b-42df-8675-6f21a38f3030 None admin] PATH_INFO: `/v3/groups/da82c36951824613849a61b4be988917` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:53.944952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44a029-2eb6-4c25-9dcc-2d00804a1fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:53.945597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44a029-2eb6-4c25-9dcc-2d00804a1fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:53.945879 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44a029-2eb6-4c25-9dcc-2d00804a1fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:53.946150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e44a029-2eb6-4c25-9dcc-2d00804a1fd7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:53.946346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be14cf-4a1b-42df-8675-6f21a38f3030 None admin] RBAC: Authorizing `identity:get_group(group_id=da82c36951824613849a61b4be988917)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:53.949066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be14cf-4a1b-42df-8675-6f21a38f3030 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:53.952219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 222/442] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 1 14:08:53 2022] GET /identity/v3/groups/da82c36951824613849a61b4be988917 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:53.952944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be14cf-4a1b-42df-8675-6f21a38f3030 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:53.958506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e44a029-2eb6-4c25-9dcc-2d00804a1fd7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-8e44a029-2eb6-4c25-9dcc-2d00804a1fd7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:53.963969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:53.965016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:53.965814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:53.965814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:53.965814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:53.965814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:53.965814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:53.965814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:53.965814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:53.965814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:53.965814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:53.965814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:53.965814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:08:53.965814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:53.965814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 221/443] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:08:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:53.966473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44a029-2eb6-4c25-9dcc-2d00804a1fd7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:54.011204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:54.064326 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be14cf-4a1b-42df-8675-6f21a38f3030 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:54.077708 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e44a029-2eb6-4c25-9dcc-2d00804a1fd7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:54.094990 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:54.098523 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334973ab-3856-4ecf-b000-f7824b9a13f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:54.099196 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334973ab-3856-4ecf-b000-f7824b9a13f4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:54.099472 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334973ab-3856-4ecf-b000-f7824b9a13f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:54.100346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334973ab-3856-4ecf-b000-f7824b9a13f4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:54.111062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334973ab-3856-4ecf-b000-f7824b9a13f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:08:54.112442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcd876-4186-4fef-a16e-031e7c47ddb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:54.113055 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcd876-4186-4fef-a16e-031e7c47ddb8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:54.113336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcd876-4186-4fef-a16e-031e7c47ddb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:54.113610 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dcd876-4186-4fef-a16e-031e7c47ddb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:54.114392 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcd876-4186-4fef-a16e-031e7c47ddb8 None admin] RBAC: Adding query filter params (group.id=da82c36951824613849a61b4be988917, role.id=125ef16e078848b2bd772db91d4115d4, scope.project.id=cf19eb89de594cdaaf28c40785f2dfac) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:54.114728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcd876-4186-4fef-a16e-031e7c47ddb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-334973ab-3856-4ecf-b000-f7824b9a13f4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:08:54.115949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:54.116934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:54.117770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:54.117770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:54.117770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:54.117770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:54.117770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:08:54.117770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:08:54.117770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:08:54.117770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:08:54.117770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:08:54.117770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:08:54.117770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:08:54.117770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:54.118424 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55dcd876-4186-4fef-a16e-031e7c47ddb8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:54.118512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 223/444] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:08:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:54.118512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334973ab-3856-4ecf-b000-f7824b9a13f4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:54.124101 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 222/445] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 1 14:08:53 2022] GET /identity/v3/role_assignments?group.id=da82c36951824613849a61b4be988917&scope.project.id=cf19eb89de594cdaaf28c40785f2dfac&role.id=125ef16e078848b2bd772db91d4115d4 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:54.124800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcd876-4186-4fef-a16e-031e7c47ddb8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:54.232936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dcd876-4186-4fef-a16e-031e7c47ddb8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:54.236661 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334973ab-3856-4ecf-b000-f7824b9a13f4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:54.239303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:54.272328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57b536-7db8-4323-b77e-96cf5992f903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:54.273039 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57b536-7db8-4323-b77e-96cf5992f903 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:54.273262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57b536-7db8-4323-b77e-96cf5992f903 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:54.273534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57b536-7db8-4323-b77e-96cf5992f903 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:54.274262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57b536-7db8-4323-b77e-96cf5992f903 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:54.274569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57b536-7db8-4323-b77e-96cf5992f903 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:54.276930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855f005-192d-45fa-b105-ae239051aa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:54.277547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855f005-192d-45fa-b105-ae239051aa3e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:54.277827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855f005-192d-45fa-b105-ae239051aa3e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:54.277923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f57b536-7db8-4323-b77e-96cf5992f903 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:54.278617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855f005-192d-45fa-b105-ae239051aa3e None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:54.278839 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855f005-192d-45fa-b105-ae239051aa3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:54.279142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855f005-192d-45fa-b105-ae239051aa3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:54.280500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6855f005-192d-45fa-b105-ae239051aa3e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:54.289079 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 223/446] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:08:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:54.289994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 224/447] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:08:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:54.295329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57b536-7db8-4323-b77e-96cf5992f903 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:54.295719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855f005-192d-45fa-b105-ae239051aa3e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:54.350204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:54.413338 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855f005-192d-45fa-b105-ae239051aa3e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:54.418849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57b536-7db8-4323-b77e-96cf5992f903 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:54.454204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e6ba2-3bae-4005-8395-72b97fdfc69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:54.454909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e6ba2-3bae-4005-8395-72b97fdfc69e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:54.455193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e6ba2-3bae-4005-8395-72b97fdfc69e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:54.455537 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6e6ba2-3bae-4005-8395-72b97fdfc69e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:54.456645 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747db584-c456-4007-8f51-bd307da346da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:54.457271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747db584-c456-4007-8f51-bd307da346da None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:54.457554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747db584-c456-4007-8f51-bd307da346da None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:54.457826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747db584-c456-4007-8f51-bd307da346da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:54.494627 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:54.533139 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e6ba2-3bae-4005-8395-72b97fdfc69e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:54.534625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6e6ba2-3bae-4005-8395-72b97fdfc69e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:54.536026 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747db584-c456-4007-8f51-bd307da346da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:54.537497 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747db584-c456-4007-8f51-bd307da346da None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:54.589726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:54.658889 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 225/448] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 14:08:54.660844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 224/449] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:08:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 14:08:54.665255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e6ba2-3bae-4005-8395-72b97fdfc69e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:54.666866 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747db584-c456-4007-8f51-bd307da346da None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:54.747650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:54.793361 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6e6ba2-3bae-4005-8395-72b97fdfc69e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:54.794254 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747db584-c456-4007-8f51-bd307da346da None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:54.827355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b957a-3393-4fbf-aabd-c65adf80a939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:54.827989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b957a-3393-4fbf-aabd-c65adf80a939 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:54.828268 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b957a-3393-4fbf-aabd-c65adf80a939 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:54.828545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2b957a-3393-4fbf-aabd-c65adf80a939 None admin] PATH_INFO: `/v3/projects/e6b4d136938b4489ad1103924c0d158f` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:54.829176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed00eb-7168-4b61-8dbd-082ec77ed744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:54.829701 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b957a-3393-4fbf-aabd-c65adf80a939 None admin] RBAC: Authorizing `identity:get_project(project_id=e6b4d136938b4489ad1103924c0d158f)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:54.829803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed00eb-7168-4b61-8dbd-082ec77ed744 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:54.830085 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed00eb-7168-4b61-8dbd-082ec77ed744 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:54.830358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ed00eb-7168-4b61-8dbd-082ec77ed744 None admin] PATH_INFO: `/v3/projects/9298874051964940922f79dd919bafce` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:54.831174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2b957a-3393-4fbf-aabd-c65adf80a939 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:54.831532 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed00eb-7168-4b61-8dbd-082ec77ed744 None admin] RBAC: Authorizing `identity:get_project(project_id=9298874051964940922f79dd919bafce)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:54.832987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 226/450] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:54 2022] GET /identity/v3/projects/e6b4d136938b4489ad1103924c0d158f => generated 344 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:54.833096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ed00eb-7168-4b61-8dbd-082ec77ed744 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:54.835174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 225/451] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:08:54 2022] GET /identity/v3/projects/9298874051964940922f79dd919bafce => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:54.838973 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b957a-3393-4fbf-aabd-c65adf80a939 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:54.845776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed00eb-7168-4b61-8dbd-082ec77ed744 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:54.860575 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:54.936538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2b957a-3393-4fbf-aabd-c65adf80a939 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:54.944373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ed00eb-7168-4b61-8dbd-082ec77ed744 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:54.970433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4266c29-18a0-4bbb-91f6-234b36d14e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:54.971092 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4266c29-18a0-4bbb-91f6-234b36d14e4f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:54.971377 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4266c29-18a0-4bbb-91f6-234b36d14e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:54.971645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4266c29-18a0-4bbb-91f6-234b36d14e4f None admin] PATH_INFO: `/v3/groups/cbf6af7484b6400d84984ad686066afe` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:54.972794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4266c29-18a0-4bbb-91f6-234b36d14e4f None admin] RBAC: Authorizing `identity:get_group(group_id=cbf6af7484b6400d84984ad686066afe)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:54.974215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4266c29-18a0-4bbb-91f6-234b36d14e4f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:54.975852 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 227/452] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 1 14:08:54 2022] GET /identity/v3/groups/cbf6af7484b6400d84984ad686066afe => generated 229 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:54.979408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8912be4-e9b6-444f-bacb-a48bbb66af13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:54.980060 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912be4-e9b6-444f-bacb-a48bbb66af13 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:54.980340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912be4-e9b6-444f-bacb-a48bbb66af13 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:54.980776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8912be4-e9b6-444f-bacb-a48bbb66af13 None admin] PATH_INFO: `/v3/groups/da82c36951824613849a61b4be988917` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:54.981645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4266c29-18a0-4bbb-91f6-234b36d14e4f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:54.982012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8912be4-e9b6-444f-bacb-a48bbb66af13 None admin] RBAC: Authorizing `identity:get_group(group_id=da82c36951824613849a61b4be988917)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:54.983470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8912be4-e9b6-444f-bacb-a48bbb66af13 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:54.984269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:54.985223 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 226/453] 10.222.0.70 () {56 vars in 1180 bytes} [Mon Aug 1 14:08:54 2022] GET /identity/v3/groups/da82c36951824613849a61b4be988917 => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:54.991111 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8912be4-e9b6-444f-bacb-a48bbb66af13 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:55.072758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:55.082248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4266c29-18a0-4bbb-91f6-234b36d14e4f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:55.093244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8912be4-e9b6-444f-bacb-a48bbb66af13 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:55.116485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93925383-92a0-4692-9c5b-e900c306dd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:55.117095 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93925383-92a0-4692-9c5b-e900c306dd52 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:55.117375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93925383-92a0-4692-9c5b-e900c306dd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:55.117650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93925383-92a0-4692-9c5b-e900c306dd52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:55.118452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93925383-92a0-4692-9c5b-e900c306dd52 None admin] RBAC: Adding query filter params (group.id=cbf6af7484b6400d84984ad686066afe, role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=e6b4d136938b4489ad1103924c0d158f) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:55.118791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93925383-92a0-4692-9c5b-e900c306dd52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:55.120223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93925383-92a0-4692-9c5b-e900c306dd52 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:55.125859 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 228/454] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 1 14:08:54 2022] GET /identity/v3/role_assignments?group.id=cbf6af7484b6400d84984ad686066afe&scope.project.id=e6b4d136938b4489ad1103924c0d158f&role.id=0681632796d144f6a7ac8eca157001ec => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:55.126437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf788840-60c9-418d-9d8e-179fe3c437fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:55.127144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf788840-60c9-418d-9d8e-179fe3c437fa None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:55.127425 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf788840-60c9-418d-9d8e-179fe3c437fa None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:55.127841 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf788840-60c9-418d-9d8e-179fe3c437fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:55.128639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf788840-60c9-418d-9d8e-179fe3c437fa None admin] RBAC: Adding query filter params (group.id=da82c36951824613849a61b4be988917, role.id=b99d323b1fad482ead67a8e8501c1c0b, scope.project.id=9298874051964940922f79dd919bafce) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:55.128943 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf788840-60c9-418d-9d8e-179fe3c437fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:55.130403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf788840-60c9-418d-9d8e-179fe3c437fa None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:55.137825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 227/455] 10.222.0.70 () {56 vars in 1376 bytes} [Mon Aug 1 14:08:54 2022] GET /identity/v3/role_assignments?group.id=da82c36951824613849a61b4be988917&scope.project.id=9298874051964940922f79dd919bafce&role.id=b99d323b1fad482ead67a8e8501c1c0b => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:57.863165 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1c6f9-0133-46f9-bd0c-43ed18342766 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:57.864155 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1c6f9-0133-46f9-bd0c-43ed18342766 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:57.864669 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1c6f9-0133-46f9-bd0c-43ed18342766 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:57.866493 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 229/456] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:57.872231 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f0470-c505-483b-a214-6e6342510d83 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:57.873063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f0470-c505-483b-a214-6e6342510d83 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:57.873536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6f0470-c505-483b-a214-6e6342510d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:57.892783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1f6f0470-c505-483b-a214-6e6342510d83 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:57.894285 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1f6f0470-c505-483b-a214-6e6342510d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:57.981582 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 228/457] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:58.016427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b439254-c071-498d-8a5f-86328ecea8ad None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:58.016727 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b439254-c071-498d-8a5f-86328ecea8ad None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:58.016982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b439254-c071-498d-8a5f-86328ecea8ad None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:58.018324 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 230/458] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:58.027057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f0470-c505-483b-a214-6e6342510d83 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:58.044329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d9125-5353-408b-b54e-f6e58bc8f80e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:58.044632 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d9125-5353-408b-b54e-f6e58bc8f80e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:58.044901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d9125-5353-408b-b54e-f6e58bc8f80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:58.086653 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9c8d9125-5353-408b-b54e-f6e58bc8f80e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:58.088125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9c8d9125-5353-408b-b54e-f6e58bc8f80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:58.165367 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:58.202956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6f0470-c505-483b-a214-6e6342510d83 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:58.216171 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:58.228090 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 231/459] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:08:58.268412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d9125-5353-408b-b54e-f6e58bc8f80e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:58.270724 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db94f405-e15e-4164-ba3c-489e54eca691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:58.271905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94f405-e15e-4164-ba3c-489e54eca691 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:58.272191 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94f405-e15e-4164-ba3c-489e54eca691 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:58.272463 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db94f405-e15e-4164-ba3c-489e54eca691 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:58.286602 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94f405-e15e-4164-ba3c-489e54eca691 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:58.286602 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db94f405-e15e-4164-ba3c-489e54eca691 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:58.300423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-db94f405-e15e-4164-ba3c-489e54eca691 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:08:58.300423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:58.300423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:58.300423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:58.300423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:58.300423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:58.300423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:58.300423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:58.300423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:58.300423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:58.300423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:58.300423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:58.300423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:08:58.300423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:08:58.300423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:58.301302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:58.302564 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:08:58.302564 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:08:58.302564 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:08:58.302564 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:08:58.302564 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 229/460] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:58.308738 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56c50c-d7c8-4355-8aba-b36aca6504ec None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:58.309027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56c50c-d7c8-4355-8aba-b36aca6504ec None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:58.309302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c56c50c-d7c8-4355-8aba-b36aca6504ec None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:58.314360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 230/461] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:58.314360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56c50c-d7c8-4355-8aba-b36aca6504ec None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:58.403046 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d9125-5353-408b-b54e-f6e58bc8f80e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:58.425855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c56c50c-d7c8-4355-8aba-b36aca6504ec None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:58.438106 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e9dacd-8289-4de2-8f51-e30744c101e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:58.438858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9dacd-8289-4de2-8f51-e30744c101e9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:58.439133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9dacd-8289-4de2-8f51-e30744c101e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:58.439326 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e9dacd-8289-4de2-8f51-e30744c101e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:58.449922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9dacd-8289-4de2-8f51-e30744c101e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:58.451416 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e9dacd-8289-4de2-8f51-e30744c101e9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:58.454183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:58.464388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-262598f4-7d17-4818-9fcb-810395b7ccb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:58.465004 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262598f4-7d17-4818-9fcb-810395b7ccb5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:58.465284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262598f4-7d17-4818-9fcb-810395b7ccb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:58.465554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262598f4-7d17-4818-9fcb-810395b7ccb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:58.466237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262598f4-7d17-4818-9fcb-810395b7ccb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:58.466537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262598f4-7d17-4818-9fcb-810395b7ccb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:58.466952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-a6e9dacd-8289-4de2-8f51-e30744c101e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:08:58.466952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:58.466952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:58.466952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:58.466952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:58.466952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:58.466952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:58.466952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:58.466952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:58.466952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:58.466952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:58.466952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:58.466952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:08:58.466952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:08:58.466952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:58.467758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:58.468605 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:08:58.468605 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:08:58.468605 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:08:58.468605 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:58.468826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-262598f4-7d17-4818-9fcb-810395b7ccb5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:58.468900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 232/462] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:08:58.469663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5668fdd-ed07-4eb7-8637-29a510d7c58c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:58.469944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5668fdd-ed07-4eb7-8637-29a510d7c58c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:58.470217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5668fdd-ed07-4eb7-8637-29a510d7c58c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:58.485345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 231/463] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:58.486518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee0c05-bc1a-4de1-a141-c74dedd891d4 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:58.486834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee0c05-bc1a-4de1-a141-c74dedd891d4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:58.487202 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ee0c05-bc1a-4de1-a141-c74dedd891d4 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:58.488653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 232/464] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:58.489320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee0c05-bc1a-4de1-a141-c74dedd891d4 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:58.493116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f5668fdd-ed07-4eb7-8637-29a510d7c58c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:58.494393 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f5668fdd-ed07-4eb7-8637-29a510d7c58c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:58.539521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:58.564009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 233/465] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:58.565053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5668fdd-ed07-4eb7-8637-29a510d7c58c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:58.612958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ee0c05-bc1a-4de1-a141-c74dedd891d4 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:58.651601 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbceb3ad-5044-4615-b5df-1fe84d31bdda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:58.652685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb3ad-5044-4615-b5df-1fe84d31bdda None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:58.653180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb3ad-5044-4615-b5df-1fe84d31bdda None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:58.653667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbceb3ad-5044-4615-b5df-1fe84d31bdda None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:58.654515 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbceb3ad-5044-4615-b5df-1fe84d31bdda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:58.655040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbceb3ad-5044-4615-b5df-1fe84d31bdda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:58.656810 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbceb3ad-5044-4615-b5df-1fe84d31bdda None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:58.673170 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5668fdd-ed07-4eb7-8637-29a510d7c58c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:58.673326 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 233/466] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:08:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:58.673326 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3452a-f2f9-4bab-8d2c-a57b89a9bc67 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:58.673326 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3452a-f2f9-4bab-8d2c-a57b89a9bc67 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:58.673326 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3452a-f2f9-4bab-8d2c-a57b89a9bc67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:58.689808 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1fb3452a-f2f9-4bab-8d2c-a57b89a9bc67 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:58.690958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1fb3452a-f2f9-4bab-8d2c-a57b89a9bc67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:58.709792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bed079-4720-4312-9ae7-2c6bd591b8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:58.710517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bed079-4720-4312-9ae7-2c6bd591b8ae None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:58.710770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bed079-4720-4312-9ae7-2c6bd591b8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:58.710975 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bed079-4720-4312-9ae7-2c6bd591b8ae None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:58.711643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bed079-4720-4312-9ae7-2c6bd591b8ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:58.713323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bed079-4720-4312-9ae7-2c6bd591b8ae None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:58.735755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 234/467] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:08:58 2022] POST /identity/v3/users => generated 246 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:08:58.739787 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bed079-4720-4312-9ae7-2c6bd591b8ae None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:58.743795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:58.776463 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 234/468] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:58.777784 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3452a-f2f9-4bab-8d2c-a57b89a9bc67 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:58.792625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:58.885688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bed079-4720-4312-9ae7-2c6bd591b8ae None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:58.928016 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ac216-08bf-446f-99b7-a5edb14a1423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:58.928932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ac216-08bf-446f-99b7-a5edb14a1423 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:58.929213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ac216-08bf-446f-99b7-a5edb14a1423 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:58.929481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280ac216-08bf-446f-99b7-a5edb14a1423 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:58.932427 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb3452a-f2f9-4bab-8d2c-a57b89a9bc67 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:58.942496 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ac216-08bf-446f-99b7-a5edb14a1423 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:58.943173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280ac216-08bf-446f-99b7-a5edb14a1423 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:58.958453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-280ac216-08bf-446f-99b7-a5edb14a1423 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:08:58.958453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:58.958453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:58.958453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:58.958453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:58.958453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:58.958453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:58.958453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:58.958453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:58.958453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:58.958453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:58.958453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:58.958453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:08:58.958453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:08:58.958453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:58.960042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:58.960943 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:08:58.960943 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:08:58.960943 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:08:58.960943 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:58.960943 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 235/469] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:58.961212 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ac216-08bf-446f-99b7-a5edb14a1423 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:58.987287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb6987-1da8-45db-a356-53496fa4ce51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:58.987928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb6987-1da8-45db-a356-53496fa4ce51 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:58.988209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb6987-1da8-45db-a356-53496fa4ce51 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:58.988476 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fb6987-1da8-45db-a356-53496fa4ce51 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:58.989155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb6987-1da8-45db-a356-53496fa4ce51 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:58.991222 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fb6987-1da8-45db-a356-53496fa4ce51 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:59.019726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 235/470] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:08:58 2022] POST /identity/v3/users => generated 248 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:08:59.020630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb6987-1da8-45db-a356-53496fa4ce51 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:59.076790 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:59.087658 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:59.114831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280ac216-08bf-446f-99b7-a5edb14a1423 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:59.174430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa93122-ee0d-48d3-b186-ff3846be8357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:59.175174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa93122-ee0d-48d3-b186-ff3846be8357 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:59.175456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa93122-ee0d-48d3-b186-ff3846be8357 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:59.175729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa93122-ee0d-48d3-b186-ff3846be8357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:59.189300 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa93122-ee0d-48d3-b186-ff3846be8357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:59.191081 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa93122-ee0d-48d3-b186-ff3846be8357 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:59.208752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-2aa93122-ee0d-48d3-b186-ff3846be8357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:08:59.208752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:59.208752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:59.208752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:59.208752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:59.208752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:59.208752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:59.208752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:59.208752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:59.208752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:59.208752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:59.208752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:59.208752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:08:59.208752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:08:59.208752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:08:59.210202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:08:59.211099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:08:59.211099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:08:59.211099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:08:59.211099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:59.214571 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 236/471] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:08:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:59.217567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa93122-ee0d-48d3-b186-ff3846be8357 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:59.227356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fb6987-1da8-45db-a356-53496fa4ce51 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:59.266454 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6273c-a199-4bd5-8a28-e1a671f8e0be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:59.267114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6273c-a199-4bd5-8a28-e1a671f8e0be None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:59.267395 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6273c-a199-4bd5-8a28-e1a671f8e0be None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:59.267668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d6273c-a199-4bd5-8a28-e1a671f8e0be None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:59.268450 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6273c-a199-4bd5-8a28-e1a671f8e0be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:59.268751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6273c-a199-4bd5-8a28-e1a671f8e0be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:59.270146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d6273c-a199-4bd5-8a28-e1a671f8e0be None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:59.285861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 236/472] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:08:59.292397 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6273c-a199-4bd5-8a28-e1a671f8e0be None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:59.359567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa93122-ee0d-48d3-b186-ff3846be8357 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:59.403719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62a4bcdb-586c-464c-8ca4-84f32cc5c13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:59.404352 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4bcdb-586c-464c-8ca4-84f32cc5c13f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:59.404633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4bcdb-586c-464c-8ca4-84f32cc5c13f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:59.404906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a4bcdb-586c-464c-8ca4-84f32cc5c13f None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:59.406011 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4bcdb-586c-464c-8ca4-84f32cc5c13f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:08:59.406011 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4bcdb-586c-464c-8ca4-84f32cc5c13f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:59.407302 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62a4bcdb-586c-464c-8ca4-84f32cc5c13f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:59.410533 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:59.416106 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:59.423940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 237/473] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:08:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:08:59.425232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08629312-1562-47e0-afa9-c7361d819d14 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:59.425451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d6273c-a199-4bd5-8a28-e1a671f8e0be None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:59.425552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08629312-1562-47e0-afa9-c7361d819d14 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:59.425782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08629312-1562-47e0-afa9-c7361d819d14 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:59.427332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 238/474] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:08:59.429362 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08629312-1562-47e0-afa9-c7361d819d14 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:59.472368 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bb7535-1024-4697-8446-bc3f7067009c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:59.473828 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb7535-1024-4697-8446-bc3f7067009c None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:59.474109 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb7535-1024-4697-8446-bc3f7067009c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:59.474385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bb7535-1024-4697-8446-bc3f7067009c None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:59.475124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb7535-1024-4697-8446-bc3f7067009c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:59.476595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bb7535-1024-4697-8446-bc3f7067009c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:59.507329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 237/475] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:08:59 2022] POST /identity/v3/users => generated 248 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:08:59.509048 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee32a2-019a-4648-aa11-5a288c9f61fc None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:59.510031 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee32a2-019a-4648-aa11-5a288c9f61fc None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:59.510340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ee32a2-019a-4648-aa11-5a288c9f61fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:59.552274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e8ee32a2-019a-4648-aa11-5a288c9f61fc None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:08:59.553552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e8ee32a2-019a-4648-aa11-5a288c9f61fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:08:59.566689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08629312-1562-47e0-afa9-c7361d819d14 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:59.643418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9afcd-4c29-43ba-a70e-94de035fe0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:59.644059 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9afcd-4c29-43ba-a70e-94de035fe0b5 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:59.644337 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9afcd-4c29-43ba-a70e-94de035fe0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:59.644606 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f9afcd-4c29-43ba-a70e-94de035fe0b5 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:59.645366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9afcd-4c29-43ba-a70e-94de035fe0b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:59.648039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f9afcd-4c29-43ba-a70e-94de035fe0b5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:59.683228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 239/476] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:08:59 2022] POST /identity/v3/users => generated 249 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:08:59.695479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 238/477] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:08:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:08:59.722989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9afcd-4c29-43ba-a70e-94de035fe0b5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:08:59.798264 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:08:59.854355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f9afcd-4c29-43ba-a70e-94de035fe0b5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:08:59.894063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87257853-0539-4e57-a6e8-5361277c1f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:08:59.894748 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87257853-0539-4e57-a6e8-5361277c1f94 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:08:59.894977 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87257853-0539-4e57-a6e8-5361277c1f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:08:59.895251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87257853-0539-4e57-a6e8-5361277c1f94 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:08:59.895973 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87257853-0539-4e57-a6e8-5361277c1f94 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:08:59.897403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87257853-0539-4e57-a6e8-5361277c1f94 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:08:59.909596 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.sql.core [None req-87257853-0539-4e57-a6e8-5361277c1f94 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 14:08:59.909596 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 14:08:59.909596 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [parameters: {'id': 'b41fda333ed8426b9cfc906b3f7ed9b9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 14:08:59.909596 dv-cinder-845990-5-smb devstack@keystone.service[80141]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80141) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 14:08:59.925448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-87257853-0539-4e57-a6e8-5361277c1f94 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 14:08:59.925448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:59.925448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 14:08:59.925448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 14:08:59.925448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 14:08:59.925448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 14:08:59.925448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 14:08:59.925448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 14:08:59.925448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 14:08:59.925448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application conn.query(q) Aug 01 14:08:59.925448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 14:08:59.925448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 14:08:59.925448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 14:08:59.925448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result.read() Aug 01 14:08:59.925448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return ref.to_dict() Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 14:08:59.926344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application next(self.gen) Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application yield resource Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application next(self.gen) Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise self.value Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application session.commit() Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 14:08:59.927296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.session.flush() Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application compat.raise_( Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 14:08:59.928706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 14:08:59.929589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application conn.query(q) Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result.read() Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 14:08:59.930408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [parameters: {'id': 'b41fda333ed8426b9cfc906b3f7ed9b9', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:08:59.932556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 01 14:08:59.933577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:08:59.934708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 240/478] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Aug 1 14:08:59 2022] POST /identity/v3/roles => generated 144 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:08:59.935589 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee32a2-019a-4648-aa11-5a288c9f61fc None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:00.035723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:00.059142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ee32a2-019a-4648-aa11-5a288c9f61fc None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:00.096972 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cf76b0-0adf-4a31-a670-91e27972a78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:00.097626 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf76b0-0adf-4a31-a670-91e27972a78a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:00.097904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf76b0-0adf-4a31-a670-91e27972a78a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:00.098221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cf76b0-0adf-4a31-a670-91e27972a78a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:00.109927 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cf76b0-0adf-4a31-a670-91e27972a78a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-51cf76b0-0adf-4a31-a670-91e27972a78a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:00.114958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:00.116418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:00.117227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:00.117227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:00.117227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:00.117227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:00.117227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:00.117227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:00.117227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:00.117227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:00.117227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:00.117227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:00.117227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 01 14:09:00.117227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:00.117227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 239/479] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:08:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:00.123853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87257853-0539-4e57-a6e8-5361277c1f94 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:00.291482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87257853-0539-4e57-a6e8-5361277c1f94 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:00.315864 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:00.339919 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb9a0af-45d0-4c15-b7ed-34b965390570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:00.340554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9a0af-45d0-4c15-b7ed-34b965390570 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:00.340838 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9a0af-45d0-4c15-b7ed-34b965390570 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:00.341115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb9a0af-45d0-4c15-b7ed-34b965390570 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:00.341834 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9a0af-45d0-4c15-b7ed-34b965390570 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:00.342138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9a0af-45d0-4c15-b7ed-34b965390570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:00.343563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb9a0af-45d0-4c15-b7ed-34b965390570 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:00.358260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 241/480] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:01.324429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522a660-96c7-4037-bf85-fbc6e04cfa3b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:01.324972 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522a660-96c7-4037-bf85-fbc6e04cfa3b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:01.324972 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c522a660-96c7-4037-bf85-fbc6e04cfa3b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:01.326324 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 240/481] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:01.336702 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502cb7c-f6e5-4112-89c1-06f34503174d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:01.337140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502cb7c-f6e5-4112-89c1-06f34503174d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:01.337334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7502cb7c-f6e5-4112-89c1-06f34503174d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:01.368466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7502cb7c-f6e5-4112-89c1-06f34503174d None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:01.369660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7502cb7c-f6e5-4112-89c1-06f34503174d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:01.465102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 242/482] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:01.497700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522a660-96c7-4037-bf85-fbc6e04cfa3b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:01.642845 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203df50-39b2-4d96-b90e-b9c6275294df None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:01.643517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203df50-39b2-4d96-b90e-b9c6275294df None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:01.644064 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2203df50-39b2-4d96-b90e-b9c6275294df None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:01.645862 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 243/483] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:09:01.651015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c522a660-96c7-4037-bf85-fbc6e04cfa3b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:01.651272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a2fe8-eab5-4706-a2f0-3ec3d9c4ebd3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:01.651781 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a2fe8-eab5-4706-a2f0-3ec3d9c4ebd3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:01.652256 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143a2fe8-eab5-4706-a2f0-3ec3d9c4ebd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:01.671433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-143a2fe8-eab5-4706-a2f0-3ec3d9c4ebd3 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:01.672933 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-143a2fe8-eab5-4706-a2f0-3ec3d9c4ebd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:01.715849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6ceea-c9b9-4510-8b03-01278b93f65d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:01.716681 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6ceea-c9b9-4510-8b03-01278b93f65d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:01.716792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6ceea-c9b9-4510-8b03-01278b93f65d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:01.717037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d6ceea-c9b9-4510-8b03-01278b93f65d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:01.733955 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:01.739839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d6ceea-c9b9-4510-8b03-01278b93f65d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:01.747807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 244/484] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-57d6ceea-c9b9-4510-8b03-01278b93f65d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:01.755418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:01.756411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:01.757210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:01.757210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:01.757210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:01.757210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:01.757210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:01.757210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:01.757210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:01.757210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:01.757210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:01.757210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:01.757210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:01.757210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:01.757210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 241/485] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:01.762545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a2fe8-eab5-4706-a2f0-3ec3d9c4ebd3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:01.811670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6ceea-c9b9-4510-8b03-01278b93f65d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:01.826954 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:01.883815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143a2fe8-eab5-4706-a2f0-3ec3d9c4ebd3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:01.925768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d055317-be77-494a-b974-49094c4eeacc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:01.926914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d055317-be77-494a-b974-49094c4eeacc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:01.927448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d055317-be77-494a-b974-49094c4eeacc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:01.928452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d055317-be77-494a-b974-49094c4eeacc None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:01.929379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d055317-be77-494a-b974-49094c4eeacc None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:01.929933 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d055317-be77-494a-b974-49094c4eeacc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:01.931595 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d055317-be77-494a-b974-49094c4eeacc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:01.941965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 245/486] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:01.951182 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d055317-be77-494a-b974-49094c4eeacc None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:01.956472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d6ceea-c9b9-4510-8b03-01278b93f65d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:02.031429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f681a0a-2b0a-44ef-b192-af3ad2866118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:02.032110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f681a0a-2b0a-44ef-b192-af3ad2866118 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:02.032395 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f681a0a-2b0a-44ef-b192-af3ad2866118 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:02.032671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f681a0a-2b0a-44ef-b192-af3ad2866118 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:02.052479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f681a0a-2b0a-44ef-b192-af3ad2866118 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-7f681a0a-2b0a-44ef-b192-af3ad2866118 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:02.066271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:02.067249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:02.068071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:02.068071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:02.068071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:02.068071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:02.068071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:02.068071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:02.068071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:02.068071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:02.068071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:02.068071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:02.068071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:02.068071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:02.068071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 242/487] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:02.076032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f681a0a-2b0a-44ef-b192-af3ad2866118 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:02.100205 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d055317-be77-494a-b974-49094c4eeacc None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:02.102878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:02.151811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fe10f-247a-40ff-84eb-b006575bb6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:02.152614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fe10f-247a-40ff-84eb-b006575bb6bd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:02.152903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fe10f-247a-40ff-84eb-b006575bb6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:02.153183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5fe10f-247a-40ff-84eb-b006575bb6bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:02.165911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fe10f-247a-40ff-84eb-b006575bb6bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:02.167421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5fe10f-247a-40ff-84eb-b006575bb6bd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:02.183406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-1e5fe10f-247a-40ff-84eb-b006575bb6bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:02.183406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:02.183406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:02.183406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:02.183406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:02.183406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:02.183406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:02.183406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:02.183406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:02.183406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:02.183406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:02.183406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:02.183406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:02.183406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:02.183406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:02.184251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:02.185096 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:02.185096 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:02.185096 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:02.185096 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:02.185301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 246/488] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:02.190830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fe10f-247a-40ff-84eb-b006575bb6bd None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:02.211968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:02.262803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f681a0a-2b0a-44ef-b192-af3ad2866118 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:02.301075 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4808b25-4df0-466b-9593-a9fe7ef061ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:02.301700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4808b25-4df0-466b-9593-a9fe7ef061ee None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:02.301983 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4808b25-4df0-466b-9593-a9fe7ef061ee None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:02.302259 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4808b25-4df0-466b-9593-a9fe7ef061ee None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:02.303054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4808b25-4df0-466b-9593-a9fe7ef061ee None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:02.303360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4808b25-4df0-466b-9593-a9fe7ef061ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:02.304778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4808b25-4df0-466b-9593-a9fe7ef061ee None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:02.315374 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 243/489] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:02 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:02.321631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4243a-4bd5-4b00-b1a5-b3efc25dfb52 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:02.321941 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4243a-4bd5-4b00-b1a5-b3efc25dfb52 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:02.322224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a4243a-4bd5-4b00-b1a5-b3efc25dfb52 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:02.323857 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 244/490] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:02.324618 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4243a-4bd5-4b00-b1a5-b3efc25dfb52 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:02.407932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5fe10f-247a-40ff-84eb-b006575bb6bd None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:02.443584 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a4243a-4bd5-4b00-b1a5-b3efc25dfb52 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:02.454919 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cdff8a-35a1-460f-9818-267027843099 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:02.455672 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdff8a-35a1-460f-9818-267027843099 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:02.456015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdff8a-35a1-460f-9818-267027843099 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:02.456363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cdff8a-35a1-460f-9818-267027843099 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:02.457129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdff8a-35a1-460f-9818-267027843099 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:02.460405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdff8a-35a1-460f-9818-267027843099 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:02.460405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cdff8a-35a1-460f-9818-267027843099 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:02.470750 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:02.476134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 247/491] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:02.476134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1f4d7-df04-4dce-9f95-d5c0e65567d6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:02.476134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1f4d7-df04-4dce-9f95-d5c0e65567d6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:02.476134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f1f4d7-df04-4dce-9f95-d5c0e65567d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:02.487685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaed8a2-52ef-4c5d-9cf0-aaa15a8c2149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:02.488352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaed8a2-52ef-4c5d-9cf0-aaa15a8c2149 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:02.488629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaed8a2-52ef-4c5d-9cf0-aaa15a8c2149 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:02.488906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaed8a2-52ef-4c5d-9cf0-aaa15a8c2149 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:02.497806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c5f1f4d7-df04-4dce-9f95-d5c0e65567d6 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:02.499450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c5f1f4d7-df04-4dce-9f95-d5c0e65567d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:02.503234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaed8a2-52ef-4c5d-9cf0-aaa15a8c2149 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:02.504731 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaed8a2-52ef-4c5d-9cf0-aaa15a8c2149 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:02.517119 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:02.520028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-3eaed8a2-52ef-4c5d-9cf0-aaa15a8c2149 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:02.520028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:02.520028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:02.520028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:02.520028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:02.520028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:02.520028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:02.520028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:02.520028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:02.520028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:02.520028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:02.520028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:02.520028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:02.520028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:02.520028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:02.522838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:02.524531 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:02.524531 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:02.524531 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:02.524531 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:02.526451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 245/492] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:02.527346 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaed8a2-52ef-4c5d-9cf0-aaa15a8c2149 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:02.589854 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 248/493] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:02.591036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724eedd-34f5-4e7c-a94f-f836aef547d8 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:02.591324 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724eedd-34f5-4e7c-a94f-f836aef547d8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:02.591599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8724eedd-34f5-4e7c-a94f-f836aef547d8 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:02.598487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 249/494] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:02.598487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724eedd-34f5-4e7c-a94f-f836aef547d8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:02.674276 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaed8a2-52ef-4c5d-9cf0-aaa15a8c2149 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:02.722048 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5f667-626c-45f1-996e-06dc199251f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:02.723093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5f667-626c-45f1-996e-06dc199251f2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:02.723605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5f667-626c-45f1-996e-06dc199251f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:02.724172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5f667-626c-45f1-996e-06dc199251f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:02.727157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8724eedd-34f5-4e7c-a94f-f836aef547d8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:02.738650 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5f667-626c-45f1-996e-06dc199251f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:02.741918 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5f667-626c-45f1-996e-06dc199251f2 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-72d5f667-626c-45f1-996e-06dc199251f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:02.764671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:02.765631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:02.766557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:02.766557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:02.766557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:02.766557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:02.766557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:02.766557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:02.766557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:02.766557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:02.766557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:09:02.766557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:02.767129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 246/495] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 1 14:09:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:02.769009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c570292-b2ae-4430-bd07-9cf1e7cebb74 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:02.769512 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c570292-b2ae-4430-bd07-9cf1e7cebb74 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:02.770007 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c570292-b2ae-4430-bd07-9cf1e7cebb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:02.774543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ac310-55dc-489e-a28f-307cc40546e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:02.775207 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ac310-55dc-489e-a28f-307cc40546e1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:02.775491 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ac310-55dc-489e-a28f-307cc40546e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:02.775767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335ac310-55dc-489e-a28f-307cc40546e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:02.776471 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ac310-55dc-489e-a28f-307cc40546e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:02.776779 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ac310-55dc-489e-a28f-307cc40546e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:02.778155 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335ac310-55dc-489e-a28f-307cc40546e1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:02.795079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 250/496] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:02.795079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ac310-55dc-489e-a28f-307cc40546e1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:02.795866 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9c570292-b2ae-4430-bd07-9cf1e7cebb74 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:02.797156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9c570292-b2ae-4430-bd07-9cf1e7cebb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:02.799735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:02.826286 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:02.874292 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 247/497] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:02.875172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c570292-b2ae-4430-bd07-9cf1e7cebb74 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:02.903959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335ac310-55dc-489e-a28f-307cc40546e1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:02.938922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa70b-3629-4a37-ad6a-133beb35af07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:02.939571 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa70b-3629-4a37-ad6a-133beb35af07 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:02.939851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa70b-3629-4a37-ad6a-133beb35af07 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:02.940131 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbfa70b-3629-4a37-ad6a-133beb35af07 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:02.951037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fbfa70b-3629-4a37-ad6a-133beb35af07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-7fbfa70b-3629-4a37-ad6a-133beb35af07 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:02.956383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:02.957604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:02.958404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:02.958404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:02.958404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:02.958404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:02.958404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:02.958404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:02.958404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:02.958404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:02.958404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:02.958404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:02.958404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:02.958404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:02.958404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 251/498] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:02.958404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa70b-3629-4a37-ad6a-133beb35af07 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:03.000400 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c570292-b2ae-4430-bd07-9cf1e7cebb74 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:03.024122 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:03.034702 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1357e3d-8424-438b-bfeb-525f33620a99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:03.035340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1357e3d-8424-438b-bfeb-525f33620a99 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:03.035619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1357e3d-8424-438b-bfeb-525f33620a99 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:03.035889 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1357e3d-8424-438b-bfeb-525f33620a99 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:03.036675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1357e3d-8424-438b-bfeb-525f33620a99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:03.036973 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1357e3d-8424-438b-bfeb-525f33620a99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:03.038422 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1357e3d-8424-438b-bfeb-525f33620a99 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:03.062586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fbfa70b-3629-4a37-ad6a-133beb35af07 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:03.075123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 248/499] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 1 14:09:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:03.076365 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3e5cf-8707-43e1-bf1b-459f72f60424 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:03.076648 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3e5cf-8707-43e1-bf1b-459f72f60424 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:03.076918 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3e5cf-8707-43e1-bf1b-459f72f60424 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:03.078102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 249/500] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:03.078803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3e5cf-8707-43e1-bf1b-459f72f60424 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:03.100976 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:03.103737 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d808b6-89eb-4096-9e80-dab03e97bbf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:03.104411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d808b6-89eb-4096-9e80-dab03e97bbf7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:03.104692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d808b6-89eb-4096-9e80-dab03e97bbf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:03.104965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d808b6-89eb-4096-9e80-dab03e97bbf7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:03.112602 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d808b6-89eb-4096-9e80-dab03e97bbf7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:03.113999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d808b6-89eb-4096-9e80-dab03e97bbf7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-98d808b6-89eb-4096-9e80-dab03e97bbf7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:03.126657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:03.127577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:03.128460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:03.128460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:03.128460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:03.128460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:03.128460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:03.128460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:03.128460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:03.128460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:03.128460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 14:09:03.128460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:03.128460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 252/501] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:09:02 2022] GET /identity/v3/users/glance => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:03.129009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d808b6-89eb-4096-9e80-dab03e97bbf7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:03.187202 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3e5cf-8707-43e1-bf1b-459f72f60424 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:03.220815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967559-c1d9-4a7e-aea3-f75a0a037200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:03.221462 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967559-c1d9-4a7e-aea3-f75a0a037200 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:03.221744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967559-c1d9-4a7e-aea3-f75a0a037200 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:03.222021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78967559-c1d9-4a7e-aea3-f75a0a037200 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:03.232810 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78967559-c1d9-4a7e-aea3-f75a0a037200 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-78967559-c1d9-4a7e-aea3-f75a0a037200 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:03.237815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:03.238881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:03.239666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:03.239666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:03.239666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:03.239666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:03.239666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:03.239666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:03.239666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:03.239666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:03.239666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:03.239666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:03.239666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:03.239666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:03.239666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 250/502] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:03.241061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967559-c1d9-4a7e-aea3-f75a0a037200 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:03.247589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d808b6-89eb-4096-9e80-dab03e97bbf7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:03.271069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:03.282224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582d1d34-724b-4ae9-861f-b41a3331ed8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:03.282863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d1d34-724b-4ae9-861f-b41a3331ed8d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:03.283138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d1d34-724b-4ae9-861f-b41a3331ed8d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:03.283406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582d1d34-724b-4ae9-861f-b41a3331ed8d None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:03.284235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d1d34-724b-4ae9-861f-b41a3331ed8d None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:03.284633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d1d34-724b-4ae9-861f-b41a3331ed8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:03.286051 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582d1d34-724b-4ae9-861f-b41a3331ed8d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:03.295025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 253/503] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:03.296105 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892901b-a236-4d28-a7af-1ab3fd21a25d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:03.296387 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892901b-a236-4d28-a7af-1ab3fd21a25d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:03.296655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4892901b-a236-4d28-a7af-1ab3fd21a25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:03.315870 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4892901b-a236-4d28-a7af-1ab3fd21a25d None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:03.317065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4892901b-a236-4d28-a7af-1ab3fd21a25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:03.326704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:03.346134 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78967559-c1d9-4a7e-aea3-f75a0a037200 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:03.380326 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6623f34-2ca0-45a1-936c-ad757b8f59e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:03.380975 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6623f34-2ca0-45a1-936c-ad757b8f59e3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:03.381254 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6623f34-2ca0-45a1-936c-ad757b8f59e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:03.381667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6623f34-2ca0-45a1-936c-ad757b8f59e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:03.384838 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 254/504] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:03.385743 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892901b-a236-4d28-a7af-1ab3fd21a25d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:03.453559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6623f34-2ca0-45a1-936c-ad757b8f59e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:03.455106 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6623f34-2ca0-45a1-936c-ad757b8f59e3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:03.485554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4892901b-a236-4d28-a7af-1ab3fd21a25d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:03.502809 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:03.523378 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418dbd9-bde9-42f4-9386-1bbc438835d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:03.523915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418dbd9-bde9-42f4-9386-1bbc438835d4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:03.524203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418dbd9-bde9-42f4-9386-1bbc438835d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:03.524477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a418dbd9-bde9-42f4-9386-1bbc438835d4 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:03.525275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418dbd9-bde9-42f4-9386-1bbc438835d4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:03.525583 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418dbd9-bde9-42f4-9386-1bbc438835d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:03.527072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a418dbd9-bde9-42f4-9386-1bbc438835d4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:03.539481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:03.559674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 251/505] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:03.560531 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6623f34-2ca0-45a1-936c-ad757b8f59e3 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:03.568483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 255/506] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Aug 1 14:09:03 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:03.569342 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418dbd9-bde9-42f4-9386-1bbc438835d4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:03.666776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6623f34-2ca0-45a1-936c-ad757b8f59e3 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:03.673550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a418dbd9-bde9-42f4-9386-1bbc438835d4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:03.701041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815adcb3-8390-4b54-b996-41d00c4a7d9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:03.701806 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815adcb3-8390-4b54-b996-41d00c4a7d9f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:03.702079 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815adcb3-8390-4b54-b996-41d00c4a7d9f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:03.702344 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815adcb3-8390-4b54-b996-41d00c4a7d9f None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:03.703084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815adcb3-8390-4b54-b996-41d00c4a7d9f None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:03.703390 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815adcb3-8390-4b54-b996-41d00c4a7d9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:03.704774 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815adcb3-8390-4b54-b996-41d00c4a7d9f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:03.709994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad71e22-25f0-49fc-8018-362c5018bb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:03.710667 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad71e22-25f0-49fc-8018-362c5018bb6e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:03.710954 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad71e22-25f0-49fc-8018-362c5018bb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:03.711229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad71e22-25f0-49fc-8018-362c5018bb6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:03.714017 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 252/507] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:03.715046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815adcb3-8390-4b54-b996-41d00c4a7d9f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:03.723389 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad71e22-25f0-49fc-8018-362c5018bb6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:03.725550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad71e22-25f0-49fc-8018-362c5018bb6e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:03.740191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-dad71e22-25f0-49fc-8018-362c5018bb6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:03.740191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:03.740191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:03.740191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:03.740191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:03.740191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:03.740191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:03.740191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:03.740191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:03.740191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:03.740191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:03.740191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:03.740191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:03.740191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:03.740191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:03.741228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:03.742358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:03.742358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:03.742358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:03.742358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:03.742358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 256/508] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:03.742358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad71e22-25f0-49fc-8018-362c5018bb6e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:03.762988 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:03.768893 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:03.821159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815adcb3-8390-4b54-b996-41d00c4a7d9f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:03.842932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad71e22-25f0-49fc-8018-362c5018bb6e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:03.854621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca9383-f128-48d6-b642-8a8aa471b2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:03.855262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca9383-f128-48d6-b642-8a8aa471b2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:03.855540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca9383-f128-48d6-b642-8a8aa471b2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:03.855815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ca9383-f128-48d6-b642-8a8aa471b2d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:03.866263 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca9383-f128-48d6-b642-8a8aa471b2d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:03.867763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ca9383-f128-48d6-b642-8a8aa471b2d4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:03.875588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a8801-2a9f-4831-8885-d306f311e20e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:03.876211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a8801-2a9f-4831-8885-d306f311e20e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:03.876487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a8801-2a9f-4831-8885-d306f311e20e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:03.876756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401a8801-2a9f-4831-8885-d306f311e20e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:03.882123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-34ca9383-f128-48d6-b642-8a8aa471b2d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:03.882123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:03.882123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:03.882123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:03.882123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:03.882123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:03.882123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:03.882123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:03.882123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:03.882123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:03.882123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:03.882123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:03.882123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:03.882123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:03.882123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:03.882993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:03.883825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:03.883825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:03.883825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:03.883825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:03.883825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 253/509] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:03.884104 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca9383-f128-48d6-b642-8a8aa471b2d4 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:03.892329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a8801-2a9f-4831-8885-d306f311e20e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:03.894238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401a8801-2a9f-4831-8885-d306f311e20e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:03.909042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-401a8801-2a9f-4831-8885-d306f311e20e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:03.909042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:03.909042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:03.909042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:03.909042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:03.909042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:03.909042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:03.909042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:03.909042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:03.909042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:03.909042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:03.909042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:03.909042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:03.909042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:03.909042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:03.909983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:03.910852 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:03.910852 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:03.910852 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:03.910852 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:03.910852 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 257/510] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:03.911451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a8801-2a9f-4831-8885-d306f311e20e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:03.980360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:03.987268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ca9383-f128-48d6-b642-8a8aa471b2d4 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:03.997557 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:04.023472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba7b27-be1d-4541-8118-aa93ea02e6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:04.024090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba7b27-be1d-4541-8118-aa93ea02e6ff None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:04.024187 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401a8801-2a9f-4831-8885-d306f311e20e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:04.024369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba7b27-be1d-4541-8118-aa93ea02e6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:04.024642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba7b27-be1d-4541-8118-aa93ea02e6ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:04.058237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c5b53-0da7-4aa6-a397-94dd8bf342c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:04.058906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c5b53-0da7-4aa6-a397-94dd8bf342c3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:04.059189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c5b53-0da7-4aa6-a397-94dd8bf342c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:04.059469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c5b53-0da7-4aa6-a397-94dd8bf342c3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:04.070358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c5b53-0da7-4aa6-a397-94dd8bf342c3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:04.071968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c5b53-0da7-4aa6-a397-94dd8bf342c3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:04.087476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ad2c5b53-0da7-4aa6-a397-94dd8bf342c3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:04.087476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:04.087476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:04.087476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:04.087476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:04.087476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:04.087476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:04.087476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:04.087476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:04.087476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:04.087476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:04.087476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:04.087476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:04.087476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:04.087476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:04.088565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:04.094450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:04.094450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:04.094450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:04.094450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:04.094450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 258/511] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:04.094450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c5b53-0da7-4aa6-a397-94dd8bf342c3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:04.094861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba7b27-be1d-4541-8118-aa93ea02e6ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:04.094861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faba7b27-be1d-4541-8118-aa93ea02e6ff None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:04.183690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:04.187687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c5b53-0da7-4aa6-a397-94dd8bf342c3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:04.193629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 254/512] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:04.194448 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba7b27-be1d-4541-8118-aa93ea02e6ff None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:04.216823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:04.223520 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021b127-4a7d-467c-9886-a4dc354d014f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:04.224138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021b127-4a7d-467c-9886-a4dc354d014f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:04.224445 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021b127-4a7d-467c-9886-a4dc354d014f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:04.224727 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8021b127-4a7d-467c-9886-a4dc354d014f None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:04.225415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021b127-4a7d-467c-9886-a4dc354d014f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:04.225722 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021b127-4a7d-467c-9886-a4dc354d014f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:04.227133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8021b127-4a7d-467c-9886-a4dc354d014f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:04.238858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 259/513] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:04.239535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021b127-4a7d-467c-9886-a4dc354d014f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:04.300494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faba7b27-be1d-4541-8118-aa93ea02e6ff None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:04.342813 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343cabd-896a-4e47-a654-b1993a0ad615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:04.343437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343cabd-896a-4e47-a654-b1993a0ad615 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:04.343628 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343cabd-896a-4e47-a654-b1993a0ad615 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:04.343904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5343cabd-896a-4e47-a654-b1993a0ad615 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:04.344598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343cabd-896a-4e47-a654-b1993a0ad615 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:04.344898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343cabd-896a-4e47-a654-b1993a0ad615 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:04.346287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5343cabd-896a-4e47-a654-b1993a0ad615 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:04.356299 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8021b127-4a7d-467c-9886-a4dc354d014f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:04.358968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 255/514] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:04.359784 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343cabd-896a-4e47-a654-b1993a0ad615 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:04.392514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dbb00-3493-4c97-9e7b-aaddf7d9636d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:04.393127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dbb00-3493-4c97-9e7b-aaddf7d9636d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:04.393410 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dbb00-3493-4c97-9e7b-aaddf7d9636d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:04.393684 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156dbb00-3493-4c97-9e7b-aaddf7d9636d None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:04.394367 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dbb00-3493-4c97-9e7b-aaddf7d9636d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:04.394694 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dbb00-3493-4c97-9e7b-aaddf7d9636d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:04.396056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-156dbb00-3493-4c97-9e7b-aaddf7d9636d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:04.407023 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 260/515] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:04.411624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dbb00-3493-4c97-9e7b-aaddf7d9636d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:04.421454 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:04.456636 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:04.467827 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5343cabd-896a-4e47-a654-b1993a0ad615 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:04.500337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a5c08-4c1d-4a3c-8dde-cd3ec8f458a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:04.500953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a5c08-4c1d-4a3c-8dde-cd3ec8f458a3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:04.501230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a5c08-4c1d-4a3c-8dde-cd3ec8f458a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:04.501502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a5c08-4c1d-4a3c-8dde-cd3ec8f458a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:04.502181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a5c08-4c1d-4a3c-8dde-cd3ec8f458a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:04.502483 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a5c08-4c1d-4a3c-8dde-cd3ec8f458a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:04.503932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7a5c08-4c1d-4a3c-8dde-cd3ec8f458a3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:04.506794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-156dbb00-3493-4c97-9e7b-aaddf7d9636d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:04.516141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 256/516] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:04.516750 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a5c08-4c1d-4a3c-8dde-cd3ec8f458a3 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:04.543313 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c783dc-1b71-4488-9988-700dbd8bd815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:04.543951 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c783dc-1b71-4488-9988-700dbd8bd815 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:04.544227 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c783dc-1b71-4488-9988-700dbd8bd815 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:04.544499 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c783dc-1b71-4488-9988-700dbd8bd815 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:04.555532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c783dc-1b71-4488-9988-700dbd8bd815 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:04.557034 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c783dc-1b71-4488-9988-700dbd8bd815 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:04.572295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-41c783dc-1b71-4488-9988-700dbd8bd815 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:04.572295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:04.572295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:04.572295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:04.572295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:04.572295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:04.572295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:04.572295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:04.572295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:04.572295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:04.572295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:04.572295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:04.572295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:04.572295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:04.572295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:04.573138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:04.573983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:04.573983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:04.573983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:04.573983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:04.573983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 261/517] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:04.574251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c783dc-1b71-4488-9988-700dbd8bd815 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:04.621257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a5c08-4c1d-4a3c-8dde-cd3ec8f458a3 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:04.635766 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:04.656717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591df81-52ae-4989-a8db-7d566fe3a59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:04.657358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591df81-52ae-4989-a8db-7d566fe3a59b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:04.657653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591df81-52ae-4989-a8db-7d566fe3a59b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:04.657906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e591df81-52ae-4989-a8db-7d566fe3a59b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:04.664961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591df81-52ae-4989-a8db-7d566fe3a59b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:04.666420 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e591df81-52ae-4989-a8db-7d566fe3a59b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:04.673835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c783dc-1b71-4488-9988-700dbd8bd815 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:04.675394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-e591df81-52ae-4989-a8db-7d566fe3a59b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:04.678393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:04.679358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:04.680518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:04.680518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:04.680518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:04.680518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:04.680518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:04.680518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:04.680518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:04.680518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:04.680518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:09:04.680518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:04.680518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 257/518] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:09:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:04.681231 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591df81-52ae-4989-a8db-7d566fe3a59b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:04.711748 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d57ba3-a66f-457e-8e51-2a1d12e43fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:04.712364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d57ba3-a66f-457e-8e51-2a1d12e43fef None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:04.712649 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d57ba3-a66f-457e-8e51-2a1d12e43fef None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:04.713208 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d57ba3-a66f-457e-8e51-2a1d12e43fef None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:04.713887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d57ba3-a66f-457e-8e51-2a1d12e43fef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:04.715368 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d57ba3-a66f-457e-8e51-2a1d12e43fef None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:04.737243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 262/519] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:09:04 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:09:04.738052 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d57ba3-a66f-457e-8e51-2a1d12e43fef None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:04.794230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e591df81-52ae-4989-a8db-7d566fe3a59b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:04.832598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cb55a-80e6-4578-bed1-72786ea27e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:04.833260 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cb55a-80e6-4578-bed1-72786ea27e7d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:04.833539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cb55a-80e6-4578-bed1-72786ea27e7d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:04.833876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45cb55a-80e6-4578-bed1-72786ea27e7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:04.841991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cb55a-80e6-4578-bed1-72786ea27e7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:04.843548 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45cb55a-80e6-4578-bed1-72786ea27e7d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:04.855611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d57ba3-a66f-457e-8e51-2a1d12e43fef None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:04.856537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-e45cb55a-80e6-4578-bed1-72786ea27e7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:04.856537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:04.856537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:04.856537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:04.856537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:04.856537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:04.856537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:04.856537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:04.856537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:04.856537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:04.856537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:04.856537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:04.856537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:04.856537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:04.856537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:04.857506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:04.858569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:04.858569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:04.858569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:04.858569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:04.858569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:04.858569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:04.858569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:04.858569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:04.862632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 258/520] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:04.863590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cb55a-80e6-4578-bed1-72786ea27e7d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:04.899432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ae6a2-3488-4385-b7ab-89287002a2f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:04.900020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ae6a2-3488-4385-b7ab-89287002a2f1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:04.900297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ae6a2-3488-4385-b7ab-89287002a2f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:04.900569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9ae6a2-3488-4385-b7ab-89287002a2f1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:04.902765 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:04.909726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ae6a2-3488-4385-b7ab-89287002a2f1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:04.911425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9ae6a2-3488-4385-b7ab-89287002a2f1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ce9ae6a2-3488-4385-b7ab-89287002a2f1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:04.923614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:04.924547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:04.925601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:04.925601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:04.925601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:04.925601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:04.925601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:04.925601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:04.925601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:04.925601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:04.925601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 14:09:04.925601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:04.925601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 263/521] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:04 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:04.925601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ae6a2-3488-4385-b7ab-89287002a2f1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:04.954184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:04.984713 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45cb55a-80e6-4578-bed1-72786ea27e7d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:05.023712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e6405-8d58-46fe-90a0-531955ca699a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:05.024327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e6405-8d58-46fe-90a0-531955ca699a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:05.024608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e6405-8d58-46fe-90a0-531955ca699a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:05.024879 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1e6405-8d58-46fe-90a0-531955ca699a None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:05.025570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e6405-8d58-46fe-90a0-531955ca699a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:05.025870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e6405-8d58-46fe-90a0-531955ca699a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:05.027293 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb1e6405-8d58-46fe-90a0-531955ca699a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:05.044706 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 259/522] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:05.044706 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e6405-8d58-46fe-90a0-531955ca699a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:05.057483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9ae6a2-3488-4385-b7ab-89287002a2f1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:05.096607 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc82f49-c1bf-4286-aa91-00cbfa3c2d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:05.097220 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc82f49-c1bf-4286-aa91-00cbfa3c2d3d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:05.097492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc82f49-c1bf-4286-aa91-00cbfa3c2d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:05.097758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc82f49-c1bf-4286-aa91-00cbfa3c2d3d None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:05.098538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc82f49-c1bf-4286-aa91-00cbfa3c2d3d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:05.098869 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc82f49-c1bf-4286-aa91-00cbfa3c2d3d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:05.100325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc82f49-c1bf-4286-aa91-00cbfa3c2d3d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:05.119278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 264/523] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Aug 1 14:09:04 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:05.120174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc82f49-c1bf-4286-aa91-00cbfa3c2d3d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:05.152783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:05.160660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1e6405-8d58-46fe-90a0-531955ca699a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:05.199088 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc973b-39b5-4737-b3ce-15ce6b64e969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:05.199707 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc973b-39b5-4737-b3ce-15ce6b64e969 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:05.199989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc973b-39b5-4737-b3ce-15ce6b64e969 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:05.200255 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebc973b-39b5-4737-b3ce-15ce6b64e969 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:05.201077 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc973b-39b5-4737-b3ce-15ce6b64e969 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:05.201298 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc973b-39b5-4737-b3ce-15ce6b64e969 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:05.202844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebc973b-39b5-4737-b3ce-15ce6b64e969 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:05.214801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:05.226688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 260/524] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:05.226688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc973b-39b5-4737-b3ce-15ce6b64e969 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:05.248004 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc82f49-c1bf-4286-aa91-00cbfa3c2d3d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:05.284004 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e71ae-f0c5-4397-a53c-1fcee0f2b5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:05.284623 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e71ae-f0c5-4397-a53c-1fcee0f2b5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:05.284905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e71ae-f0c5-4397-a53c-1fcee0f2b5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:05.285179 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e71ae-f0c5-4397-a53c-1fcee0f2b5c1 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:05.285978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e71ae-f0c5-4397-a53c-1fcee0f2b5c1 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:05.286284 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e71ae-f0c5-4397-a53c-1fcee0f2b5c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:05.287768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565e71ae-f0c5-4397-a53c-1fcee0f2b5c1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:05.310394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 265/525] 10.222.0.70 () {56 vars in 1139 bytes} [Mon Aug 1 14:09:05 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:05.310394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e71ae-f0c5-4397-a53c-1fcee0f2b5c1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:05.344852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebc973b-39b5-4737-b3ce-15ce6b64e969 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c8dfd-6a29-46a5-995f-a354754791d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:05.383365 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c8dfd-6a29-46a5-995f-a354754791d9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:05.383647 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c8dfd-6a29-46a5-995f-a354754791d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:05.383919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662c8dfd-6a29-46a5-995f-a354754791d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:05.391846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c8dfd-6a29-46a5-995f-a354754791d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:05.393320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662c8dfd-6a29-46a5-995f-a354754791d9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:05.404733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-662c8dfd-6a29-46a5-995f-a354754791d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:05.404733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:05.404733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:05.404733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:05.404733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:05.404733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:05.404733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:05.404733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:05.404733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:05.404733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:05.404733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:05.404733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:05.404733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:05.404733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:05.404733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:05.405772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:05.406740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:05.406740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:05.406740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:05.406740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:05.406740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:05.406740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:05.406740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:05.406740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:05.406740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 261/526] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:05.407217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c8dfd-6a29-46a5-995f-a354754791d9 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:05.420660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e71ae-f0c5-4397-a53c-1fcee0f2b5c1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:05.426207 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:05.460307 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26de7-3d91-444d-851d-4e104829308f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:05.460922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26de7-3d91-444d-851d-4e104829308f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:05.461199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26de7-3d91-444d-851d-4e104829308f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:05.461469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c26de7-3d91-444d-851d-4e104829308f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:05.464406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:05.522344 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662c8dfd-6a29-46a5-995f-a354754791d9 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:05.534346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c26de7-3d91-444d-851d-4e104829308f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:05.535818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c26de7-3d91-444d-851d-4e104829308f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:05.557550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221d6cc-a317-4a63-80c2-e1bdb90bf202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:05.558154 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221d6cc-a317-4a63-80c2-e1bdb90bf202 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:05.558428 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221d6cc-a317-4a63-80c2-e1bdb90bf202 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:05.558737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a221d6cc-a317-4a63-80c2-e1bdb90bf202 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:05.559516 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221d6cc-a317-4a63-80c2-e1bdb90bf202 None admin] RBAC: Adding query filter params (role.id=7db30e557e5b4d789838af5eb5985bf5, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=e856fd5aff914cfb8b8dd86b39c89bd0) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:05.559815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221d6cc-a317-4a63-80c2-e1bdb90bf202 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:05.561253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a221d6cc-a317-4a63-80c2-e1bdb90bf202 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:05.574621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 262/527] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:05 2022] GET /identity/v3/role_assignments?user.id=e856fd5aff914cfb8b8dd86b39c89bd0&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=7db30e557e5b4d789838af5eb5985bf5 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:05.574621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221d6cc-a317-4a63-80c2-e1bdb90bf202 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:05.664018 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 266/528] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:05.665149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26de7-3d91-444d-851d-4e104829308f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:05.682799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:05.709030 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:05.721190 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a221d6cc-a317-4a63-80c2-e1bdb90bf202 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:05.765204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871cb8d-f913-4365-948a-9906ff019084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:05.765817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871cb8d-f913-4365-948a-9906ff019084 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:05.766092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871cb8d-f913-4365-948a-9906ff019084 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:05.766360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871cb8d-f913-4365-948a-9906ff019084 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:05.797555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c26de7-3d91-444d-851d-4e104829308f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:05.833495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f26736-020f-4f89-b376-af5c7a953c33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:05.834787 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f26736-020f-4f89-b376-af5c7a953c33 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:05.835064 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f26736-020f-4f89-b376-af5c7a953c33 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:05.835332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f26736-020f-4f89-b376-af5c7a953c33 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:05.836076 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f26736-020f-4f89-b376-af5c7a953c33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:05.836373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f26736-020f-4f89-b376-af5c7a953c33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:05.838127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f26736-020f-4f89-b376-af5c7a953c33 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:05.850852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871cb8d-f913-4365-948a-9906ff019084 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:05.852456 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6871cb8d-f913-4365-948a-9906ff019084 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:05.862434 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 267/529] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:05.863365 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f26736-020f-4f89-b376-af5c7a953c33 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:05.936244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:05.961090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 263/530] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:05.962084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871cb8d-f913-4365-948a-9906ff019084 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:06.001867 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:06.012858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f26736-020f-4f89-b376-af5c7a953c33 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:06.060668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44492164-d34c-4060-ae82-0623bfeb3882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:06.061371 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44492164-d34c-4060-ae82-0623bfeb3882 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:06.061902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44492164-d34c-4060-ae82-0623bfeb3882 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:06.062184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44492164-d34c-4060-ae82-0623bfeb3882 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:06.078397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44492164-d34c-4060-ae82-0623bfeb3882 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:06.078959 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6871cb8d-f913-4365-948a-9906ff019084 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:06.079892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44492164-d34c-4060-ae82-0623bfeb3882 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:06.099099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-44492164-d34c-4060-ae82-0623bfeb3882 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:06.099099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:06.099099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:06.099099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:06.099099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:06.099099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:06.099099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:06.099099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:06.099099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:06.099099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:06.099099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:06.099099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:06.099099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:06.099099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:06.099099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:06.101746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:06.103855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:06.103855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:06.103855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:06.103855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:06.110623 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 268/531] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:06.110623 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44492164-d34c-4060-ae82-0623bfeb3882 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:06.119671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70f0d5-3077-4c2a-8fd0-919547266ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:06.120555 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70f0d5-3077-4c2a-8fd0-919547266ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:06.121384 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70f0d5-3077-4c2a-8fd0-919547266ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:06.121833 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e70f0d5-3077-4c2a-8fd0-919547266ac0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:06.122812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70f0d5-3077-4c2a-8fd0-919547266ac0 None admin] RBAC: Adding query filter params (role.id=7db30e557e5b4d789838af5eb5985bf5, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=bcc213ef64924074bd16152228913ef1) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:06.123637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70f0d5-3077-4c2a-8fd0-919547266ac0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:06.126546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e70f0d5-3077-4c2a-8fd0-919547266ac0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:06.134856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 264/532] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:05 2022] GET /identity/v3/role_assignments?user.id=bcc213ef64924074bd16152228913ef1&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=7db30e557e5b4d789838af5eb5985bf5 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:06.135856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70f0d5-3077-4c2a-8fd0-919547266ac0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:06.224384 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:06.258569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44492164-d34c-4060-ae82-0623bfeb3882 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:06.297799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b99e4-2c74-4d7a-98b1-fa2bc7f09477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:06.298954 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b99e4-2c74-4d7a-98b1-fa2bc7f09477 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:06.299436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b99e4-2c74-4d7a-98b1-fa2bc7f09477 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:06.299928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340b99e4-2c74-4d7a-98b1-fa2bc7f09477 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:06.301580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e70f0d5-3077-4c2a-8fd0-919547266ac0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:06.313440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b99e4-2c74-4d7a-98b1-fa2bc7f09477 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:06.315476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-340b99e4-2c74-4d7a-98b1-fa2bc7f09477 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:06.335775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-340b99e4-2c74-4d7a-98b1-fa2bc7f09477 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:06.335775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:06.335775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:06.335775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:06.335775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:06.335775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:06.335775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:06.335775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:06.335775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:06.335775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:06.335775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:06.335775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:06.335775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:06.335775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:06.335775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:06.336729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:06.337549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:06.337549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:06.337549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:06.337549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:06.340307 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:06.340799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 269/533] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:06.347009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b99e4-2c74-4d7a-98b1-fa2bc7f09477 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:06.366279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676eee6-c1d1-42e4-8bdb-6ae211d15424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:06.367647 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676eee6-c1d1-42e4-8bdb-6ae211d15424 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:06.368232 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676eee6-c1d1-42e4-8bdb-6ae211d15424 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:06.368701 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f676eee6-c1d1-42e4-8bdb-6ae211d15424 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:06.369647 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676eee6-c1d1-42e4-8bdb-6ae211d15424 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:06.370165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676eee6-c1d1-42e4-8bdb-6ae211d15424 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:06.373880 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f676eee6-c1d1-42e4-8bdb-6ae211d15424 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:06.390143 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 265/534] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:06.395471 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676eee6-c1d1-42e4-8bdb-6ae211d15424 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:06.488638 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340b99e4-2c74-4d7a-98b1-fa2bc7f09477 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:06.557899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a1b62-eb10-4d29-87dc-264f2c6c4a40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:06.558550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a1b62-eb10-4d29-87dc-264f2c6c4a40 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:06.558848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a1b62-eb10-4d29-87dc-264f2c6c4a40 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:06.562599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1a1b62-eb10-4d29-87dc-264f2c6c4a40 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:06.562599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a1b62-eb10-4d29-87dc-264f2c6c4a40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:06.562599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a1b62-eb10-4d29-87dc-264f2c6c4a40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:06.562599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1a1b62-eb10-4d29-87dc-264f2c6c4a40 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:06.586230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 270/535] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:06.591995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a1b62-eb10-4d29-87dc-264f2c6c4a40 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:06.594744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f676eee6-c1d1-42e4-8bdb-6ae211d15424 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:06.598563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:06.668886 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19525-f5e8-4224-9987-f9e1ddda9091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:06.669548 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19525-f5e8-4224-9987-f9e1ddda9091 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:06.669826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19525-f5e8-4224-9987-f9e1ddda9091 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:06.670094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf19525-f5e8-4224-9987-f9e1ddda9091 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:06.683433 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf19525-f5e8-4224-9987-f9e1ddda9091 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:06.687566 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf19525-f5e8-4224-9987-f9e1ddda9091 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:06.709458 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:06.716011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-2bf19525-f5e8-4224-9987-f9e1ddda9091 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:06.716011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:06.716011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:06.716011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:06.716011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:06.716011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:06.716011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:06.716011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:06.716011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:06.716011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:06.716011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:06.716011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:06.716011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:06.716011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:06.716011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:06.716851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:06.717694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:06.717694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:06.717694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:06.717694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:06.717694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:06.717694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:06.717694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:06.717694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:06.720778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 266/536] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:06.723584 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19525-f5e8-4224-9987-f9e1ddda9091 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:06.769213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1a1b62-eb10-4d29-87dc-264f2c6c4a40 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:06.859288 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6866d1a9-3d3b-4b49-b58a-ce7bd69c8d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:06.859956 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866d1a9-3d3b-4b49-b58a-ce7bd69c8d87 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:06.860235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866d1a9-3d3b-4b49-b58a-ce7bd69c8d87 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:06.860507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6866d1a9-3d3b-4b49-b58a-ce7bd69c8d87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:06.864126 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf19525-f5e8-4224-9987-f9e1ddda9091 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:06.891407 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866d1a9-3d3b-4b49-b58a-ce7bd69c8d87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:06.892890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6866d1a9-3d3b-4b49-b58a-ce7bd69c8d87 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:06.900752 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac25939-76f9-4cfe-a42a-4cb287a4c48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:06.901665 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac25939-76f9-4cfe-a42a-4cb287a4c48a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:06.902154 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac25939-76f9-4cfe-a42a-4cb287a4c48a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:06.902666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac25939-76f9-4cfe-a42a-4cb287a4c48a None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:06.903645 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac25939-76f9-4cfe-a42a-4cb287a4c48a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:06.904148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac25939-76f9-4cfe-a42a-4cb287a4c48a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:06.905765 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac25939-76f9-4cfe-a42a-4cb287a4c48a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:06.916394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6866d1a9-3d3b-4b49-b58a-ce7bd69c8d87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:06.916394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:06.916394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:06.916394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:06.916394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:06.916394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:06.916394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:06.916394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:06.916394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:06.916394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:06.916394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:06.916394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:06.916394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:06.916394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:06.916394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:06.917255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:06.918172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:06.918172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:06.918172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:06.918172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:06.918172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:06.918172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:06.918172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:06.918172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:06.920719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 267/537] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:06.922710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 271/538] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:06.928486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac25939-76f9-4cfe-a42a-4cb287a4c48a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:06.930056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d19107-0756-4d7e-98ef-dc30d5733cd3 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:06.930546 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d19107-0756-4d7e-98ef-dc30d5733cd3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:06.931037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d19107-0756-4d7e-98ef-dc30d5733cd3 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:06.932847 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 272/539] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:06.934621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d19107-0756-4d7e-98ef-dc30d5733cd3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:06.964112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:07.051459 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac25939-76f9-4cfe-a42a-4cb287a4c48a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:07.052125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d19107-0756-4d7e-98ef-dc30d5733cd3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:07.070419 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:07.088616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee69803-d616-40ed-9e87-8f8fb79451c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:07.089386 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46aed50-8474-404e-9fe2-678ad90cdbe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:07.089667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee69803-d616-40ed-9e87-8f8fb79451c4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:07.090082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee69803-d616-40ed-9e87-8f8fb79451c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:07.090213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aed50-8474-404e-9fe2-678ad90cdbe9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:07.090444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aed50-8474-404e-9fe2-678ad90cdbe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:07.090764 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46aed50-8474-404e-9fe2-678ad90cdbe9 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:07.090899 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee69803-d616-40ed-9e87-8f8fb79451c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:07.091511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46aed50-8474-404e-9fe2-678ad90cdbe9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:07.091813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46aed50-8474-404e-9fe2-678ad90cdbe9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:07.092112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee69803-d616-40ed-9e87-8f8fb79451c4 None admin] RBAC: Adding query filter params (role.id=7db30e557e5b4d789838af5eb5985bf5, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=a41da5d6d38341deaf1563fe0ebac32b) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:07.092550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee69803-d616-40ed-9e87-8f8fb79451c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:07.093310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46aed50-8474-404e-9fe2-678ad90cdbe9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:07.094244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee69803-d616-40ed-9e87-8f8fb79451c4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:07.106786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 268/541] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:06 2022] GET /identity/v3/role_assignments?user.id=a41da5d6d38341deaf1563fe0ebac32b&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=7db30e557e5b4d789838af5eb5985bf5 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:07.108576 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc33433-4a5d-438a-8922-f7c45aa4eb9b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:07.109015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc33433-4a5d-438a-8922-f7c45aa4eb9b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:07.109428 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc33433-4a5d-438a-8922-f7c45aa4eb9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:07.110673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 273/541] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:07.112363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46aed50-8474-404e-9fe2-678ad90cdbe9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:07.157382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9bc33433-4a5d-438a-8922-f7c45aa4eb9b None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:07.158634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9bc33433-4a5d-438a-8922-f7c45aa4eb9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:07.264521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46aed50-8474-404e-9fe2-678ad90cdbe9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:07.300993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abd29a-459a-48db-8f21-44b656d82cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:07.301667 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abd29a-459a-48db-8f21-44b656d82cab None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:07.301886 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abd29a-459a-48db-8f21-44b656d82cab None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:07.302155 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42abd29a-459a-48db-8f21-44b656d82cab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:07.303535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abd29a-459a-48db-8f21-44b656d82cab None admin] RBAC: Adding query filter params (role.id=7db30e557e5b4d789838af5eb5985bf5, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=33fcc673845943fc96bc18f011639716) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:07.303839 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abd29a-459a-48db-8f21-44b656d82cab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:07.305299 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42abd29a-459a-48db-8f21-44b656d82cab None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:07.311329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 274/542] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:07 2022] GET /identity/v3/role_assignments?user.id=33fcc673845943fc96bc18f011639716&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=7db30e557e5b4d789838af5eb5985bf5 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:07.317298 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 269/543] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:07.357150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abd29a-459a-48db-8f21-44b656d82cab None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:07.417930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:07.503912 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42abd29a-459a-48db-8f21-44b656d82cab None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:07.560323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c868cfd-007a-4f7c-aa9b-91b568a0d43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:07.560946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c868cfd-007a-4f7c-aa9b-91b568a0d43a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:07.561181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c868cfd-007a-4f7c-aa9b-91b568a0d43a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:07.561456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c868cfd-007a-4f7c-aa9b-91b568a0d43a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:07.574855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c868cfd-007a-4f7c-aa9b-91b568a0d43a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-7c868cfd-007a-4f7c-aa9b-91b568a0d43a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:07.580190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:07.581215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:07.582007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:07.582007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:07.582007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:07.582007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:07.582007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:07.582007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:07.582007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:07.582007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:07.582007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:07.582007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:07.582007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:07.582007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:07.582007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 275/544] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:07.588947 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc33433-4a5d-438a-8922-f7c45aa4eb9b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:07.621000 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:07.727547 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc33433-4a5d-438a-8922-f7c45aa4eb9b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:07.763440 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166de20-d0fd-417e-b061-8414c836352b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:07.764358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166de20-d0fd-417e-b061-8414c836352b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:07.764839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166de20-d0fd-417e-b061-8414c836352b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:07.765282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166de20-d0fd-417e-b061-8414c836352b None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:07.766162 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166de20-d0fd-417e-b061-8414c836352b None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:07.766677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166de20-d0fd-417e-b061-8414c836352b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:07.768474 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166de20-d0fd-417e-b061-8414c836352b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:07.777461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 270/545] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:07.783654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c868cfd-007a-4f7c-aa9b-91b568a0d43a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:07.812217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd8158-4a3b-4a42-a044-8a1451c58e0f None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:07.812468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd8158-4a3b-4a42-a044-8a1451c58e0f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:07.812794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decd8158-4a3b-4a42-a044-8a1451c58e0f None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:07.814144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 271/546] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:07.819166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107c8ed-9531-4a91-adcc-8c58e333e910 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:07.819452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107c8ed-9531-4a91-adcc-8c58e333e910 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:07.819733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107c8ed-9531-4a91-adcc-8c58e333e910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:07.846590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-6107c8ed-9531-4a91-adcc-8c58e333e910 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:07.847899 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6107c8ed-9531-4a91-adcc-8c58e333e910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:07.955583 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 272/547] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:09:07.956127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c868cfd-007a-4f7c-aa9b-91b568a0d43a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:07.958080 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:07.986823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107c8ed-9531-4a91-adcc-8c58e333e910 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:08.003299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:08.029302 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39200259-e950-4727-8ba2-67fd90f38fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:08.029965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39200259-e950-4727-8ba2-67fd90f38fda None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:08.030245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39200259-e950-4727-8ba2-67fd90f38fda None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:08.030514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39200259-e950-4727-8ba2-67fd90f38fda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:08.052591 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39200259-e950-4727-8ba2-67fd90f38fda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:08.054062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39200259-e950-4727-8ba2-67fd90f38fda None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:08.079132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-39200259-e950-4727-8ba2-67fd90f38fda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:08.079132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:08.079132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:08.079132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:08.079132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:08.079132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:08.079132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:08.079132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:08.079132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:08.079132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:08.079132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:08.079132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:08.079132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:08.079132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:08.079132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:08.080003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:08.080837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:08.080837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:08.080837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:08.080837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:08.083053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 276/548] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:08.091497 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39200259-e950-4727-8ba2-67fd90f38fda None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:08.119769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6107c8ed-9531-4a91-adcc-8c58e333e910 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:08.205888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39200259-e950-4727-8ba2-67fd90f38fda None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:08.231917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a894a-1af5-4792-8d9b-827d8c2d4591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:08.232597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a894a-1af5-4792-8d9b-827d8c2d4591 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:08.232859 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a894a-1af5-4792-8d9b-827d8c2d4591 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:08.233120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5a894a-1af5-4792-8d9b-827d8c2d4591 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:08.242777 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f83e1b-ed96-4935-b254-ee58f78dcb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:08.243559 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f83e1b-ed96-4935-b254-ee58f78dcb50 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:08.243976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f83e1b-ed96-4935-b254-ee58f78dcb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:08.244380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f83e1b-ed96-4935-b254-ee58f78dcb50 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:08.245197 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f83e1b-ed96-4935-b254-ee58f78dcb50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:08.245655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f83e1b-ed96-4935-b254-ee58f78dcb50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:08.247178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f83e1b-ed96-4935-b254-ee58f78dcb50 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:08.259809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5a894a-1af5-4792-8d9b-827d8c2d4591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:08.260201 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 277/549] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-0e5a894a-1af5-4792-8d9b-827d8c2d4591 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:08.266551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:08.267639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:08.269264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:08.269264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:08.269264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:08.269264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:08.269264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:08.269264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:08.269264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:08.269264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:08.269264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:08.269264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:08.269264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:08.269264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:08.271630 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f83e1b-ed96-4935-b254-ee58f78dcb50 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:08.278567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 273/550] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:08.279620 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a894a-1af5-4792-8d9b-827d8c2d4591 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:08.302960 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:08.423021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:08.470946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f83e1b-ed96-4935-b254-ee58f78dcb50 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:08.490815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5a894a-1af5-4792-8d9b-827d8c2d4591 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:08.546234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52519b-bdcb-4664-b1df-65bc98bbd756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:08.546962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52519b-bdcb-4664-b1df-65bc98bbd756 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:08.547249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52519b-bdcb-4664-b1df-65bc98bbd756 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:08.547523 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de52519b-bdcb-4664-b1df-65bc98bbd756 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:08.558633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52519b-bdcb-4664-b1df-65bc98bbd756 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:08.560086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de52519b-bdcb-4664-b1df-65bc98bbd756 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:08.562872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29b12f5-361f-4038-a2b3-ccd73f270aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:08.563496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b12f5-361f-4038-a2b3-ccd73f270aa5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:08.563773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b12f5-361f-4038-a2b3-ccd73f270aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:08.564044 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29b12f5-361f-4038-a2b3-ccd73f270aa5 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:08.564819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b12f5-361f-4038-a2b3-ccd73f270aa5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:08.565125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b12f5-361f-4038-a2b3-ccd73f270aa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:08.566508 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29b12f5-361f-4038-a2b3-ccd73f270aa5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-de52519b-bdcb-4664-b1df-65bc98bbd756 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:08.585436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:08.586716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:08.588037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:08.588037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:08.588037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:08.588037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:08.588037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:08.588037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:08.588037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:08.588037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:08.588037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:09:08.588037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:08.588037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 278/551] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:09:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:08.590625 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 274/552] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:08.596719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52519b-bdcb-4664-b1df-65bc98bbd756 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:08.597563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d7bbe-3ff1-4444-a184-6c02be3491b8 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:08.597851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d7bbe-3ff1-4444-a184-6c02be3491b8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:08.598125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5d7bbe-3ff1-4444-a184-6c02be3491b8 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:08.599710 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 275/553] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:09:08.600395 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d7bbe-3ff1-4444-a184-6c02be3491b8 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:08.697713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:08.726786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5d7bbe-3ff1-4444-a184-6c02be3491b8 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:08.735835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de52519b-bdcb-4664-b1df-65bc98bbd756 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:08.767527 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:08.774050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86692447-8bba-45ee-8853-15255e4d176d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:08.775036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86692447-8bba-45ee-8853-15255e4d176d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:08.775163 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a18d752-7a57-4c5b-a319-371d36b0aa53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:08.775408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86692447-8bba-45ee-8853-15255e4d176d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:08.775664 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18d752-7a57-4c5b-a319-371d36b0aa53 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:08.775778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86692447-8bba-45ee-8853-15255e4d176d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:08.776059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18d752-7a57-4c5b-a319-371d36b0aa53 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:08.776334 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a18d752-7a57-4c5b-a319-371d36b0aa53 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:08.777123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18d752-7a57-4c5b-a319-371d36b0aa53 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:08.777423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18d752-7a57-4c5b-a319-371d36b0aa53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:08.779226 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a18d752-7a57-4c5b-a319-371d36b0aa53 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:08.791069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86692447-8bba-45ee-8853-15255e4d176d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:08.792393 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86692447-8bba-45ee-8853-15255e4d176d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:08.804285 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 276/554] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Aug 1 14:09:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:08.805552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9270-1f6a-454c-a80d-7b684c8b8b11 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:08.805836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9270-1f6a-454c-a80d-7b684c8b8b11 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:08.806102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4f9270-1f6a-454c-a80d-7b684c8b8b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:08.808885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-86692447-8bba-45ee-8853-15255e4d176d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:08.808885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:08.808885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:08.808885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:08.808885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:08.808885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:08.808885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:08.808885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:08.808885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:08.808885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:08.808885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:08.808885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:08.808885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:08.808885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:08.808885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:08.809824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:08.810749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:08.810749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:08.810749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:08.810749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:08.814875 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 279/555] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:08.815643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86692447-8bba-45ee-8853-15255e4d176d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:08.831874 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-3c4f9270-1f6a-454c-a80d-7b684c8b8b11 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:08.833852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3c4f9270-1f6a-454c-a80d-7b684c8b8b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:08.923221 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86692447-8bba-45ee-8853-15255e4d176d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:08.927881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 277/556] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:08.928731 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f9270-1f6a-454c-a80d-7b684c8b8b11 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:08.970655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:08.986733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67785cfb-fed4-4ca6-92fd-6f2b6977e435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:08.987359 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67785cfb-fed4-4ca6-92fd-6f2b6977e435 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:08.987630 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67785cfb-fed4-4ca6-92fd-6f2b6977e435 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:08.987896 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67785cfb-fed4-4ca6-92fd-6f2b6977e435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:09.054000 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4f9270-1f6a-454c-a80d-7b684c8b8b11 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:09.060291 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67785cfb-fed4-4ca6-92fd-6f2b6977e435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:09.061757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67785cfb-fed4-4ca6-92fd-6f2b6977e435 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:09.073438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:09.093005 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88635827-65dd-442c-a193-7f6230322d02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:09.093906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88635827-65dd-442c-a193-7f6230322d02 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:09.094325 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88635827-65dd-442c-a193-7f6230322d02 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:09.094793 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88635827-65dd-442c-a193-7f6230322d02 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:09.095616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88635827-65dd-442c-a193-7f6230322d02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:09.096146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88635827-65dd-442c-a193-7f6230322d02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:09.097789 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88635827-65dd-442c-a193-7f6230322d02 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:09.115300 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 278/557] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:09.116355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88635827-65dd-442c-a193-7f6230322d02 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:09.169489 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 280/558] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:09.170357 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67785cfb-fed4-4ca6-92fd-6f2b6977e435 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:09.198173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:09.232282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88635827-65dd-442c-a193-7f6230322d02 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:09.268866 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733b726-7ba8-4b46-b7f6-af0806859cba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:09.269786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733b726-7ba8-4b46-b7f6-af0806859cba None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:09.270209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733b726-7ba8-4b46-b7f6-af0806859cba None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:09.270646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6733b726-7ba8-4b46-b7f6-af0806859cba None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:09.277876 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67785cfb-fed4-4ca6-92fd-6f2b6977e435 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:09.281950 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6733b726-7ba8-4b46-b7f6-af0806859cba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-6733b726-7ba8-4b46-b7f6-af0806859cba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:09.288110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:09.289675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:09.290619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:09.290619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:09.290619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:09.290619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:09.290619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:09.290619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:09.290619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:09.290619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:09.290619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:09.290619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:09.290619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:09.290619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:09.292885 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 279/559] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:09.293824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733b726-7ba8-4b46-b7f6-af0806859cba None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:09.323866 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890abe-5dd3-49de-8b0e-55b26f06936a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:09.324507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890abe-5dd3-49de-8b0e-55b26f06936a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:09.324784 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890abe-5dd3-49de-8b0e-55b26f06936a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:09.325284 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c890abe-5dd3-49de-8b0e-55b26f06936a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:09.332988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c890abe-5dd3-49de-8b0e-55b26f06936a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:09.334154 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c890abe-5dd3-49de-8b0e-55b26f06936a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:09.338189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0c890abe-5dd3-49de-8b0e-55b26f06936a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:09.348072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:09.349831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:09.350772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:09.350772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:09.350772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:09.350772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:09.350772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:09.350772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:09.350772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:09.350772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:09.350772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:09:09.350772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:09.350772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 281/560] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 1 14:09:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:09.351372 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890abe-5dd3-49de-8b0e-55b26f06936a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:09.417449 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6733b726-7ba8-4b46-b7f6-af0806859cba None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:09.447234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:09.452615 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f618a-6bf8-4897-9480-8759c47c90a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:09.453252 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f618a-6bf8-4897-9480-8759c47c90a0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:09.453529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f618a-6bf8-4897-9480-8759c47c90a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:09.453796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4f618a-6bf8-4897-9480-8759c47c90a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:09.463796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c890abe-5dd3-49de-8b0e-55b26f06936a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:09.464972 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f618a-6bf8-4897-9480-8759c47c90a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:09.466430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4f618a-6bf8-4897-9480-8759c47c90a0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:09.481277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-1f4f618a-6bf8-4897-9480-8759c47c90a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:09.481277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:09.481277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:09.481277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:09.481277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:09.481277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:09.481277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:09.481277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:09.481277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:09.481277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:09.481277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:09.481277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:09.481277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:09.481277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:09.481277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:09.482174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:09.483234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:09.483234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:09.483234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:09.483234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:09.483234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 280/561] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:09.483234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f618a-6bf8-4897-9480-8759c47c90a0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:09.507615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500c9663-80f2-4af7-bf88-04ddca165a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:09.508316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c9663-80f2-4af7-bf88-04ddca165a16 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:09.508602 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c9663-80f2-4af7-bf88-04ddca165a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:09.508914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500c9663-80f2-4af7-bf88-04ddca165a16 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:09.510194 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c9663-80f2-4af7-bf88-04ddca165a16 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:09.510550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c9663-80f2-4af7-bf88-04ddca165a16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:09.512161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500c9663-80f2-4af7-bf88-04ddca165a16 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:09.522411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 282/562] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:09.523533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09725131-3ee3-40ff-ac6b-7a9e89fd7d02 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:09.523818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09725131-3ee3-40ff-ac6b-7a9e89fd7d02 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:09.524090 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09725131-3ee3-40ff-ac6b-7a9e89fd7d02 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:09.529656 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 283/563] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:09.529656 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09725131-3ee3-40ff-ac6b-7a9e89fd7d02 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:09.587023 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:09.601153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4f618a-6bf8-4897-9480-8759c47c90a0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:09.637568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141465f-1e22-4177-8a66-eeab7cf08ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:09.638189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141465f-1e22-4177-8a66-eeab7cf08ebb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:09.638464 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141465f-1e22-4177-8a66-eeab7cf08ebb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:09.638775 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3141465f-1e22-4177-8a66-eeab7cf08ebb None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:09.639567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141465f-1e22-4177-8a66-eeab7cf08ebb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:09.639869 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141465f-1e22-4177-8a66-eeab7cf08ebb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:09.641346 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3141465f-1e22-4177-8a66-eeab7cf08ebb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:09.642773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09725131-3ee3-40ff-ac6b-7a9e89fd7d02 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:09.659464 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 281/564] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 1 14:09:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:09.660294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141465f-1e22-4177-8a66-eeab7cf08ebb None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:09.686055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f20feb-bec4-4c5a-9791-ea37dd7e91be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:09.687114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f20feb-bec4-4c5a-9791-ea37dd7e91be None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:09.687618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f20feb-bec4-4c5a-9791-ea37dd7e91be None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:09.688093 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f20feb-bec4-4c5a-9791-ea37dd7e91be None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:09.688964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f20feb-bec4-4c5a-9791-ea37dd7e91be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:09.689471 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f20feb-bec4-4c5a-9791-ea37dd7e91be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:09.691110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f20feb-bec4-4c5a-9791-ea37dd7e91be None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:09.704607 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 284/565] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:09.706492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069484be-73ab-4e98-bcff-ebb7dc2b22bf None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:09.706984 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069484be-73ab-4e98-bcff-ebb7dc2b22bf None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:09.707827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069484be-73ab-4e98-bcff-ebb7dc2b22bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:09.728476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-069484be-73ab-4e98-bcff-ebb7dc2b22bf None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:09.729970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-069484be-73ab-4e98-bcff-ebb7dc2b22bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:09.732346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:09.772979 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3141465f-1e22-4177-8a66-eeab7cf08ebb None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:09.798421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 285/566] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:09.799285 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069484be-73ab-4e98-bcff-ebb7dc2b22bf None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:09.819302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94355f-982f-4704-a022-cb3a065fb916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:09.819947 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94355f-982f-4704-a022-cb3a065fb916 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:09.820223 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94355f-982f-4704-a022-cb3a065fb916 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:09.820493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94355f-982f-4704-a022-cb3a065fb916 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:09.830901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94355f-982f-4704-a022-cb3a065fb916 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:09.832536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94355f-982f-4704-a022-cb3a065fb916 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:09.842443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:09.850024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-de94355f-982f-4704-a022-cb3a065fb916 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:09.850024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:09.850024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:09.850024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:09.850024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:09.850024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:09.850024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:09.850024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:09.850024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:09.850024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:09.850024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:09.850024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:09.850024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:09.850024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:09.850024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:09.850944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:09.851830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:09.851830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:09.851830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:09.851830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:09.851830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 282/567] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:09.852515 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94355f-982f-4704-a022-cb3a065fb916 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:09.901190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069484be-73ab-4e98-bcff-ebb7dc2b22bf None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:09.934037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfb7a50-8981-422f-a7c4-91dc56319925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:09.934861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb7a50-8981-422f-a7c4-91dc56319925 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:09.935139 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb7a50-8981-422f-a7c4-91dc56319925 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:09.935405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfb7a50-8981-422f-a7c4-91dc56319925 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:09.941838 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:09.947209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb7a50-8981-422f-a7c4-91dc56319925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:09.948638 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfb7a50-8981-422f-a7c4-91dc56319925 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:09.951118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94355f-982f-4704-a022-cb3a065fb916 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:09.963749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0bfb7a50-8981-422f-a7c4-91dc56319925 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:09.963749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:09.963749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:09.963749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:09.963749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:09.963749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:09.963749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:09.963749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:09.963749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:09.963749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:09.963749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:09.963749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:09.963749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:09.963749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:09.963749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:09.964629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:09.965576 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:09.965576 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:09.965576 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:09.965576 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:09.965576 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 286/568] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:09.966310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c49b8-26ab-47b9-84a2-2257b6cbc045 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:09.966607 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c49b8-26ab-47b9-84a2-2257b6cbc045 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:09.966875 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c49b8-26ab-47b9-84a2-2257b6cbc045 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:09.968084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 287/569] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:09.972181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c49b8-26ab-47b9-84a2-2257b6cbc045 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:09.991031 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659c911-f705-4cf8-aa91-69462e3d3fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:09.991665 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659c911-f705-4cf8-aa91-69462e3d3fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:09.991952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659c911-f705-4cf8-aa91-69462e3d3fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:09.992209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f659c911-f705-4cf8-aa91-69462e3d3fd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:09.999802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659c911-f705-4cf8-aa91-69462e3d3fd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:10.000971 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f659c911-f705-4cf8-aa91-69462e3d3fd7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:10.012660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-f659c911-f705-4cf8-aa91-69462e3d3fd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:10.012660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:10.012660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:10.012660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:10.012660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:10.012660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:10.012660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:10.012660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:10.012660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:10.012660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:10.012660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:10.012660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:10.012660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:10.012660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:10.012660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:10.013741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:10.014677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:10.014677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:10.014677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:10.014677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:10.014677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:10.014677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:10.014677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:10.014677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:10.014677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 283/570] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:10.014677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659c911-f705-4cf8-aa91-69462e3d3fd7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:10.077019 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c49b8-26ab-47b9-84a2-2257b6cbc045 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:10.077305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:10.111059 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a039e-4ba2-4b60-b9b4-9ab4c4282ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:10.111695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a039e-4ba2-4b60-b9b4-9ab4c4282ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:10.111974 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a039e-4ba2-4b60-b9b4-9ab4c4282ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:10.112248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a039e-4ba2-4b60-b9b4-9ab4c4282ae0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:10.118907 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f659c911-f705-4cf8-aa91-69462e3d3fd7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:10.122322 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a039e-4ba2-4b60-b9b4-9ab4c4282ae0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6a1a039e-4ba2-4b60-b9b4-9ab4c4282ae0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:10.127853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:10.128932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:10.129930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:10.129930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:10.129930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:10.129930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:10.129930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:10.129930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:10.129930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:10.129930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:10.129930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:10.129930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:10.129930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:10.129930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:10.129930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 288/571] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:10.129930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a039e-4ba2-4b60-b9b4-9ab4c4282ae0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:10.157819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ccba1-e7a0-4b10-8bdd-454d514b8c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:10.158442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ccba1-e7a0-4b10-8bdd-454d514b8c4a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:10.158751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ccba1-e7a0-4b10-8bdd-454d514b8c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:10.159025 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ccba1-e7a0-4b10-8bdd-454d514b8c4a None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:10.159711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ccba1-e7a0-4b10-8bdd-454d514b8c4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:10.160011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ccba1-e7a0-4b10-8bdd-454d514b8c4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:10.161388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ccba1-e7a0-4b10-8bdd-454d514b8c4a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:10.173061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 284/572] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:10.174269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250993c-d9e4-41ce-b3d5-bf98bea18bd0 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:10.174557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250993c-d9e4-41ce-b3d5-bf98bea18bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:10.174861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7250993c-d9e4-41ce-b3d5-bf98bea18bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:10.184206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:10.191788 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7250993c-d9e4-41ce-b3d5-bf98bea18bd0 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:10.193496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7250993c-d9e4-41ce-b3d5-bf98bea18bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:10.235808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a039e-4ba2-4b60-b9b4-9ab4c4282ae0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:10.260504 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 285/573] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:10.261320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250993c-d9e4-41ce-b3d5-bf98bea18bd0 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:10.270829 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bb678-4fe5-4aa7-91fc-7b9c0b865ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:10.271510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bb678-4fe5-4aa7-91fc-7b9c0b865ba2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:10.271856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bb678-4fe5-4aa7-91fc-7b9c0b865ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:10.272231 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bb678-4fe5-4aa7-91fc-7b9c0b865ba2 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:10.272919 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bb678-4fe5-4aa7-91fc-7b9c0b865ba2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:10.273223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bb678-4fe5-4aa7-91fc-7b9c0b865ba2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:10.274609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bb678-4fe5-4aa7-91fc-7b9c0b865ba2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:10.286389 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 289/574] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:10.287140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bb678-4fe5-4aa7-91fc-7b9c0b865ba2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:10.328071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:10.377406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7250993c-d9e4-41ce-b3d5-bf98bea18bd0 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:10.386555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bb678-4fe5-4aa7-91fc-7b9c0b865ba2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:10.396983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:10.412751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e20b4-165d-4121-82f9-ce3427d8e878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:10.413367 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e20b4-165d-4121-82f9-ce3427d8e878 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:10.413650 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e20b4-165d-4121-82f9-ce3427d8e878 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:10.413924 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6e20b4-165d-4121-82f9-ce3427d8e878 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:10.414700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e20b4-165d-4121-82f9-ce3427d8e878 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:10.415004 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e20b4-165d-4121-82f9-ce3427d8e878 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:10.416496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6e20b4-165d-4121-82f9-ce3427d8e878 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:10.421958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9319c-6276-472d-b191-50fee0db2ffe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:10.422666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9319c-6276-472d-b191-50fee0db2ffe None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:10.423290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9319c-6276-472d-b191-50fee0db2ffe None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:10.423290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f9319c-6276-472d-b191-50fee0db2ffe None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:10.423904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9319c-6276-472d-b191-50fee0db2ffe None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:10.424201 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9319c-6276-472d-b191-50fee0db2ffe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:10.425537 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f9319c-6276-472d-b191-50fee0db2ffe None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:10.428555 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 286/575] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:10.429335 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e20b4-165d-4121-82f9-ce3427d8e878 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:10.434235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 290/576] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:10.434957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9319c-6276-472d-b191-50fee0db2ffe None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:10.527643 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6e20b4-165d-4121-82f9-ce3427d8e878 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:10.536757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f9319c-6276-472d-b191-50fee0db2ffe None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:10.537792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:10.561413 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d68db-45e3-46a9-9951-5bc7fa95eaac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:10.562048 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d68db-45e3-46a9-9951-5bc7fa95eaac None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:10.562327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d68db-45e3-46a9-9951-5bc7fa95eaac None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:10.562627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d68db-45e3-46a9-9951-5bc7fa95eaac None admin] PATH_INFO: `/v3/users/glance` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:10.570522 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a63227-977b-4c03-9e2a-44a93afe4c99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:10.571247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a63227-977b-4c03-9e2a-44a93afe4c99 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:10.571349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d68db-45e3-46a9-9951-5bc7fa95eaac None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:10.571521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a63227-977b-4c03-9e2a-44a93afe4c99 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:10.571786 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a63227-977b-4c03-9e2a-44a93afe4c99 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:10.573065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d68db-45e3-46a9-9951-5bc7fa95eaac None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:10.581686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a63227-977b-4c03-9e2a-44a93afe4c99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-564d68db-45e3-46a9-9951-5bc7fa95eaac None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:10.585905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:10.587011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:10.593046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:10.593046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:10.593046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:10.593046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:10.593046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:10.593046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:10.593046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:10.593046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:10.593046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 14:09:10.593046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:10.593046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 287/577] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:09:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-16a63227-977b-4c03-9e2a-44a93afe4c99 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:10.593773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:10.594833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:10.595868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:10.595868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:10.595868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:10.595868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:10.595868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:10.595868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:10.595868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:10.595868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:10.595868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:10.595868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:10.595868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:10.595868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:10.596646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d68db-45e3-46a9-9951-5bc7fa95eaac None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:10.596730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 291/578] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:10.596730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a63227-977b-4c03-9e2a-44a93afe4c99 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:10.625050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:10.693724 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a63227-977b-4c03-9e2a-44a93afe4c99 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:10.697881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d68db-45e3-46a9-9951-5bc7fa95eaac None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:10.727118 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab445884-17d2-4ebe-be7c-e7e9e3f6a148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:10.727726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab445884-17d2-4ebe-be7c-e7e9e3f6a148 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:10.728009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab445884-17d2-4ebe-be7c-e7e9e3f6a148 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:10.728284 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab445884-17d2-4ebe-be7c-e7e9e3f6a148 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:10.729066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab445884-17d2-4ebe-be7c-e7e9e3f6a148 None admin] RBAC: Adding query filter params (role.id=7db30e557e5b4d789838af5eb5985bf5, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=98cccf60a5424986b2e92b523542a640) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:10.729373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab445884-17d2-4ebe-be7c-e7e9e3f6a148 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:10.730840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab445884-17d2-4ebe-be7c-e7e9e3f6a148 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:10.731767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34379940-91bb-4d61-80bf-2c86e57e93d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:10.732408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34379940-91bb-4d61-80bf-2c86e57e93d7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:10.732688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34379940-91bb-4d61-80bf-2c86e57e93d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:10.732964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34379940-91bb-4d61-80bf-2c86e57e93d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:10.736374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 292/579] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:10 2022] GET /identity/v3/role_assignments?user.id=98cccf60a5424986b2e92b523542a640&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=7db30e557e5b4d789838af5eb5985bf5 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:10.737146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab445884-17d2-4ebe-be7c-e7e9e3f6a148 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:10.739835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34379940-91bb-4d61-80bf-2c86e57e93d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:10.741327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34379940-91bb-4d61-80bf-2c86e57e93d7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:10.754273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-34379940-91bb-4d61-80bf-2c86e57e93d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:10.754273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:10.754273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:10.754273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:10.754273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:10.754273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:10.754273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:10.754273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:10.754273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:10.754273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:10.754273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:10.754273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:10.754273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:10.754273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:10.754273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:10.755932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:10.757138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:10.757138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:10.757138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:10.757138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:10.757138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:10.757138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:10.757138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:10.757138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:10.757138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 288/580] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:10.758108 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34379940-91bb-4d61-80bf-2c86e57e93d7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:10.801449 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:10.864630 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:10.872573 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab445884-17d2-4ebe-be7c-e7e9e3f6a148 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:10.880722 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34379940-91bb-4d61-80bf-2c86e57e93d7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:10.916199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f9fa1-d71c-4c62-9e50-e1f64a4d24a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:10.917088 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f9fa1-d71c-4c62-9e50-e1f64a4d24a5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:10.917615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f9fa1-d71c-4c62-9e50-e1f64a4d24a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:10.918026 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f9fa1-d71c-4c62-9e50-e1f64a4d24a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:10.918869 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8478a87-5050-4bf4-ac48-eef7121dff7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:10.919492 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8478a87-5050-4bf4-ac48-eef7121dff7e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:10.919776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8478a87-5050-4bf4-ac48-eef7121dff7e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:10.920053 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8478a87-5050-4bf4-ac48-eef7121dff7e None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:10.920840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8478a87-5050-4bf4-ac48-eef7121dff7e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:10.921149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8478a87-5050-4bf4-ac48-eef7121dff7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:10.922614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8478a87-5050-4bf4-ac48-eef7121dff7e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:10.931967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f9fa1-d71c-4c62-9e50-e1f64a4d24a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:10.934405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01f9fa1-d71c-4c62-9e50-e1f64a4d24a5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:10.945137 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 289/581] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Aug 1 14:09:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:10.945137 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8478a87-5050-4bf4-ac48-eef7121dff7e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:10.956501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f01f9fa1-d71c-4c62-9e50-e1f64a4d24a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:10.956501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:10.956501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:10.956501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:10.956501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:10.956501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:10.956501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:10.956501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:10.956501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:10.956501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:10.956501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:10.956501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:10.956501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:10.956501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:10.956501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:10.957600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:10.959332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:10.959332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:10.959332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:10.959332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:10.959911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 293/582] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:10.960805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f9fa1-d71c-4c62-9e50-e1f64a4d24a5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:11.049684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:11.064998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8478a87-5050-4bf4-ac48-eef7121dff7e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:11.074892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f9fa1-d71c-4c62-9e50-e1f64a4d24a5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:11.109804 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443633d-f091-4756-a114-56cc2f5ff47f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:11.110612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443633d-f091-4756-a114-56cc2f5ff47f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:11.110997 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443633d-f091-4756-a114-56cc2f5ff47f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:11.111371 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1443633d-f091-4756-a114-56cc2f5ff47f None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:11.112195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443633d-f091-4756-a114-56cc2f5ff47f None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:11.112596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443633d-f091-4756-a114-56cc2f5ff47f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:11.114103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1443633d-f091-4756-a114-56cc2f5ff47f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:11.124538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3496cb5-3e55-43e1-8a11-fd1f9b6db54a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:11.129161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3496cb5-3e55-43e1-8a11-fd1f9b6db54a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:11.129268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 290/583] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:11.129362 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3496cb5-3e55-43e1-8a11-fd1f9b6db54a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:11.129362 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3496cb5-3e55-43e1-8a11-fd1f9b6db54a None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:11.129515 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443633d-f091-4756-a114-56cc2f5ff47f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:11.129615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3496cb5-3e55-43e1-8a11-fd1f9b6db54a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:11.129615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3496cb5-3e55-43e1-8a11-fd1f9b6db54a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:11.129615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3496cb5-3e55-43e1-8a11-fd1f9b6db54a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:11.145346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 294/584] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:11.147098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3496cb5-3e55-43e1-8a11-fd1f9b6db54a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:11.165105 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:11.234540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1443633d-f091-4756-a114-56cc2f5ff47f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:11.266146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3496cb5-3e55-43e1-8a11-fd1f9b6db54a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:11.273823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1eb50-59fa-4b4b-89c2-2255f2740b0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:11.274473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1eb50-59fa-4b4b-89c2-2255f2740b0e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:11.274775 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1eb50-59fa-4b4b-89c2-2255f2740b0e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:11.275050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f1eb50-59fa-4b4b-89c2-2255f2740b0e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:11.285514 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1eb50-59fa-4b4b-89c2-2255f2740b0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:11.287052 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f1eb50-59fa-4b4b-89c2-2255f2740b0e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:11.300933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-51f1eb50-59fa-4b4b-89c2-2255f2740b0e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:11.300933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:11.300933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:11.300933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:11.300933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:11.300933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:11.300933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:11.300933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:11.300933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:11.300933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:11.300933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:11.300933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:11.300933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:11.300933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:11.300933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:11.301809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:11.303283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:11.303283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:11.303283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:11.303283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:11.303502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ab3c4-7a2a-4eaf-908d-a864ecd1b36e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:11.303836 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ab3c4-7a2a-4eaf-908d-a864ecd1b36e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:11.304108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ab3c4-7a2a-4eaf-908d-a864ecd1b36e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:11.304378 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122ab3c4-7a2a-4eaf-908d-a864ecd1b36e None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:11.305069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ab3c4-7a2a-4eaf-908d-a864ecd1b36e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:11.305370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ab3c4-7a2a-4eaf-908d-a864ecd1b36e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:11.306760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122ab3c4-7a2a-4eaf-908d-a864ecd1b36e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:11.307442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 291/585] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:11.308185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1eb50-59fa-4b4b-89c2-2255f2740b0e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:11.310802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:11.324823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 295/586] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:11.324823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ab3c4-7a2a-4eaf-908d-a864ecd1b36e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:11.393882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:11.419029 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f1eb50-59fa-4b4b-89c2-2255f2740b0e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:11.430430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122ab3c4-7a2a-4eaf-908d-a864ecd1b36e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:11.455509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d387bc-081f-4803-9ab3-7228893d70fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:11.456454 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d387bc-081f-4803-9ab3-7228893d70fd None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:11.456733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d387bc-081f-4803-9ab3-7228893d70fd None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:11.457003 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d387bc-081f-4803-9ab3-7228893d70fd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:11.465926 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d275e1d-80bd-4728-9686-1afd4c3fd935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:11.466616 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275e1d-80bd-4728-9686-1afd4c3fd935 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:11.466901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275e1d-80bd-4728-9686-1afd4c3fd935 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:11.467174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d275e1d-80bd-4728-9686-1afd4c3fd935 None admin] PATH_INFO: `/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/e856fd5aff914cfb8b8dd86b39c89bd0/roles/7db30e557e5b4d789838af5eb5985bf5` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:11.471321 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d387bc-081f-4803-9ab3-7228893d70fd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:11.472906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d387bc-081f-4803-9ab3-7228893d70fd None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:11.483133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275e1d-80bd-4728-9686-1afd4c3fd935 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8bcd31836684fe5b43fd604df3d3e8b, user_id=e856fd5aff914cfb8b8dd86b39c89bd0, role_id=7db30e557e5b4d789838af5eb5985bf5)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:11.484703 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d275e1d-80bd-4728-9686-1afd4c3fd935 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:11.488697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-c1d387bc-081f-4803-9ab3-7228893d70fd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:11.488697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:11.488697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:11.488697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:11.488697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:11.488697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:11.488697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:11.488697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:11.488697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:11.488697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:11.488697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:11.488697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:11.488697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:11.488697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:11.488697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:11.490238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:11.491156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:11.491156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:11.491156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:11.491156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:11.491156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 292/587] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:11.491459 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d387bc-081f-4803-9ab3-7228893d70fd None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:11.506810 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 296/588] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:09:11 2022] PUT /identity/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/e856fd5aff914cfb8b8dd86b39c89bd0/roles/7db30e557e5b4d789838af5eb5985bf5 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:09:11.506810 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d275e1d-80bd-4728-9686-1afd4c3fd935 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:11.572193 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:11.637232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d275e1d-80bd-4728-9686-1afd4c3fd935 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:11.639392 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d387bc-081f-4803-9ab3-7228893d70fd None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:11.660897 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:11.683023 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ed846-9856-4e9b-a635-5a94bd0ed6b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:11.683666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ed846-9856-4e9b-a635-5a94bd0ed6b4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:11.683946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ed846-9856-4e9b-a635-5a94bd0ed6b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:11.684224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045ed846-9856-4e9b-a635-5a94bd0ed6b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:11.689219 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369362a-f083-4a70-a95f-99bc10397cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:11.690051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369362a-f083-4a70-a95f-99bc10397cbd None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:11.690530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369362a-f083-4a70-a95f-99bc10397cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:11.691010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8369362a-f083-4a70-a95f-99bc10397cbd None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:11.692166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369362a-f083-4a70-a95f-99bc10397cbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:11.692443 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ed846-9856-4e9b-a635-5a94bd0ed6b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:11.693361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369362a-f083-4a70-a95f-99bc10397cbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:11.694460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045ed846-9856-4e9b-a635-5a94bd0ed6b4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:11.695525 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8369362a-f083-4a70-a95f-99bc10397cbd None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-045ed846-9856-4e9b-a635-5a94bd0ed6b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:11.708069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:11.709663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:11.711038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:11.711038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:11.711038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:11.711038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:11.711038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:11.711038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:11.711038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:11.711038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:11.711038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:09:11.711038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:11.711038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 297/589] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:09:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:11.711038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ed846-9856-4e9b-a635-5a94bd0ed6b4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:11.718482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 293/590] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:11.720316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369362a-f083-4a70-a95f-99bc10397cbd None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:11.833101 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045ed846-9856-4e9b-a635-5a94bd0ed6b4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:11.858243 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8369362a-f083-4a70-a95f-99bc10397cbd None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:11.871414 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750aa4f-b608-4659-a71e-9b335b79b8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:11.872161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750aa4f-b608-4659-a71e-9b335b79b8ea None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:11.872446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750aa4f-b608-4659-a71e-9b335b79b8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:11.872716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b750aa4f-b608-4659-a71e-9b335b79b8ea None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:11.873424 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750aa4f-b608-4659-a71e-9b335b79b8ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:11.873725 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750aa4f-b608-4659-a71e-9b335b79b8ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:11.875762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b750aa4f-b608-4659-a71e-9b335b79b8ea None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:11.878977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:11.893194 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 298/591] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:11.894339 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750aa4f-b608-4659-a71e-9b335b79b8ea None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:11.906741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544914d-9549-4ea9-acfa-6cd52ec51041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:11.907466 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544914d-9549-4ea9-acfa-6cd52ec51041 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:11.908222 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544914d-9549-4ea9-acfa-6cd52ec51041 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:11.908584 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544914d-9549-4ea9-acfa-6cd52ec51041 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:11.909743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544914d-9549-4ea9-acfa-6cd52ec51041 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:11.910127 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544914d-9549-4ea9-acfa-6cd52ec51041 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:11.912146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8544914d-9549-4ea9-acfa-6cd52ec51041 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:11.941040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 294/592] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Aug 1 14:09:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:11.941040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544914d-9549-4ea9-acfa-6cd52ec51041 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:11.941684 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:12.020062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b750aa4f-b608-4659-a71e-9b335b79b8ea None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:12.057371 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999158ad-a846-492e-852b-0a372c62330e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:12.058337 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999158ad-a846-492e-852b-0a372c62330e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:12.058803 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999158ad-a846-492e-852b-0a372c62330e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:12.059205 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999158ad-a846-492e-852b-0a372c62330e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:12.066728 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999158ad-a846-492e-852b-0a372c62330e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:12.067218 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544914d-9549-4ea9-acfa-6cd52ec51041 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:12.069116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999158ad-a846-492e-852b-0a372c62330e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:12.081249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-999158ad-a846-492e-852b-0a372c62330e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:12.081249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:12.081249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:12.081249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:12.081249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:12.081249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:12.081249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:12.081249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:12.081249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:12.081249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:12.081249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:12.081249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:12.081249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:12.081249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:12.081249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:12.082303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:12.083939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:12.083939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:12.083939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:12.083939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:12.083939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:12.083939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:12.083939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:12.083939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:12.086112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 299/593] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:12.087118 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999158ad-a846-492e-852b-0a372c62330e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:12.107361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450ac5f-360e-4bb7-bd51-b1fbca631a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:12.108352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450ac5f-360e-4bb7-bd51-b1fbca631a64 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:12.108551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450ac5f-360e-4bb7-bd51-b1fbca631a64 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:12.108884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5450ac5f-360e-4bb7-bd51-b1fbca631a64 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:12.116791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450ac5f-360e-4bb7-bd51-b1fbca631a64 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:12.118662 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5450ac5f-360e-4bb7-bd51-b1fbca631a64 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-5450ac5f-360e-4bb7-bd51-b1fbca631a64 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:12.131735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:12.132855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:12.133881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:12.133881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:12.133881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:12.133881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:12.133881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:12.133881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:12.133881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:12.133881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:12.133881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 14:09:12.133881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:12.134412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 295/594] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:12.135083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450ac5f-360e-4bb7-bd51-b1fbca631a64 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:12.169383 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:12.198162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:12.203500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999158ad-a846-492e-852b-0a372c62330e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:12.241466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d997fe-2226-496d-b7c2-8a02ee8616ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:12.242452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d997fe-2226-496d-b7c2-8a02ee8616ef None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:12.243038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d997fe-2226-496d-b7c2-8a02ee8616ef None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:12.243608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d997fe-2226-496d-b7c2-8a02ee8616ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:12.246914 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5450ac5f-360e-4bb7-bd51-b1fbca631a64 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:12.255959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d997fe-2226-496d-b7c2-8a02ee8616ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:12.257811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d997fe-2226-496d-b7c2-8a02ee8616ef None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:12.274769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e5d997fe-2226-496d-b7c2-8a02ee8616ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:12.274769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:12.274769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:12.274769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:12.274769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:12.274769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:12.274769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:12.274769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:12.274769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:12.274769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:12.274769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:12.274769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:12.274769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:12.274769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:12.274769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:12.275689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:12.276565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:12.276565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:12.276565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:12.276565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:12.282901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 300/595] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:12.283552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbff15-c68d-49d3-b75d-d98b3f36af02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:12.284175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbff15-c68d-49d3-b75d-d98b3f36af02 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:12.284455 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbff15-c68d-49d3-b75d-d98b3f36af02 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:12.284796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fbff15-c68d-49d3-b75d-d98b3f36af02 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:12.285053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d997fe-2226-496d-b7c2-8a02ee8616ef None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:12.285538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbff15-c68d-49d3-b75d-d98b3f36af02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:12.286115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbff15-c68d-49d3-b75d-d98b3f36af02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:12.287344 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fbff15-c68d-49d3-b75d-d98b3f36af02 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:12.301141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 296/596] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:12.302013 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbff15-c68d-49d3-b75d-d98b3f36af02 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:12.395111 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d997fe-2226-496d-b7c2-8a02ee8616ef None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:12.400591 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:12.410282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fbff15-c68d-49d3-b75d-d98b3f36af02 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:12.436045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a65823-84ad-4f0a-aa4c-f756b9bef109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:12.436968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a65823-84ad-4f0a-aa4c-f756b9bef109 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:12.437447 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a65823-84ad-4f0a-aa4c-f756b9bef109 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:12.438010 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a65823-84ad-4f0a-aa4c-f756b9bef109 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:12.439110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a65823-84ad-4f0a-aa4c-f756b9bef109 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:12.439751 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a65823-84ad-4f0a-aa4c-f756b9bef109 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:12.441621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a65823-84ad-4f0a-aa4c-f756b9bef109 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:12.447202 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faaf7c-6d3a-49b5-82b1-866be17f0015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:12.447819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faaf7c-6d3a-49b5-82b1-866be17f0015 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:12.448098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faaf7c-6d3a-49b5-82b1-866be17f0015 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:12.448369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95faaf7c-6d3a-49b5-82b1-866be17f0015 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:12.449055 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95faaf7c-6d3a-49b5-82b1-866be17f0015 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:12.449357 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95faaf7c-6d3a-49b5-82b1-866be17f0015 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:12.450748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95faaf7c-6d3a-49b5-82b1-866be17f0015 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:12.463430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 301/597] 10.222.0.70 () {56 vars in 1139 bytes} [Mon Aug 1 14:09:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:12.463606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 297/598] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:12.464299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faaf7c-6d3a-49b5-82b1-866be17f0015 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:12.468799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a65823-84ad-4f0a-aa4c-f756b9bef109 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:12.480307 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:12.573129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95faaf7c-6d3a-49b5-82b1-866be17f0015 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:12.578022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a65823-84ad-4f0a-aa4c-f756b9bef109 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:12.609908 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8662e-41a7-4624-91da-3bdee22a46bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:12.610914 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8662e-41a7-4624-91da-3bdee22a46bd None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:12.611382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8662e-41a7-4624-91da-3bdee22a46bd None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:12.611802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f8662e-41a7-4624-91da-3bdee22a46bd None admin] PATH_INFO: `/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/bcc213ef64924074bd16152228913ef1/roles/7db30e557e5b4d789838af5eb5985bf5` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:12.616831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dab932-2d7d-4ad9-bdc0-f9a6d7f572e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:12.617635 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dab932-2d7d-4ad9-bdc0-f9a6d7f572e0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:12.618012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dab932-2d7d-4ad9-bdc0-f9a6d7f572e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:12.618531 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dab932-2d7d-4ad9-bdc0-f9a6d7f572e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:12.629987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8662e-41a7-4624-91da-3bdee22a46bd None admin] RBAC: Authorizing `identity:create_grant(project_id=c8bcd31836684fe5b43fd604df3d3e8b, user_id=bcc213ef64924074bd16152228913ef1, role_id=7db30e557e5b4d789838af5eb5985bf5)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:12.631169 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dab932-2d7d-4ad9-bdc0-f9a6d7f572e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:12.632775 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f8662e-41a7-4624-91da-3bdee22a46bd None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:12.633127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5dab932-2d7d-4ad9-bdc0-f9a6d7f572e0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:12.648584 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 298/599] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:09:12 2022] PUT /identity/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/bcc213ef64924074bd16152228913ef1/roles/7db30e557e5b4d789838af5eb5985bf5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:09:12.649674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8662e-41a7-4624-91da-3bdee22a46bd None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:12.650210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f5dab932-2d7d-4ad9-bdc0-f9a6d7f572e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:12.650210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:12.650210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:12.650210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:12.650210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:12.650210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:12.650210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:12.650210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:12.650210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:12.650210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:12.650210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:12.650210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:12.650210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:12.650210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:12.650210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:12.651263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:12.652366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:12.652366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:12.652366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:12.652366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:12.653998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 302/600] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:12.659644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dab932-2d7d-4ad9-bdc0-f9a6d7f572e0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:12.663879 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:12.772823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f8662e-41a7-4624-91da-3bdee22a46bd None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:12.812302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f1cb7-0509-4b5b-952e-d4c34e8c2daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:12.813207 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f1cb7-0509-4b5b-952e-d4c34e8c2daa None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:12.813636 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f1cb7-0509-4b5b-952e-d4c34e8c2daa None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:12.814080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f1cb7-0509-4b5b-952e-d4c34e8c2daa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:12.822143 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f1cb7-0509-4b5b-952e-d4c34e8c2daa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:12.823876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f1cb7-0509-4b5b-952e-d4c34e8c2daa None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:12.834218 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:12.839824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-f12f1cb7-0509-4b5b-952e-d4c34e8c2daa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:12.839824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:12.839824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:12.839824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:12.839824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:12.839824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:12.839824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:12.839824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:12.839824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:12.839824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:12.839824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:12.839824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:12.839824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:12.839824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:12.839824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:12.842711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:12.843597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:12.843597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:12.843597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:12.843597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:12.843597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:12.843597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:12.843597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:12.843597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:12.844339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 299/601] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:12.846525 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93722da-f93e-468f-9345-241bff507984 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:12.847390 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93722da-f93e-468f-9345-241bff507984 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:12.847864 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93722da-f93e-468f-9345-241bff507984 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:12.850813 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 300/602] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:12.851781 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93722da-f93e-468f-9345-241bff507984 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:12.888180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dab932-2d7d-4ad9-bdc0-f9a6d7f572e0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:12.925076 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdffa5cb-be36-445e-98ae-8231feab3759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:12.925888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffa5cb-be36-445e-98ae-8231feab3759 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:12.926235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffa5cb-be36-445e-98ae-8231feab3759 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:12.926649 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdffa5cb-be36-445e-98ae-8231feab3759 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:12.927452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffa5cb-be36-445e-98ae-8231feab3759 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:12.927825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffa5cb-be36-445e-98ae-8231feab3759 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:12.929268 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdffa5cb-be36-445e-98ae-8231feab3759 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:12.931127 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:12.943274 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 303/603] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:12.944598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093a1c0-619d-492a-97e8-942584945f21 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:12.944955 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093a1c0-619d-492a-97e8-942584945f21 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:12.945293 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3093a1c0-619d-492a-97e8-942584945f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:12.966290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3093a1c0-619d-492a-97e8-942584945f21 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:12.967618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3093a1c0-619d-492a-97e8-942584945f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:12.982000 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93722da-f93e-468f-9345-241bff507984 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:13.026317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4db1b-29cf-46fa-8326-fcd0cebfbb89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:13.027050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4db1b-29cf-46fa-8326-fcd0cebfbb89 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:13.027334 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4db1b-29cf-46fa-8326-fcd0cebfbb89 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:13.027893 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4db1b-29cf-46fa-8326-fcd0cebfbb89 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:13.028644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4db1b-29cf-46fa-8326-fcd0cebfbb89 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:13.028948 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4db1b-29cf-46fa-8326-fcd0cebfbb89 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:13.030421 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4db1b-29cf-46fa-8326-fcd0cebfbb89 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:13.045253 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 304/604] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:13.046252 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 301/605] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:13.047520 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093a1c0-619d-492a-97e8-942584945f21 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:13.058759 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4db1b-29cf-46fa-8326-fcd0cebfbb89 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:13.127522 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:13.184242 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4db1b-29cf-46fa-8326-fcd0cebfbb89 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:13.200981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3093a1c0-619d-492a-97e8-942584945f21 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:13.209885 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:13.223650 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f6468-f125-43f3-8a0f-5fa6ec74743c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:13.224595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f6468-f125-43f3-8a0f-5fa6ec74743c None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:13.225021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f6468-f125-43f3-8a0f-5fa6ec74743c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:13.225436 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f6468-f125-43f3-8a0f-5fa6ec74743c None admin] PATH_INFO: `/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/a41da5d6d38341deaf1563fe0ebac32b/roles/7db30e557e5b4d789838af5eb5985bf5` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:13.241546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f6468-f125-43f3-8a0f-5fa6ec74743c None admin] RBAC: Authorizing `identity:create_grant(project_id=c8bcd31836684fe5b43fd604df3d3e8b, user_id=a41da5d6d38341deaf1563fe0ebac32b, role_id=7db30e557e5b4d789838af5eb5985bf5)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:13.243319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f6468-f125-43f3-8a0f-5fa6ec74743c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:13.251433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123241d-7a2d-4daa-a489-169d452e9c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:13.252427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123241d-7a2d-4daa-a489-169d452e9c5e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:13.253053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123241d-7a2d-4daa-a489-169d452e9c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:13.253552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123241d-7a2d-4daa-a489-169d452e9c5e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:13.261702 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 302/606] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:09:13 2022] PUT /identity/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/a41da5d6d38341deaf1563fe0ebac32b/roles/7db30e557e5b4d789838af5eb5985bf5 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:09:13.262673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123241d-7a2d-4daa-a489-169d452e9c5e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:13.262785 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f6468-f125-43f3-8a0f-5fa6ec74743c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:13.264431 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123241d-7a2d-4daa-a489-169d452e9c5e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:13.278699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f123241d-7a2d-4daa-a489-169d452e9c5e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:13.278699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:13.278699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:13.278699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:13.278699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:13.278699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:13.278699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:13.278699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:13.278699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:13.278699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:13.278699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:13.278699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:13.278699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:13.278699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:13.278699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:13.279608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:13.280512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:13.280512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:13.280512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:13.280512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:13.280512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:13.280512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:13.280512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:13.280512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:13.283117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 305/607] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:13.288347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123241d-7a2d-4daa-a489-169d452e9c5e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:13.437571 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f6468-f125-43f3-8a0f-5fa6ec74743c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:13.487688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123241d-7a2d-4daa-a489-169d452e9c5e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:13.491648 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd0108-e628-4ac0-a148-4d9247e91830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:13.492304 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd0108-e628-4ac0-a148-4d9247e91830 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:13.492581 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd0108-e628-4ac0-a148-4d9247e91830 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:13.492848 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bd0108-e628-4ac0-a148-4d9247e91830 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:13.504924 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:13.509355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bd0108-e628-4ac0-a148-4d9247e91830 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-89bd0108-e628-4ac0-a148-4d9247e91830 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:13.514952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:13.515890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:13.516715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:13.516715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:13.516715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:13.516715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:13.516715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:13.516715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:13.516715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:13.516715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:13.516715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:13.516715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:13.516715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:13.516715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:13.518887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 303/608] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:13.522243 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd0108-e628-4ac0-a148-4d9247e91830 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:13.546636 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83695ba-7376-4e0a-a111-e3114e699143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:13.547688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83695ba-7376-4e0a-a111-e3114e699143 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:13.548261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83695ba-7376-4e0a-a111-e3114e699143 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:13.548825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83695ba-7376-4e0a-a111-e3114e699143 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:13.549993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83695ba-7376-4e0a-a111-e3114e699143 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:13.550498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83695ba-7376-4e0a-a111-e3114e699143 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:13.552842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83695ba-7376-4e0a-a111-e3114e699143 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:13.569244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:13.570437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 306/609] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:13.575698 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83695ba-7376-4e0a-a111-e3114e699143 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:13.701642 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83695ba-7376-4e0a-a111-e3114e699143 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:13.719732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bd0108-e628-4ac0-a148-4d9247e91830 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:13.746403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287edac1-2af9-4489-9150-c6e0f37216e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:13.747120 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287edac1-2af9-4489-9150-c6e0f37216e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:13.747399 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287edac1-2af9-4489-9150-c6e0f37216e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:13.747673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287edac1-2af9-4489-9150-c6e0f37216e4 None admin] PATH_INFO: `/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/33fcc673845943fc96bc18f011639716/roles/7db30e557e5b4d789838af5eb5985bf5` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:13.762948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287edac1-2af9-4489-9150-c6e0f37216e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8bcd31836684fe5b43fd604df3d3e8b, user_id=33fcc673845943fc96bc18f011639716, role_id=7db30e557e5b4d789838af5eb5985bf5)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:13.764392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287edac1-2af9-4489-9150-c6e0f37216e4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:13.767220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0895ee4-43c5-4514-a369-6f77c5efd465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:13.768707 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0895ee4-43c5-4514-a369-6f77c5efd465 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:13.769022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0895ee4-43c5-4514-a369-6f77c5efd465 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:13.769315 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0895ee4-43c5-4514-a369-6f77c5efd465 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:13.770035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0895ee4-43c5-4514-a369-6f77c5efd465 None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:13.770337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0895ee4-43c5-4514-a369-6f77c5efd465 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:13.771915 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0895ee4-43c5-4514-a369-6f77c5efd465 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:13.779373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 307/610] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:09:13 2022] PUT /identity/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/33fcc673845943fc96bc18f011639716/roles/7db30e557e5b4d789838af5eb5985bf5 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:09:13.781033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11af216-99b2-4fdd-90e9-1f3728b267b7 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:13.781244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 304/611] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:13.782192 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11af216-99b2-4fdd-90e9-1f3728b267b7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:13.782729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11af216-99b2-4fdd-90e9-1f3728b267b7 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:13.789765 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 308/612] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:13.790872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0895ee4-43c5-4514-a369-6f77c5efd465 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:13.792299 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f9ff8-cfa5-4bb7-b480-7615ca803ccb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:13.792855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f9ff8-cfa5-4bb7-b480-7615ca803ccb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:13.793392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f9ff8-cfa5-4bb7-b480-7615ca803ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:13.833287 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7d2f9ff8-cfa5-4bb7-b480-7615ca803ccb None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:13.836102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7d2f9ff8-cfa5-4bb7-b480-7615ca803ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:13.878990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:13.976649 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 309/613] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:13.980557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:13.987675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0895ee4-43c5-4514-a369-6f77c5efd465 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:14.000809 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f9ff8-cfa5-4bb7-b480-7615ca803ccb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:14.049141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65437775-9e1f-49de-93ff-eaff34518671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:14.049803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65437775-9e1f-49de-93ff-eaff34518671 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:14.050084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65437775-9e1f-49de-93ff-eaff34518671 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:14.050356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65437775-9e1f-49de-93ff-eaff34518671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:14.067373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65437775-9e1f-49de-93ff-eaff34518671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:14.068917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65437775-9e1f-49de-93ff-eaff34518671 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:14.096498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-65437775-9e1f-49de-93ff-eaff34518671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:14.096498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:14.096498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:14.096498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:14.096498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:14.096498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:14.096498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:14.096498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:14.096498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:14.096498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:14.096498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:14.096498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:14.096498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:14.096498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:14.096498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:14.097408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:14.098323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:14.098323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:14.098323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:14.098323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:14.107200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 305/614] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:14.112333 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65437775-9e1f-49de-93ff-eaff34518671 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:14.157910 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f9ff8-cfa5-4bb7-b480-7615ca803ccb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:14.229647 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4381-c60f-4101-8f43-cff7ecb4f26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:14.231762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4381-c60f-4101-8f43-cff7ecb4f26c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:14.233373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4381-c60f-4101-8f43-cff7ecb4f26c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:14.233879 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684a4381-c60f-4101-8f43-cff7ecb4f26c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:14.259565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684a4381-c60f-4101-8f43-cff7ecb4f26c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-684a4381-c60f-4101-8f43-cff7ecb4f26c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:14.267217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:14.268127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:14.268959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:14.268959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:14.268959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:14.268959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:14.268959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:14.268959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:14.268959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:14.268959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:14.268959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:14.268959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:14.268959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:14.268959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:14.278783 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 310/615] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:14.295601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4381-c60f-4101-8f43-cff7ecb4f26c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:14.303364 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65437775-9e1f-49de-93ff-eaff34518671 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:14.315049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:14.342026 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713a067-715f-4ec6-9610-93ede7dffc5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:14.343040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713a067-715f-4ec6-9610-93ede7dffc5b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:14.343541 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713a067-715f-4ec6-9610-93ede7dffc5b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:14.344072 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f713a067-715f-4ec6-9610-93ede7dffc5b None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:14.345003 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713a067-715f-4ec6-9610-93ede7dffc5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:14.345509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713a067-715f-4ec6-9610-93ede7dffc5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:14.347188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f713a067-715f-4ec6-9610-93ede7dffc5b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:14.361114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 306/616] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:14.367705 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713a067-715f-4ec6-9610-93ede7dffc5b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:14.379958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:14.473897 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684a4381-c60f-4101-8f43-cff7ecb4f26c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:14.479002 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f713a067-715f-4ec6-9610-93ede7dffc5b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:14.525179 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428298f2-eb2b-441b-8d7d-3576a8204f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:14.525804 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428298f2-eb2b-441b-8d7d-3576a8204f90 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:14.526115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428298f2-eb2b-441b-8d7d-3576a8204f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:14.526360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428298f2-eb2b-441b-8d7d-3576a8204f90 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:14.527107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428298f2-eb2b-441b-8d7d-3576a8204f90 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:14.527409 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428298f2-eb2b-441b-8d7d-3576a8204f90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:14.528790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428298f2-eb2b-441b-8d7d-3576a8204f90 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:14.543286 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 311/617] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:14.543953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e129d5c-9c6e-4a86-9dbf-d10fa952dffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:14.544606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e129d5c-9c6e-4a86-9dbf-d10fa952dffb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:14.544887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e129d5c-9c6e-4a86-9dbf-d10fa952dffb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:14.545164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e129d5c-9c6e-4a86-9dbf-d10fa952dffb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:14.551689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428298f2-eb2b-441b-8d7d-3576a8204f90 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:14.564096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e129d5c-9c6e-4a86-9dbf-d10fa952dffb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:14.567396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e129d5c-9c6e-4a86-9dbf-d10fa952dffb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-7e129d5c-9c6e-4a86-9dbf-d10fa952dffb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:14.584894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:14.585913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:14.586875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:14.586875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:14.586875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:14.586875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:14.586875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:14.586875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:14.586875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:14.586875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:14.586875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:09:14.586875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:14.589751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 307/618] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:09:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:14.595854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e129d5c-9c6e-4a86-9dbf-d10fa952dffb None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:14.695049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:14.718752 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:14.737899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428298f2-eb2b-441b-8d7d-3576a8204f90 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:14.772106 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039c49e-28be-478c-8d81-e740991f96ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:14.772739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039c49e-28be-478c-8d81-e740991f96ba None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:14.773013 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039c49e-28be-478c-8d81-e740991f96ba None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:14.773281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0039c49e-28be-478c-8d81-e740991f96ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:14.784316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039c49e-28be-478c-8d81-e740991f96ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:14.785809 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0039c49e-28be-478c-8d81-e740991f96ba None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:14.800658 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e129d5c-9c6e-4a86-9dbf-d10fa952dffb None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:14.803549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0039c49e-28be-478c-8d81-e740991f96ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:14.803549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:14.803549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:14.803549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:14.803549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:14.803549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:14.803549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:14.803549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:14.803549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:14.803549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:14.803549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:14.803549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:14.803549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:14.803549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:14.803549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:14.804401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:14.805918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:14.805918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:14.805918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:14.805918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:14.805918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 312/619] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:14.812040 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039c49e-28be-478c-8d81-e740991f96ba None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:14.870666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584ae9a-47a0-4666-815e-f5d199d8129e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:14.871288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584ae9a-47a0-4666-815e-f5d199d8129e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:14.871561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584ae9a-47a0-4666-815e-f5d199d8129e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:14.871828 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7584ae9a-47a0-4666-815e-f5d199d8129e None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:14.872617 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584ae9a-47a0-4666-815e-f5d199d8129e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:14.872917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584ae9a-47a0-4666-815e-f5d199d8129e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:14.874354 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7584ae9a-47a0-4666-815e-f5d199d8129e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:14.902124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 308/620] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Aug 1 14:09:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:14.907457 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584ae9a-47a0-4666-815e-f5d199d8129e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:15.004937 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0039c49e-28be-478c-8d81-e740991f96ba None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:15.015685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7584ae9a-47a0-4666-815e-f5d199d8129e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:15.029556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:15.040123 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f71959-a009-4f9b-b2a7-a669925b5407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:15.040836 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f71959-a009-4f9b-b2a7-a669925b5407 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:15.041208 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f71959-a009-4f9b-b2a7-a669925b5407 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:15.041556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f71959-a009-4f9b-b2a7-a669925b5407 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:15.042334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f71959-a009-4f9b-b2a7-a669925b5407 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:15.042737 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f71959-a009-4f9b-b2a7-a669925b5407 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:15.044180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4f71959-a009-4f9b-b2a7-a669925b5407 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:15.045855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:15.060045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 313/621] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:15.060311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39ea1de-1149-4f43-a091-d76acb9a1b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:15.060920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ea1de-1149-4f43-a091-d76acb9a1b5f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:15.061198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ea1de-1149-4f43-a091-d76acb9a1b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:15.061470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39ea1de-1149-4f43-a091-d76acb9a1b5f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:15.061621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54785f62-b0d0-4931-850c-855dc02ea54b None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:15.062066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54785f62-b0d0-4931-850c-855dc02ea54b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:15.062353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54785f62-b0d0-4931-850c-855dc02ea54b None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:15.066653 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 314/622] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:15.068224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54785f62-b0d0-4931-850c-855dc02ea54b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:15.079068 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ea1de-1149-4f43-a091-d76acb9a1b5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:15.080571 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39ea1de-1149-4f43-a091-d76acb9a1b5f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:15.096501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-c39ea1de-1149-4f43-a091-d76acb9a1b5f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:15.096501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:15.096501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:15.096501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:15.096501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:15.096501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:15.096501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:15.096501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:15.096501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:15.096501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:15.096501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:15.096501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:15.096501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:15.096501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:15.096501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:15.097410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:15.099266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:15.099266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:15.099266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:15.099266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:15.099266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 309/623] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:15.099835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1545537-543b-4d3f-8dad-acecafcf1cce None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:15.099998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1545537-543b-4d3f-8dad-acecafcf1cce None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:15.102619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1545537-543b-4d3f-8dad-acecafcf1cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:15.119851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f1545537-543b-4d3f-8dad-acecafcf1cce None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:15.121085 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f1545537-543b-4d3f-8dad-acecafcf1cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:15.181401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54785f62-b0d0-4931-850c-855dc02ea54b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:15.198663 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 310/624] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:15.199566 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1545537-543b-4d3f-8dad-acecafcf1cce None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:15.217541 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc67c1b-f7de-4ed0-b5a4-bd7c8264542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:15.218177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc67c1b-f7de-4ed0-b5a4-bd7c8264542a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:15.218453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc67c1b-f7de-4ed0-b5a4-bd7c8264542a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:15.218754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc67c1b-f7de-4ed0-b5a4-bd7c8264542a None admin] PATH_INFO: `/v3/users/nova` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:15.226748 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc67c1b-f7de-4ed0-b5a4-bd7c8264542a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:15.228184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc67c1b-f7de-4ed0-b5a4-bd7c8264542a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-0fc67c1b-f7de-4ed0-b5a4-bd7c8264542a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:15.240989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:15.243375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:15.245666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:15.245666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:15.245666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:15.245666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:15.245666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:15.245666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:15.245666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:15.245666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:15.245666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:09:15.245666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:15.245666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 315/625] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 1 14:09:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:15.245666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc67c1b-f7de-4ed0-b5a4-bd7c8264542a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:15.293487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:15.327434 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1545537-543b-4d3f-8dad-acecafcf1cce None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:15.335048 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:15.353651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc67c1b-f7de-4ed0-b5a4-bd7c8264542a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:15.365305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd754d-f809-4bfd-a7e0-9bfc49b42ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:15.366170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd754d-f809-4bfd-a7e0-9bfc49b42ec6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:15.366625 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd754d-f809-4bfd-a7e0-9bfc49b42ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:15.367045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cd754d-f809-4bfd-a7e0-9bfc49b42ec6 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:15.367887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd754d-f809-4bfd-a7e0-9bfc49b42ec6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:15.368338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd754d-f809-4bfd-a7e0-9bfc49b42ec6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:15.369871 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cd754d-f809-4bfd-a7e0-9bfc49b42ec6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:15.386565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 311/626] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:15.387667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd754d-f809-4bfd-a7e0-9bfc49b42ec6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:15.389854 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d818dcb-8544-4f92-92b5-287a81b4c40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:15.390496 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d818dcb-8544-4f92-92b5-287a81b4c40f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:15.390832 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d818dcb-8544-4f92-92b5-287a81b4c40f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:15.391085 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d818dcb-8544-4f92-92b5-287a81b4c40f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:15.402291 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d818dcb-8544-4f92-92b5-287a81b4c40f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-9d818dcb-8544-4f92-92b5-287a81b4c40f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:15.407988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:15.409125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:15.410128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:15.410128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:15.410128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:15.410128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:15.410128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:15.410128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:15.410128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:15.410128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:15.410128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:15.410128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:15.410128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:15.410128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:15.415020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 316/627] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:15.415774 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d818dcb-8544-4f92-92b5-287a81b4c40f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:15.496437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cd754d-f809-4bfd-a7e0-9bfc49b42ec6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:15.527855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d818dcb-8544-4f92-92b5-287a81b4c40f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:15.530277 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:15.537429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc080d-3771-4c2a-8f9d-6656fafee29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:15.538298 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc080d-3771-4c2a-8f9d-6656fafee29a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:15.538762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc080d-3771-4c2a-8f9d-6656fafee29a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:15.539198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cc080d-3771-4c2a-8f9d-6656fafee29a None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:15.540141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc080d-3771-4c2a-8f9d-6656fafee29a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:15.540593 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc080d-3771-4c2a-8f9d-6656fafee29a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:15.542270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cc080d-3771-4c2a-8f9d-6656fafee29a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:15.560379 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 312/628] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 1 14:09:15 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:15.561447 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc080d-3771-4c2a-8f9d-6656fafee29a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:15.566282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd76f8d-8451-4cf4-a067-b62104a48fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:15.566953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd76f8d-8451-4cf4-a067-b62104a48fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:15.567294 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd76f8d-8451-4cf4-a067-b62104a48fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:15.567605 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd76f8d-8451-4cf4-a067-b62104a48fd4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:15.575033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd76f8d-8451-4cf4-a067-b62104a48fd4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:15.576482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd76f8d-8451-4cf4-a067-b62104a48fd4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:15.589251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:15.591045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6bd76f8d-8451-4cf4-a067-b62104a48fd4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:15.591045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:15.591045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:15.591045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:15.591045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:15.591045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:15.591045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:15.591045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:15.591045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:15.591045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:15.591045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:15.591045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:15.591045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:15.591045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:15.591045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:15.592363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:15.593263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:15.593263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:15.593263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:15.593263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:15.593263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:15.593263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:15.593263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:15.593263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:15.595604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 317/629] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:15.597211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd76f8d-8451-4cf4-a067-b62104a48fd4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:15.697456 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cc080d-3771-4c2a-8f9d-6656fafee29a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:15.722363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd76f8d-8451-4cf4-a067-b62104a48fd4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:15.746415 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7137484-44cb-45ed-8d81-dd90279fd997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:15.747994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7137484-44cb-45ed-8d81-dd90279fd997 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:15.748455 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7137484-44cb-45ed-8d81-dd90279fd997 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:15.749194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7137484-44cb-45ed-8d81-dd90279fd997 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:15.750431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7137484-44cb-45ed-8d81-dd90279fd997 None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:15.751380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7137484-44cb-45ed-8d81-dd90279fd997 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:15.753509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7137484-44cb-45ed-8d81-dd90279fd997 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:15.759083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8afe4-93d7-41bb-84ba-fa384fe265bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:15.759715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8afe4-93d7-41bb-84ba-fa384fe265bb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:15.759999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8afe4-93d7-41bb-84ba-fa384fe265bb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:15.760276 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8afe4-93d7-41bb-84ba-fa384fe265bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:15.769560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 313/630] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:15.769560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7137484-44cb-45ed-8d81-dd90279fd997 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:15.794989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:15.838508 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8afe4-93d7-41bb-84ba-fa384fe265bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:15.840105 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8afe4-93d7-41bb-84ba-fa384fe265bb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:15.863496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:15.879537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7137484-44cb-45ed-8d81-dd90279fd997 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:15.915105 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f240a8-4c08-4789-8a19-d525b5a32dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:15.915727 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f240a8-4c08-4789-8a19-d525b5a32dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:15.916010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f240a8-4c08-4789-8a19-d525b5a32dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:15.916290 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f240a8-4c08-4789-8a19-d525b5a32dd6 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:15.917048 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f240a8-4c08-4789-8a19-d525b5a32dd6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:15.917360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f240a8-4c08-4789-8a19-d525b5a32dd6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:15.918847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f240a8-4c08-4789-8a19-d525b5a32dd6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:15.936126 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 314/631] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:15.936126 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b244ab9-3251-4711-97d4-eae588b2fd33 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:15.936126 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b244ab9-3251-4711-97d4-eae588b2fd33 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:15.936126 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b244ab9-3251-4711-97d4-eae588b2fd33 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:15.938284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 315/632] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:15.939132 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b244ab9-3251-4711-97d4-eae588b2fd33 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:15.955652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 318/633] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:15.955652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8afe4-93d7-41bb-84ba-fa384fe265bb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:16.028689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:16.055656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b244ab9-3251-4711-97d4-eae588b2fd33 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:16.068039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8afe4-93d7-41bb-84ba-fa384fe265bb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:16.090428 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfe3386-54e8-4674-b108-4c3976499087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:16.091026 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe3386-54e8-4674-b108-4c3976499087 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:16.091306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe3386-54e8-4674-b108-4c3976499087 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:16.091577 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfe3386-54e8-4674-b108-4c3976499087 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:16.101395 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe3386-54e8-4674-b108-4c3976499087 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:16.102873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfe3386-54e8-4674-b108-4c3976499087 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:16.103296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754da42-7192-491d-9333-c3aa5e66bf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:16.103968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754da42-7192-491d-9333-c3aa5e66bf77 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:16.104250 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754da42-7192-491d-9333-c3aa5e66bf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:16.104529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7754da42-7192-491d-9333-c3aa5e66bf77 None admin] PATH_INFO: `/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/98cccf60a5424986b2e92b523542a640/roles/7db30e557e5b4d789838af5eb5985bf5` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:16.109518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:16.118194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-4bfe3386-54e8-4674-b108-4c3976499087 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:16.118194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:16.118194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:16.118194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:16.118194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:16.118194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:16.118194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:16.118194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:16.118194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:16.118194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:16.118194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:16.118194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:16.118194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:16.118194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:16.118194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:16.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:16.120198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:16.120198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:16.120198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:16.120198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:16.120419 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754da42-7192-491d-9333-c3aa5e66bf77 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8bcd31836684fe5b43fd604df3d3e8b, user_id=98cccf60a5424986b2e92b523542a640, role_id=7db30e557e5b4d789838af5eb5985bf5)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:16.120493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 316/634] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:16.120571 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7754da42-7192-491d-9333-c3aa5e66bf77 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:16.120817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c4071-99cf-4802-9d1e-02cb9f5e6b04 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:16.121097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c4071-99cf-4802-9d1e-02cb9f5e6b04 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:16.121369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33c4071-99cf-4802-9d1e-02cb9f5e6b04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:16.133777 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 319/635] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:09:15 2022] PUT /identity/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/98cccf60a5424986b2e92b523542a640/roles/7db30e557e5b4d789838af5eb5985bf5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:09:16.134803 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754da42-7192-491d-9333-c3aa5e66bf77 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:16.153309 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b33c4071-99cf-4802-9d1e-02cb9f5e6b04 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:16.155224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b33c4071-99cf-4802-9d1e-02cb9f5e6b04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:16.237559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 317/636] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:16.239057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013a857-3c6a-42d1-8a79-914349a01cac None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:16.239856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013a857-3c6a-42d1-8a79-914349a01cac None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:16.240130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f013a857-3c6a-42d1-8a79-914349a01cac None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:16.245746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 318/637] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:16.245746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013a857-3c6a-42d1-8a79-914349a01cac None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:16.267057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7754da42-7192-491d-9333-c3aa5e66bf77 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:16.287736 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:16.314196 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38a04b2-1fb8-4726-9f2e-75c49900b25f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:16.314910 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a04b2-1fb8-4726-9f2e-75c49900b25f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:16.315189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a04b2-1fb8-4726-9f2e-75c49900b25f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:16.315465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38a04b2-1fb8-4726-9f2e-75c49900b25f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:16.326351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a04b2-1fb8-4726-9f2e-75c49900b25f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:16.327844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38a04b2-1fb8-4726-9f2e-75c49900b25f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:16.344012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c38a04b2-1fb8-4726-9f2e-75c49900b25f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:16.344012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:16.344012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:16.344012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:16.344012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:16.344012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:16.344012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:16.344012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:16.344012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:16.344012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:16.344012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:16.344012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:16.344012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:16.344012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:16.344012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:16.344906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:16.345893 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:16.345893 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:16.345893 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:16.345893 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:16.345893 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 320/638] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:16.346416 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50062948-49c6-4292-ab05-47b61349b09d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:16.350938 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50062948-49c6-4292-ab05-47b61349b09d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:16.350938 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50062948-49c6-4292-ab05-47b61349b09d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:16.367783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f013a857-3c6a-42d1-8a79-914349a01cac None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:16.367957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-50062948-49c6-4292-ab05-47b61349b09d None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:16.369075 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-50062948-49c6-4292-ab05-47b61349b09d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:16.397816 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:16.407375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d074fb-938b-4220-b496-4152b52642f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:16.408002 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d074fb-938b-4220-b496-4152b52642f5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:16.408283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d074fb-938b-4220-b496-4152b52642f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:16.408556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d074fb-938b-4220-b496-4152b52642f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:16.409250 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d074fb-938b-4220-b496-4152b52642f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:16.409553 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d074fb-938b-4220-b496-4152b52642f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:16.410965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d074fb-938b-4220-b496-4152b52642f5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:16.423206 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 319/639] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:16.424019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d074fb-938b-4220-b496-4152b52642f5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:16.450047 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 321/640] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:16.451504 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50062948-49c6-4292-ab05-47b61349b09d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:16.544453 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d074fb-938b-4220-b496-4152b52642f5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:16.568888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:16.575135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50062948-49c6-4292-ab05-47b61349b09d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:16.583610 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32618ec3-0b3f-4fb1-b11b-f14b4083f893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:16.584658 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32618ec3-0b3f-4fb1-b11b-f14b4083f893 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:16.584658 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32618ec3-0b3f-4fb1-b11b-f14b4083f893 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:16.584948 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32618ec3-0b3f-4fb1-b11b-f14b4083f893 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:16.596133 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32618ec3-0b3f-4fb1-b11b-f14b4083f893 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-32618ec3-0b3f-4fb1-b11b-f14b4083f893 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:16.601934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:16.602962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:16.603850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:16.603850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:16.603850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:16.603850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:16.603850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:16.603850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:16.603850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:16.603850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:16.603850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:16.603850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:16.603850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:16.603850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:16.603850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 320/641] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:16.603850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32618ec3-0b3f-4fb1-b11b-f14b4083f893 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:16.619129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778224d-0b39-409c-86c2-f81057767b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:16.619719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778224d-0b39-409c-86c2-f81057767b4d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:16.620040 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778224d-0b39-409c-86c2-f81057767b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:16.620345 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d778224d-0b39-409c-86c2-f81057767b4d None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:16.621085 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778224d-0b39-409c-86c2-f81057767b4d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:16.621394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778224d-0b39-409c-86c2-f81057767b4d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:16.622968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d778224d-0b39-409c-86c2-f81057767b4d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:16.635456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 322/642] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:16.635456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778224d-0b39-409c-86c2-f81057767b4d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:16.662479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:16.716585 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32618ec3-0b3f-4fb1-b11b-f14b4083f893 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:16.747708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d778224d-0b39-409c-86c2-f81057767b4d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:16.751231 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01ed17-8f20-412f-820d-cc133bc1cd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:16.751873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01ed17-8f20-412f-820d-cc133bc1cd50 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:16.752152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01ed17-8f20-412f-820d-cc133bc1cd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:16.752425 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db01ed17-8f20-412f-820d-cc133bc1cd50 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:16.761275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01ed17-8f20-412f-820d-cc133bc1cd50 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:16.762796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db01ed17-8f20-412f-820d-cc133bc1cd50 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-db01ed17-8f20-412f-820d-cc133bc1cd50 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:16.774102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:16.775361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:16.776319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:16.776319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:16.776319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:16.776319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:16.776319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:16.776319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:16.776319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:16.776319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:16.776319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 01 14:09:16.776319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:16.776319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 321/643] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:09:16 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:16.776918 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01ed17-8f20-412f-820d-cc133bc1cd50 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:16.789338 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d96274-c745-47eb-ba4e-189f9f620400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:16.789985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96274-c745-47eb-ba4e-189f9f620400 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:16.790270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96274-c745-47eb-ba4e-189f9f620400 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:16.790767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96274-c745-47eb-ba4e-189f9f620400 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:16.801516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d96274-c745-47eb-ba4e-189f9f620400 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-51d96274-c745-47eb-ba4e-189f9f620400 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:16.814988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:16.815986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:16.816883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:16.816883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:16.816883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:16.816883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:16.816883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:16.816883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:16.816883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:16.816883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:16.816883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:16.816883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:16.816883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:16.816883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:16.816883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 323/644] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:16.817718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d96274-c745-47eb-ba4e-189f9f620400 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:16.840324 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:16.895172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db01ed17-8f20-412f-820d-cc133bc1cd50 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:16.904790 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:16.933568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810238d-1a9f-4d69-b691-0e0471301e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:16.933751 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d96274-c745-47eb-ba4e-189f9f620400 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:16.934186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810238d-1a9f-4d69-b691-0e0471301e68 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:16.934465 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810238d-1a9f-4d69-b691-0e0471301e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:16.934764 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b810238d-1a9f-4d69-b691-0e0471301e68 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:16.935470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810238d-1a9f-4d69-b691-0e0471301e68 None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:16.935772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810238d-1a9f-4d69-b691-0e0471301e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:16.937171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b810238d-1a9f-4d69-b691-0e0471301e68 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:16.945953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 322/645] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:16.946588 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810238d-1a9f-4d69-b691-0e0471301e68 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:16.972946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352cc78-1761-4c97-8a25-a582c3a319e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:16.973583 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352cc78-1761-4c97-8a25-a582c3a319e8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:16.974373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352cc78-1761-4c97-8a25-a582c3a319e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:16.974673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9352cc78-1761-4c97-8a25-a582c3a319e8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:16.981944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352cc78-1761-4c97-8a25-a582c3a319e8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:16.983653 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9352cc78-1761-4c97-8a25-a582c3a319e8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:16.998247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-9352cc78-1761-4c97-8a25-a582c3a319e8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:16.998247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:16.998247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:16.998247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:16.998247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:16.998247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:16.998247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:16.998247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:16.998247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:16.998247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:16.998247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:16.998247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:16.998247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:16.998247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:16.998247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:16.999315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:17.002159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:17.002159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:17.002159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:17.002159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:17.002159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:17.002159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:17.002159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:17.002159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:17.003914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 324/646] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:17.004493 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352cc78-1761-4c97-8a25-a582c3a319e8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:17.066641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b810238d-1a9f-4d69-b691-0e0471301e68 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:17.087112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:17.103696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9f4a4-dda9-4a36-ac8a-dd519043fe4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:17.104317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9f4a4-dda9-4a36-ac8a-dd519043fe4b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:17.104599 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9f4a4-dda9-4a36-ac8a-dd519043fe4b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:17.104873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e9f4a4-dda9-4a36-ac8a-dd519043fe4b None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:17.105658 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9f4a4-dda9-4a36-ac8a-dd519043fe4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:17.105979 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9f4a4-dda9-4a36-ac8a-dd519043fe4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:17.107468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e9f4a4-dda9-4a36-ac8a-dd519043fe4b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:17.114251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9352cc78-1761-4c97-8a25-a582c3a319e8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:17.124798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 323/647] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Aug 1 14:09:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:17.125608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9f4a4-dda9-4a36-ac8a-dd519043fe4b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:17.155913 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f80ea6-931e-4256-9b11-6f906afcd735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:17.156745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f80ea6-931e-4256-9b11-6f906afcd735 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:17.157191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f80ea6-931e-4256-9b11-6f906afcd735 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:17.157670 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f80ea6-931e-4256-9b11-6f906afcd735 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:17.158374 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:17.158735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f80ea6-931e-4256-9b11-6f906afcd735 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:17.159038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f80ea6-931e-4256-9b11-6f906afcd735 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:17.160791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f80ea6-931e-4256-9b11-6f906afcd735 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:17.174350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 325/648] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:17.174350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f80ea6-931e-4256-9b11-6f906afcd735 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:17.238888 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e9f4a4-dda9-4a36-ac8a-dd519043fe4b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:17.275272 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99f733-185c-4aaf-9962-e858e594f55a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:17.276014 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99f733-185c-4aaf-9962-e858e594f55a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:17.276299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99f733-185c-4aaf-9962-e858e594f55a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:17.276569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d99f733-185c-4aaf-9962-e858e594f55a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:17.288712 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f80ea6-931e-4256-9b11-6f906afcd735 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:17.288909 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99f733-185c-4aaf-9962-e858e594f55a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:17.290994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d99f733-185c-4aaf-9962-e858e594f55a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:17.307537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-5d99f733-185c-4aaf-9962-e858e594f55a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:17.307537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:17.307537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:17.307537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:17.307537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:17.307537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:17.307537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:17.307537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:17.307537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:17.307537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:17.307537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:17.307537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:17.307537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:17.307537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:17.307537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:17.308671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:17.309616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:17.309616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:17.309616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:17.309616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:17.309616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 324/649] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:17.309921 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99f733-185c-4aaf-9962-e858e594f55a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:17.331759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f78032-b458-448f-957f-5a37a12afa57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:17.332907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f78032-b458-448f-957f-5a37a12afa57 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:17.333727 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f78032-b458-448f-957f-5a37a12afa57 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:17.334002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f78032-b458-448f-957f-5a37a12afa57 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:17.335015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f78032-b458-448f-957f-5a37a12afa57 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:17.335322 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f78032-b458-448f-957f-5a37a12afa57 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:17.336807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f78032-b458-448f-957f-5a37a12afa57 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:17.344804 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:17.351741 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 326/650] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:17.352859 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f78032-b458-448f-957f-5a37a12afa57 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:17.401931 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:17.424147 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d99f733-185c-4aaf-9962-e858e594f55a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:17.457830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c916811-f906-4158-8cc8-ed0218184509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:17.458088 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f78032-b458-448f-957f-5a37a12afa57 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:17.459024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c916811-f906-4158-8cc8-ed0218184509 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:17.459305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c916811-f906-4158-8cc8-ed0218184509 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:17.459578 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c916811-f906-4158-8cc8-ed0218184509 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:17.494921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48799c-4531-4061-a7fc-8a5437e1aa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:17.495568 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48799c-4531-4061-a7fc-8a5437e1aa85 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:17.495850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48799c-4531-4061-a7fc-8a5437e1aa85 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:17.496125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf48799c-4531-4061-a7fc-8a5437e1aa85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:17.507891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48799c-4531-4061-a7fc-8a5437e1aa85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:17.509458 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf48799c-4531-4061-a7fc-8a5437e1aa85 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:17.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-cf48799c-4531-4061-a7fc-8a5437e1aa85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:17.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:17.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:17.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:17.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:17.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:17.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:17.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:17.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:17.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:17.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:17.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:17.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:17.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:17.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:17.526646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:17.527561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:17.527561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:17.527561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:17.527561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:17.527561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 327/651] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:17.527878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48799c-4531-4061-a7fc-8a5437e1aa85 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:17.532458 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c916811-f906-4158-8cc8-ed0218184509 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:17.534030 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c916811-f906-4158-8cc8-ed0218184509 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:17.581000 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:17.622116 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:17.641677 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf48799c-4531-4061-a7fc-8a5437e1aa85 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:17.645376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 325/652] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:17.646813 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c916811-f906-4158-8cc8-ed0218184509 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:17.678042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9bda6-c1ce-4c44-a493-43d36d366359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:17.678612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9bda6-c1ce-4c44-a493-43d36d366359 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:17.678901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9bda6-c1ce-4c44-a493-43d36d366359 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:17.679178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9bda6-c1ce-4c44-a493-43d36d366359 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:17.679866 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9bda6-c1ce-4c44-a493-43d36d366359 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:17.680172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9bda6-c1ce-4c44-a493-43d36d366359 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:17.681540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9bda6-c1ce-4c44-a493-43d36d366359 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:17.694291 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 328/653] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:17.695356 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9bda6-c1ce-4c44-a493-43d36d366359 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:17.772112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c916811-f906-4158-8cc8-ed0218184509 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:17.801195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9bda6-c1ce-4c44-a493-43d36d366359 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:17.808386 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf65093-7a39-4f05-a7c6-b4cd8c93bd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:17.809217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf65093-7a39-4f05-a7c6-b4cd8c93bd24 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:17.809498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf65093-7a39-4f05-a7c6-b4cd8c93bd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:17.809774 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf65093-7a39-4f05-a7c6-b4cd8c93bd24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:17.810552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf65093-7a39-4f05-a7c6-b4cd8c93bd24 None admin] RBAC: Adding query filter params (role.id=7db30e557e5b4d789838af5eb5985bf5, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=e856fd5aff914cfb8b8dd86b39c89bd0) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:17.810894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf65093-7a39-4f05-a7c6-b4cd8c93bd24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:17.812337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf65093-7a39-4f05-a7c6-b4cd8c93bd24 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:17.813128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:17.819274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 326/654] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:17 2022] GET /identity/v3/role_assignments?user.id=e856fd5aff914cfb8b8dd86b39c89bd0&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=7db30e557e5b4d789838af5eb5985bf5 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:17.820090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf65093-7a39-4f05-a7c6-b4cd8c93bd24 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:17.863293 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fd7e3-633a-4fd8-a773-2e4bd3ebc243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:17.864825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fd7e3-633a-4fd8-a773-2e4bd3ebc243 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:17.865317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fd7e3-633a-4fd8-a773-2e4bd3ebc243 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:17.865800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83fd7e3-633a-4fd8-a773-2e4bd3ebc243 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:17.867507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fd7e3-633a-4fd8-a773-2e4bd3ebc243 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:17.868108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fd7e3-633a-4fd8-a773-2e4bd3ebc243 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:17.870361 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83fd7e3-633a-4fd8-a773-2e4bd3ebc243 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:17.873890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:17.892348 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 329/655] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:17.894247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fd7e3-633a-4fd8-a773-2e4bd3ebc243 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:17.962947 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf65093-7a39-4f05-a7c6-b4cd8c93bd24 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:18.016472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2583d9-4801-4b3d-a9dd-434c105eea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:18.017263 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2583d9-4801-4b3d-a9dd-434c105eea20 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:18.017561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2583d9-4801-4b3d-a9dd-434c105eea20 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:18.017848 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2583d9-4801-4b3d-a9dd-434c105eea20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:18.025651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83fd7e3-633a-4fd8-a773-2e4bd3ebc243 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:18.032612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2583d9-4801-4b3d-a9dd-434c105eea20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:18.033282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2583d9-4801-4b3d-a9dd-434c105eea20 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:18.051460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-7f2583d9-4801-4b3d-a9dd-434c105eea20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:18.051460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:18.051460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:18.051460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:18.051460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:18.051460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:18.051460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:18.051460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:18.051460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:18.051460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:18.051460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:18.051460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:18.051460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:18.051460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:18.051460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:18.052957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:18.053845 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:18.053845 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:18.053845 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:18.053845 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:18.053845 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 327/656] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:18.054128 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2583d9-4801-4b3d-a9dd-434c105eea20 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:18.079877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e125ed5-41ee-428b-9b38-bb8747725b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:18.081065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e125ed5-41ee-428b-9b38-bb8747725b58 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:18.081357 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e125ed5-41ee-428b-9b38-bb8747725b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:18.081631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e125ed5-41ee-428b-9b38-bb8747725b58 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:18.091806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e125ed5-41ee-428b-9b38-bb8747725b58 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:18.093269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e125ed5-41ee-428b-9b38-bb8747725b58 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-5e125ed5-41ee-428b-9b38-bb8747725b58 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:18.106369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:18.107507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:18.108482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:18.108482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:18.108482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:18.108482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:18.108482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:18.108482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:18.108482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:18.108482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:18.108482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:09:18.108482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:18.108482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 330/657] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:09:17 2022] GET /identity/v3/users/cinder => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:18.109114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e125ed5-41ee-428b-9b38-bb8747725b58 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:18.156842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:18.170099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:18.177543 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2583d9-4801-4b3d-a9dd-434c105eea20 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:18.214025 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35437b76-e99a-4d7e-8cc3-b2e395dd4d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:18.214597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35437b76-e99a-4d7e-8cc3-b2e395dd4d04 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:18.214888 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35437b76-e99a-4d7e-8cc3-b2e395dd4d04 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:18.215159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35437b76-e99a-4d7e-8cc3-b2e395dd4d04 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:18.222998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35437b76-e99a-4d7e-8cc3-b2e395dd4d04 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:18.224990 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35437b76-e99a-4d7e-8cc3-b2e395dd4d04 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-35437b76-e99a-4d7e-8cc3-b2e395dd4d04 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:18.236213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:18.237195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:18.238142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:18.238142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:18.238142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:18.238142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:18.238142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:18.238142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:18.238142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:18.238142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:18.238142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 01 14:09:18.238142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:18.238142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 328/658] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:18 2022] GET /identity/v3/users/neutron => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:18.239895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35437b76-e99a-4d7e-8cc3-b2e395dd4d04 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:18.256862 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e125ed5-41ee-428b-9b38-bb8747725b58 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:18.293505 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab182af6-de01-41e6-bfab-ecd87fc97bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:18.294126 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab182af6-de01-41e6-bfab-ecd87fc97bb6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:18.294412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab182af6-de01-41e6-bfab-ecd87fc97bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:18.294720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab182af6-de01-41e6-bfab-ecd87fc97bb6 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:18.295416 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab182af6-de01-41e6-bfab-ecd87fc97bb6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:18.295718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab182af6-de01-41e6-bfab-ecd87fc97bb6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:18.297090 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab182af6-de01-41e6-bfab-ecd87fc97bb6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:18.310041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 331/659] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:18.311301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5a65b-1a0d-4222-a5fb-3fadc16b8859 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:18.311589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5a65b-1a0d-4222-a5fb-3fadc16b8859 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:18.311864 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d5a65b-1a0d-4222-a5fb-3fadc16b8859 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:18.313225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 332/660] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:18 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:18.313754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5a65b-1a0d-4222-a5fb-3fadc16b8859 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:18.362674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35437b76-e99a-4d7e-8cc3-b2e395dd4d04 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:18.397273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5c15c-645a-45ca-a88b-73463a5dd5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:18.397889 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5c15c-645a-45ca-a88b-73463a5dd5df None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:18.398171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5c15c-645a-45ca-a88b-73463a5dd5df None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:18.398441 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e5c15c-645a-45ca-a88b-73463a5dd5df None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:18.399262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5c15c-645a-45ca-a88b-73463a5dd5df None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:18.399575 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5c15c-645a-45ca-a88b-73463a5dd5df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:18.401014 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e5c15c-645a-45ca-a88b-73463a5dd5df None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:18.414386 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:18.422268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 329/661] 10.222.0.70 () {56 vars in 1137 bytes} [Mon Aug 1 14:09:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:18.423147 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5c15c-645a-45ca-a88b-73463a5dd5df None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:18.431806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d5a65b-1a0d-4222-a5fb-3fadc16b8859 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:18.440527 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:18.470915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6776e07d-6423-42a8-ba12-0236b86b9685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:18.471451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776e07d-6423-42a8-ba12-0236b86b9685 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:18.471733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776e07d-6423-42a8-ba12-0236b86b9685 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:18.472007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6776e07d-6423-42a8-ba12-0236b86b9685 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:18.472826 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776e07d-6423-42a8-ba12-0236b86b9685 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:18.473132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776e07d-6423-42a8-ba12-0236b86b9685 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:18.475117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6776e07d-6423-42a8-ba12-0236b86b9685 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:18.494553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 333/662] 10.222.0.70 () {56 vars in 1139 bytes} [Mon Aug 1 14:09:18 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:18.500456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d69bb-f205-4c69-9066-dfa07f224803 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:18.501606 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d69bb-f205-4c69-9066-dfa07f224803 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:18.501994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5d69bb-f205-4c69-9066-dfa07f224803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:18.521295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-af5d69bb-f205-4c69-9066-dfa07f224803 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:18.522720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-af5d69bb-f205-4c69-9066-dfa07f224803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:18.531361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e5c15c-645a-45ca-a88b-73463a5dd5df None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:18.565925 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562b0f1-e15d-44e3-ad1f-33568c82b836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:18.566764 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562b0f1-e15d-44e3-ad1f-33568c82b836 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:18.567115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562b0f1-e15d-44e3-ad1f-33568c82b836 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:18.567483 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4562b0f1-e15d-44e3-ad1f-33568c82b836 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:18.574514 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562b0f1-e15d-44e3-ad1f-33568c82b836 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:18.576005 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4562b0f1-e15d-44e3-ad1f-33568c82b836 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:18.588237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-4562b0f1-e15d-44e3-ad1f-33568c82b836 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:18.588237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:18.588237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:18.588237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:18.588237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:18.588237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:18.588237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:18.588237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:18.588237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:18.588237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:18.588237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:18.588237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:18.588237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:18.588237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:18.588237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:18.594049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:18.595241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:18.595241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:18.595241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:18.595241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:18.595241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:18.595241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:18.595241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:18.595241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:18.595241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 330/663] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:18.595241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562b0f1-e15d-44e3-ad1f-33568c82b836 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:18.606613 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 334/664] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:18.606613 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d69bb-f205-4c69-9066-dfa07f224803 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:18.684383 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:18.698157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:18.714493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4562b0f1-e15d-44e3-ad1f-33568c82b836 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:18.720995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5d69bb-f205-4c69-9066-dfa07f224803 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:18.750025 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b91a62-156b-4427-8059-5ab0e38ba14f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:18.750767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b91a62-156b-4427-8059-5ab0e38ba14f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:18.751042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b91a62-156b-4427-8059-5ab0e38ba14f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:18.751310 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b91a62-156b-4427-8059-5ab0e38ba14f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:18.756393 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085ed87-f61a-436a-9784-b2b41b04114b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:18.757158 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085ed87-f61a-436a-9784-b2b41b04114b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:18.757538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085ed87-f61a-436a-9784-b2b41b04114b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:18.757914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085ed87-f61a-436a-9784-b2b41b04114b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:18.822246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b91a62-156b-4427-8059-5ab0e38ba14f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:18.823856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b91a62-156b-4427-8059-5ab0e38ba14f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:18.825005 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085ed87-f61a-436a-9784-b2b41b04114b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:18.826555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d085ed87-f61a-436a-9784-b2b41b04114b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:18.901167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:18.907195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:18.935914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 335/665] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:18.935914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085ed87-f61a-436a-9784-b2b41b04114b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:18.936209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 331/666] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:18.936209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b91a62-156b-4427-8059-5ab0e38ba14f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:19.047983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d085ed87-f61a-436a-9784-b2b41b04114b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:19.049754 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b91a62-156b-4427-8059-5ab0e38ba14f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:19.084076 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661443f-b580-42f1-8db1-490e47e417b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:19.084801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661443f-b580-42f1-8db1-490e47e417b0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:19.085149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661443f-b580-42f1-8db1-490e47e417b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:19.085484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d661443f-b580-42f1-8db1-490e47e417b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:19.086324 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661443f-b580-42f1-8db1-490e47e417b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:19.086733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661443f-b580-42f1-8db1-490e47e417b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:19.088485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d661443f-b580-42f1-8db1-490e47e417b0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:19.090171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30d60d-1b18-43f8-ae97-25cfa0892ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:19.090913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30d60d-1b18-43f8-ae97-25cfa0892ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:19.091405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30d60d-1b18-43f8-ae97-25cfa0892ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:19.091729 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be30d60d-1b18-43f8-ae97-25cfa0892ab2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:19.106128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 336/667] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:19.106128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661443f-b580-42f1-8db1-490e47e417b0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:19.107959 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be30d60d-1b18-43f8-ae97-25cfa0892ab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-be30d60d-1b18-43f8-ae97-25cfa0892ab2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:19.113062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:19.114183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:19.120387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:19.120387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:19.120387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:19.120387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:19.120387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:19.120387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:19.120387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:19.120387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:19.120387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:19.120387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:19.120387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:19.120387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:19.120387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 332/668] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:19.120387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30d60d-1b18-43f8-ae97-25cfa0892ab2 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:19.152436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:19.156102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:19.218753 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d661443f-b580-42f1-8db1-490e47e417b0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:19.228451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be30d60d-1b18-43f8-ae97-25cfa0892ab2 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:19.253081 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a2c2f-bb80-4c3c-8d76-c34ae784ab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:19.253639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a2c2f-bb80-4c3c-8d76-c34ae784ab8d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:19.253921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a2c2f-bb80-4c3c-8d76-c34ae784ab8d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:19.254185 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9a2c2f-bb80-4c3c-8d76-c34ae784ab8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:19.265312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a2c2f-bb80-4c3c-8d76-c34ae784ab8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:19.265610 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1529c6-cc8a-4f4b-8c4e-4dc388b24ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:19.266249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1529c6-cc8a-4f4b-8c4e-4dc388b24ed6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:19.266533 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1529c6-cc8a-4f4b-8c4e-4dc388b24ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:19.266794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9a2c2f-bb80-4c3c-8d76-c34ae784ab8d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:19.266892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1529c6-cc8a-4f4b-8c4e-4dc388b24ed6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:19.278041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1529c6-cc8a-4f4b-8c4e-4dc388b24ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:19.279521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1529c6-cc8a-4f4b-8c4e-4dc388b24ed6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:19.281121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-de9a2c2f-bb80-4c3c-8d76-c34ae784ab8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:19.281121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:19.281121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:19.281121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:19.281121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:19.281121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:19.281121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:19.281121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:19.281121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:19.281121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:19.281121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:19.281121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:19.281121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:19.281121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:19.281121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:19.282174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:19.283314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:19.283314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:19.283314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:19.283314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:19.283314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 337/669] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:19.287569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a2c2f-bb80-4c3c-8d76-c34ae784ab8d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:19.299435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-be1529c6-cc8a-4f4b-8c4e-4dc388b24ed6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:19.299435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:19.299435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:19.299435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:19.299435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:19.299435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:19.299435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:19.299435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:19.299435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:19.299435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:19.299435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:19.299435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:19.299435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:19.299435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:19.299435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:19.300554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:19.302159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:19.302159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:19.302159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:19.302159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:19.302721 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 333/670] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:19.303638 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1529c6-cc8a-4f4b-8c4e-4dc388b24ed6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:19.389989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:19.390216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:19.401557 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9a2c2f-bb80-4c3c-8d76-c34ae784ab8d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:19.406500 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1529c6-cc8a-4f4b-8c4e-4dc388b24ed6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:19.440179 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9e2c-3190-4b5a-8c3b-c78609df7f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:19.440798 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9e2c-3190-4b5a-8c3b-c78609df7f4b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:19.441076 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9e2c-3190-4b5a-8c3b-c78609df7f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:19.441349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6c9e2c-3190-4b5a-8c3b-c78609df7f4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:19.441911 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87351646-a7fd-4e11-afe6-a2c2d0e60bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:19.442127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c9e2c-3190-4b5a-8c3b-c78609df7f4b None admin] RBAC: Adding query filter params (role.id=7db30e557e5b4d789838af5eb5985bf5, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=bcc213ef64924074bd16152228913ef1) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:19.443089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c9e2c-3190-4b5a-8c3b-c78609df7f4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:19.443209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87351646-a7fd-4e11-afe6-a2c2d0e60bde None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:19.443474 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87351646-a7fd-4e11-afe6-a2c2d0e60bde None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:19.443741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87351646-a7fd-4e11-afe6-a2c2d0e60bde None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:19.444443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87351646-a7fd-4e11-afe6-a2c2d0e60bde None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:19.444549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6c9e2c-3190-4b5a-8c3b-c78609df7f4b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:19.444742 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87351646-a7fd-4e11-afe6-a2c2d0e60bde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:19.446197 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87351646-a7fd-4e11-afe6-a2c2d0e60bde None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:19.459599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 338/671] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:19 2022] GET /identity/v3/role_assignments?user.id=bcc213ef64924074bd16152228913ef1&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=7db30e557e5b4d789838af5eb5985bf5 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:19.459599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9e2c-3190-4b5a-8c3b-c78609df7f4b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:19.468142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 334/672] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:19.469062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87351646-a7fd-4e11-afe6-a2c2d0e60bde None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:19.590902 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87351646-a7fd-4e11-afe6-a2c2d0e60bde None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:19.603673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6c9e2c-3190-4b5a-8c3b-c78609df7f4b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:19.631852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad029224-67d0-4908-9948-dc052bfed5f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:19.632513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad029224-67d0-4908-9948-dc052bfed5f7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:19.632792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad029224-67d0-4908-9948-dc052bfed5f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:19.633061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad029224-67d0-4908-9948-dc052bfed5f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:19.633750 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad029224-67d0-4908-9948-dc052bfed5f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:19.634049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad029224-67d0-4908-9948-dc052bfed5f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:19.636395 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad029224-67d0-4908-9948-dc052bfed5f7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:19.649025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16fc08-4d12-4092-b7f4-d3654c7c6b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:19.649572 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 335/673] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:19.650154 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16fc08-4d12-4092-b7f4-d3654c7c6b07 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:19.650459 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad029224-67d0-4908-9948-dc052bfed5f7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:19.650567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16fc08-4d12-4092-b7f4-d3654c7c6b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:19.650779 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb16fc08-4d12-4092-b7f4-d3654c7c6b07 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:19.651475 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16fc08-4d12-4092-b7f4-d3654c7c6b07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:19.651782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16fc08-4d12-4092-b7f4-d3654c7c6b07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:19.653148 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb16fc08-4d12-4092-b7f4-d3654c7c6b07 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:19.661860 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:19.672190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 339/674] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:19.673124 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16fc08-4d12-4092-b7f4-d3654c7c6b07 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:19.690715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:19.776018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad029224-67d0-4908-9948-dc052bfed5f7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:19.813385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa1681-83d2-41a7-8235-3e167a9620a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:19.814244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa1681-83d2-41a7-8235-3e167a9620a2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:19.814527 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa1681-83d2-41a7-8235-3e167a9620a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:19.814827 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa1681-83d2-41a7-8235-3e167a9620a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:19.829119 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb16fc08-4d12-4092-b7f4-d3654c7c6b07 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:19.831557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa1681-83d2-41a7-8235-3e167a9620a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:19.833617 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa1681-83d2-41a7-8235-3e167a9620a2 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:19.851064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-b0aa1681-83d2-41a7-8235-3e167a9620a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:19.851064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:19.851064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:19.851064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:19.851064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:19.851064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:19.851064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:19.851064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:19.851064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:19.851064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:19.851064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:19.851064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:19.851064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:19.851064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:19.851064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:19.852417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:19.853826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:19.853826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:19.853826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:19.853826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:19.853826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 336/675] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:19.853826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa1681-83d2-41a7-8235-3e167a9620a2 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:19.890029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bf2db-f342-49c3-838b-ede1a64e443f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:19.891121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bf2db-f342-49c3-838b-ede1a64e443f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:19.891554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bf2db-f342-49c3-838b-ede1a64e443f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:19.891994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bf2db-f342-49c3-838b-ede1a64e443f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:19.901833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bf2db-f342-49c3-838b-ede1a64e443f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:19.903878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1bf2db-f342-49c3-838b-ede1a64e443f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:19.920398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:19.921816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8b1bf2db-f342-49c3-838b-ede1a64e443f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:19.921816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:19.921816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:19.921816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:19.921816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:19.921816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:19.921816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:19.921816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:19.921816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:19.921816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:19.921816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:19.921816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:19.921816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:19.921816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:19.921816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:19.923115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:19.924382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:19.924382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:19.924382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:19.924382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:19.924382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:19.924382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:19.924382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:19.924382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:19.924382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 340/676] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:19.924869 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bf2db-f342-49c3-838b-ede1a64e443f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:19.972163 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa1681-83d2-41a7-8235-3e167a9620a2 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:20.014808 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e37bc-2690-4e0e-aa2a-1df279e83af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:20.015828 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e37bc-2690-4e0e-aa2a-1df279e83af4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:20.016109 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e37bc-2690-4e0e-aa2a-1df279e83af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:20.016381 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472e37bc-2690-4e0e-aa2a-1df279e83af4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:20.023955 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e37bc-2690-4e0e-aa2a-1df279e83af4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:20.025458 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472e37bc-2690-4e0e-aa2a-1df279e83af4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:20.031847 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:20.039783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-472e37bc-2690-4e0e-aa2a-1df279e83af4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:20.039783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:20.039783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:20.039783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:20.039783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:20.039783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:20.039783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:20.039783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:20.039783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:20.039783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:20.039783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:20.039783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:20.039783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:20.039783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:20.039783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:20.040690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:20.041580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:20.041580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:20.041580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:20.041580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:20.041580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:20.041580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:20.041580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:20.041580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:20.042455 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 337/677] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:20.043021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e37bc-2690-4e0e-aa2a-1df279e83af4 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:20.060823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1bf2db-f342-49c3-838b-ede1a64e443f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:20.101049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d72082-3f2f-4b43-8383-21822a30e63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:20.101724 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d72082-3f2f-4b43-8383-21822a30e63a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:20.101947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d72082-3f2f-4b43-8383-21822a30e63a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:20.102215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d72082-3f2f-4b43-8383-21822a30e63a None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:20.102929 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d72082-3f2f-4b43-8383-21822a30e63a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:20.103227 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d72082-3f2f-4b43-8383-21822a30e63a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:20.104582 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d72082-3f2f-4b43-8383-21822a30e63a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:20.117408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 341/678] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:20.120188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeade66-7d8d-47f0-b97c-6c487d75ba0a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:20.120689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeade66-7d8d-47f0-b97c-6c487d75ba0a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:20.121186 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeade66-7d8d-47f0-b97c-6c487d75ba0a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:20.123420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 342/679] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:20.124695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeade66-7d8d-47f0-b97c-6c487d75ba0a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:20.162141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472e37bc-2690-4e0e-aa2a-1df279e83af4 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:20.184923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:20.202893 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4abfb2-4362-4411-a91c-1a26dfbf8675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:20.204282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4abfb2-4362-4411-a91c-1a26dfbf8675 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:20.204567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4abfb2-4362-4411-a91c-1a26dfbf8675 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:20.204851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4abfb2-4362-4411-a91c-1a26dfbf8675 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:20.205592 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4abfb2-4362-4411-a91c-1a26dfbf8675 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:20.205900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4abfb2-4362-4411-a91c-1a26dfbf8675 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:20.207386 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4abfb2-4362-4411-a91c-1a26dfbf8675 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:20.229352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 338/680] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:20.229352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4abfb2-4362-4411-a91c-1a26dfbf8675 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:20.235580 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeade66-7d8d-47f0-b97c-6c487d75ba0a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:20.274224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287e2cb5-a9a1-4c16-926e-dd5fdc76dd2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:20.275186 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e2cb5-a9a1-4c16-926e-dd5fdc76dd2b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:20.275466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e2cb5-a9a1-4c16-926e-dd5fdc76dd2b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:20.275740 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287e2cb5-a9a1-4c16-926e-dd5fdc76dd2b None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:20.276644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e2cb5-a9a1-4c16-926e-dd5fdc76dd2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:20.277329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e2cb5-a9a1-4c16-926e-dd5fdc76dd2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:20.278787 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287e2cb5-a9a1-4c16-926e-dd5fdc76dd2b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:20.280463 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:20.297586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 343/681] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:20.297586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d2dd1-dd25-4d5c-8b36-287f5ab9af3b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:20.297586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d2dd1-dd25-4d5c-8b36-287f5ab9af3b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:20.297586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d2dd1-dd25-4d5c-8b36-287f5ab9af3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:20.313427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3e1d2dd1-dd25-4d5c-8b36-287f5ab9af3b None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:20.314647 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3e1d2dd1-dd25-4d5c-8b36-287f5ab9af3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:20.338998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4abfb2-4362-4411-a91c-1a26dfbf8675 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:20.376239 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da3438-b42a-427b-88e0-dc63ce1af78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:20.377016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da3438-b42a-427b-88e0-dc63ce1af78a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:20.377305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da3438-b42a-427b-88e0-dc63ce1af78a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:20.377697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02da3438-b42a-427b-88e0-dc63ce1af78a None admin] PATH_INFO: `/v3/users/swift` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:20.382623 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 344/682] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:20.385586 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da3438-b42a-427b-88e0-dc63ce1af78a None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:20.387079 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02da3438-b42a-427b-88e0-dc63ce1af78a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:20.391296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d2dd1-dd25-4d5c-8b36-287f5ab9af3b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-02da3438-b42a-427b-88e0-dc63ce1af78a None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:20.400008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:20.401046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:20.401994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:20.401994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:20.401994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:20.401994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:20.401994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:20.401994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:20.401994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:20.401994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:20.401994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:09:20.401994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:20.401994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 339/683] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:09:20 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:20.402624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da3438-b42a-427b-88e0-dc63ce1af78a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:20.445148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:20.505456 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02da3438-b42a-427b-88e0-dc63ce1af78a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:20.509678 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d2dd1-dd25-4d5c-8b36-287f5ab9af3b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:20.537836 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:20.542038 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f911ea8-5ae0-4e38-be03-0918a376e0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:20.542807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f911ea8-5ae0-4e38-be03-0918a376e0ac None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:20.543022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f911ea8-5ae0-4e38-be03-0918a376e0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:20.543290 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f911ea8-5ae0-4e38-be03-0918a376e0ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:20.544062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f911ea8-5ae0-4e38-be03-0918a376e0ac None admin] RBAC: Adding query filter params (role.id=7db30e557e5b4d789838af5eb5985bf5, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=33fcc673845943fc96bc18f011639716) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:20.544363 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f911ea8-5ae0-4e38-be03-0918a376e0ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:20.545788 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f911ea8-5ae0-4e38-be03-0918a376e0ac None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:20.549906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337b670-ca2d-4cdb-8ef3-3a669bb38284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:20.550517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337b670-ca2d-4cdb-8ef3-3a669bb38284 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:20.550836 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337b670-ca2d-4cdb-8ef3-3a669bb38284 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:20.551156 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e337b670-ca2d-4cdb-8ef3-3a669bb38284 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:20.558940 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 340/684] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:20 2022] GET /identity/v3/role_assignments?user.id=33fcc673845943fc96bc18f011639716&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=7db30e557e5b4d789838af5eb5985bf5 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:20.559162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337b670-ca2d-4cdb-8ef3-3a669bb38284 None admin] RBAC: Adding query filter params (role.id=7db30e557e5b4d789838af5eb5985bf5, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=a41da5d6d38341deaf1563fe0ebac32b) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:20.559162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337b670-ca2d-4cdb-8ef3-3a669bb38284 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:20.559308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f911ea8-5ae0-4e38-be03-0918a376e0ac None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:20.559380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e337b670-ca2d-4cdb-8ef3-3a669bb38284 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:20.560784 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 345/685] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:20 2022] GET /identity/v3/role_assignments?user.id=a41da5d6d38341deaf1563fe0ebac32b&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=7db30e557e5b4d789838af5eb5985bf5 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:20.560913 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337b670-ca2d-4cdb-8ef3-3a669bb38284 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:20.772380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e337b670-ca2d-4cdb-8ef3-3a669bb38284 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:20.773000 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f911ea8-5ae0-4e38-be03-0918a376e0ac None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:20.778053 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:20.819294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586590e-575b-4abc-8dfb-fa84c19521f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:20.819857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c20ea-9fac-4b2c-a8b7-7213dec2a5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:20.819981 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586590e-575b-4abc-8dfb-fa84c19521f6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:20.820182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586590e-575b-4abc-8dfb-fa84c19521f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:20.820452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d586590e-575b-4abc-8dfb-fa84c19521f6 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:20.820552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c20ea-9fac-4b2c-a8b7-7213dec2a5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:20.820781 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c20ea-9fac-4b2c-a8b7-7213dec2a5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:20.821049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0c20ea-9fac-4b2c-a8b7-7213dec2a5f5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:20.821241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586590e-575b-4abc-8dfb-fa84c19521f6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:20.821543 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586590e-575b-4abc-8dfb-fa84c19521f6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:20.823879 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d586590e-575b-4abc-8dfb-fa84c19521f6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:20.837027 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c0c20ea-9fac-4b2c-a8b7-7213dec2a5f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-4c0c20ea-9fac-4b2c-a8b7-7213dec2a5f5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:20.844257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:20.845181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:20.846440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:20.846440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:20.846440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:20.846440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:20.846440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:20.846440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:20.846440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:20.846440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:20.846440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:20.846440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:20.846440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:09:20.846440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:20.846440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 346/686] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:09:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:20.849263 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 341/687] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Aug 1 14:09:20 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:20.851422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c20ea-9fac-4b2c-a8b7-7213dec2a5f5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:20.855100 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586590e-575b-4abc-8dfb-fa84c19521f6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:20.920318 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:20.993465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c0c20ea-9fac-4b2c-a8b7-7213dec2a5f5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:20.996768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d586590e-575b-4abc-8dfb-fa84c19521f6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:21.031904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce2717-3b5f-47f7-bb77-0c1ac6ff8596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:21.032917 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce2717-3b5f-47f7-bb77-0c1ac6ff8596 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:21.033340 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce2717-3b5f-47f7-bb77-0c1ac6ff8596 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:21.033746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bce2717-3b5f-47f7-bb77-0c1ac6ff8596 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:21.034256 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652eb63-e3b8-44b9-bb65-c2d80fe384f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:21.034908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce2717-3b5f-47f7-bb77-0c1ac6ff8596 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:21.035122 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652eb63-e3b8-44b9-bb65-c2d80fe384f6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:21.035500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce2717-3b5f-47f7-bb77-0c1ac6ff8596 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:21.035626 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652eb63-e3b8-44b9-bb65-c2d80fe384f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:21.035972 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7652eb63-e3b8-44b9-bb65-c2d80fe384f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:21.037308 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bce2717-3b5f-47f7-bb77-0c1ac6ff8596 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:21.046874 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 347/688] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:09:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:21.053603 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce2717-3b5f-47f7-bb77-0c1ac6ff8596 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:21.108296 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:21.190364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bce2717-3b5f-47f7-bb77-0c1ac6ff8596 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:21.208975 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652eb63-e3b8-44b9-bb65-c2d80fe384f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:21.211128 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7652eb63-e3b8-44b9-bb65-c2d80fe384f6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:21.214571 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:21.290209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801e7b6-8537-4c48-a33a-d05c3f5fd030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:21.290885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801e7b6-8537-4c48-a33a-d05c3f5fd030 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:21.291230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801e7b6-8537-4c48-a33a-d05c3f5fd030 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:21.291428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7801e7b6-8537-4c48-a33a-d05c3f5fd030 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:21.315917 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801e7b6-8537-4c48-a33a-d05c3f5fd030 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:21.317947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7801e7b6-8537-4c48-a33a-d05c3f5fd030 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:21.330037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 342/689] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 01 14:09:21.337041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652eb63-e3b8-44b9-bb65-c2d80fe384f6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:21.352572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-7801e7b6-8537-4c48-a33a-d05c3f5fd030 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:21.352572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:21.352572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:21.352572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:21.352572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:21.352572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:21.352572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:21.352572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:21.352572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:21.352572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:21.352572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:21.352572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:21.352572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:21.352572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:21.352572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:21.353707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:21.354861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:21.354861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:21.354861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:21.354861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:21.358780 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 348/690] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:21.364116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801e7b6-8537-4c48-a33a-d05c3f5fd030 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:21.426067 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:21.500291 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7801e7b6-8537-4c48-a33a-d05c3f5fd030 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:21.521722 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7652eb63-e3b8-44b9-bb65-c2d80fe384f6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:21.537529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8090f7c-580e-4eb8-86a3-082c41a067a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:21.538161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8090f7c-580e-4eb8-86a3-082c41a067a4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:21.538450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8090f7c-580e-4eb8-86a3-082c41a067a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:21.538761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8090f7c-580e-4eb8-86a3-082c41a067a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:21.539466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8090f7c-580e-4eb8-86a3-082c41a067a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:21.539776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8090f7c-580e-4eb8-86a3-082c41a067a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:21.541305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8090f7c-580e-4eb8-86a3-082c41a067a4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:21.555269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 349/691] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:21.560337 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8090f7c-580e-4eb8-86a3-082c41a067a4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:21.606109 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:21.606295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195101a8-ddf7-4a96-a492-1d4ab97f5ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:21.607207 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195101a8-ddf7-4a96-a492-1d4ab97f5ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:21.607207 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195101a8-ddf7-4a96-a492-1d4ab97f5ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:21.607486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195101a8-ddf7-4a96-a492-1d4ab97f5ee5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:21.619269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195101a8-ddf7-4a96-a492-1d4ab97f5ee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:21.621288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195101a8-ddf7-4a96-a492-1d4ab97f5ee5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:21.637227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-195101a8-ddf7-4a96-a492-1d4ab97f5ee5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:21.637227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:21.637227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:21.637227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:21.637227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:21.637227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:21.637227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:21.637227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:21.637227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:21.637227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:21.637227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:21.637227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:21.637227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:21.637227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:21.637227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:21.638135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:21.639498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:21.639498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:21.639498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:21.639498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:21.639498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 343/692] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:21.644906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195101a8-ddf7-4a96-a492-1d4ab97f5ee5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:21.749099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8090f7c-580e-4eb8-86a3-082c41a067a4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:21.789033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51d800-5a26-4c45-a348-306ca868defd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:21.789678 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51d800-5a26-4c45-a348-306ca868defd None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:21.789959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51d800-5a26-4c45-a348-306ca868defd None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:21.790231 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51d800-5a26-4c45-a348-306ca868defd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:21.802261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51d800-5a26-4c45-a348-306ca868defd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:21.803677 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e51d800-5a26-4c45-a348-306ca868defd None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8e51d800-5a26-4c45-a348-306ca868defd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:21.820856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:21.821821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:21.823411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:21.823411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:21.823411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:21.823411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:21.823411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:21.823411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:21.823411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:21.823411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:21.823411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:09:21.823411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:21.823411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 350/693] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 1 14:09:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:21.831559 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51d800-5a26-4c45-a348-306ca868defd None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:21.832505 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195101a8-ddf7-4a96-a492-1d4ab97f5ee5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:21.850952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:21.869784 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2350e-ace9-49d5-8cd0-d30ad7de9085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:21.870817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2350e-ace9-49d5-8cd0-d30ad7de9085 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:21.871315 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2350e-ace9-49d5-8cd0-d30ad7de9085 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:21.871832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff2350e-ace9-49d5-8cd0-d30ad7de9085 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:21.872731 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2350e-ace9-49d5-8cd0-d30ad7de9085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:21.873239 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2350e-ace9-49d5-8cd0-d30ad7de9085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:21.874978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff2350e-ace9-49d5-8cd0-d30ad7de9085 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:21.889179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 344/694] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:21.899834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2350e-ace9-49d5-8cd0-d30ad7de9085 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:21.972133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:21.998080 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e51d800-5a26-4c45-a348-306ca868defd None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:22.044418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cc0562-4c11-4dd4-adbb-043c0e9084f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:22.045296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc0562-4c11-4dd4-adbb-043c0e9084f7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:22.045637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc0562-4c11-4dd4-adbb-043c0e9084f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:22.045921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cc0562-4c11-4dd4-adbb-043c0e9084f7 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:22.047144 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc0562-4c11-4dd4-adbb-043c0e9084f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:22.047456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc0562-4c11-4dd4-adbb-043c0e9084f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:22.048904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cc0562-4c11-4dd4-adbb-043c0e9084f7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:22.069427 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff2350e-ace9-49d5-8cd0-d30ad7de9085 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:22.069754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 351/695] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 1 14:09:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:22.071271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3b7a-082a-455f-9b1d-ce205313fe6f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:22.071771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3b7a-082a-455f-9b1d-ce205313fe6f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:22.072241 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909f3b7a-082a-455f-9b1d-ce205313fe6f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:22.077811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 352/696] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:22.078811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3b7a-082a-455f-9b1d-ce205313fe6f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:22.116789 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85da15cd-a062-41a9-9af4-82fd7351c9db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:22.117602 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da15cd-a062-41a9-9af4-82fd7351c9db None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:22.117889 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da15cd-a062-41a9-9af4-82fd7351c9db None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:22.118166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85da15cd-a062-41a9-9af4-82fd7351c9db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:22.126819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da15cd-a062-41a9-9af4-82fd7351c9db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:22.128663 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85da15cd-a062-41a9-9af4-82fd7351c9db None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:22.143970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-85da15cd-a062-41a9-9af4-82fd7351c9db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:22.143970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:22.143970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:22.143970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:22.143970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:22.143970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:22.143970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:22.143970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:22.143970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:22.143970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:22.143970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:22.143970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:22.143970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:22.143970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:22.143970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:22.144855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:22.146404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:22.146404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:22.146404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:22.146404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:22.146404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:22.146404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:22.146404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:22.146404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:22.146404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 345/697] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:22.146939 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c1f39-c5b0-4d67-96d9-572091372d7f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:22.146939 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c1f39-c5b0-4d67-96d9-572091372d7f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:22.147266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2c1f39-c5b0-4d67-96d9-572091372d7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:22.169537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-3c2c1f39-c5b0-4d67-96d9-572091372d7f None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:22.171041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3c2c1f39-c5b0-4d67-96d9-572091372d7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:22.192968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909f3b7a-082a-455f-9b1d-ce205313fe6f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:22.205184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:22.231656 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b9c81-c134-4c77-8cec-cbd720a86cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:22.232629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b9c81-c134-4c77-8cec-cbd720a86cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:22.233144 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b9c81-c134-4c77-8cec-cbd720a86cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:22.233618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83b9c81-c134-4c77-8cec-cbd720a86cc1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:22.245142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:22.258597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 346/698] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:22.258597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c1f39-c5b0-4d67-96d9-572091372d7f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:22.339605 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b9c81-c134-4c77-8cec-cbd720a86cc1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:22.342297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83b9c81-c134-4c77-8cec-cbd720a86cc1 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:22.371883 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2c1f39-c5b0-4d67-96d9-572091372d7f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:22.416054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d431d68-c543-4ecd-800c-15ca0d4fd26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:22.416746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d431d68-c543-4ecd-800c-15ca0d4fd26c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:22.417018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d431d68-c543-4ecd-800c-15ca0d4fd26c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:22.417297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d431d68-c543-4ecd-800c-15ca0d4fd26c None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:22.418550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d431d68-c543-4ecd-800c-15ca0d4fd26c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:22.418892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d431d68-c543-4ecd-800c-15ca0d4fd26c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:22.420632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d431d68-c543-4ecd-800c-15ca0d4fd26c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:22.436215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 347/699] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:22.437073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d431d68-c543-4ecd-800c-15ca0d4fd26c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:22.470095 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:22.475330 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 353/700] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:22.476660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b9c81-c134-4c77-8cec-cbd720a86cc1 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:22.533356 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:22.571017 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d431d68-c543-4ecd-800c-15ca0d4fd26c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:22.611200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83b9c81-c134-4c77-8cec-cbd720a86cc1 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:22.616429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee1967-f4fe-40f6-90be-19f3722edb77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:22.617347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee1967-f4fe-40f6-90be-19f3722edb77 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:22.617863 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee1967-f4fe-40f6-90be-19f3722edb77 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:22.618339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ee1967-f4fe-40f6-90be-19f3722edb77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:22.634043 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee1967-f4fe-40f6-90be-19f3722edb77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:22.636468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ee1967-f4fe-40f6-90be-19f3722edb77 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:22.654154 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b495f3-799a-4b01-828a-07bb388741c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:22.655136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b495f3-799a-4b01-828a-07bb388741c5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:22.655691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b495f3-799a-4b01-828a-07bb388741c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:22.656163 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b495f3-799a-4b01-828a-07bb388741c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:22.656847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-15ee1967-f4fe-40f6-90be-19f3722edb77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:22.656847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:22.656847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:22.656847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:22.656847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:22.656847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:22.656847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:22.656847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:22.656847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:22.656847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:22.656847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:22.656847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:22.656847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:22.656847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:22.656847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:22.657762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:22.658719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:22.658719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:22.658719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:22.658719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:22.659716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b495f3-799a-4b01-828a-07bb388741c5 None admin] RBAC: Adding query filter params (role.id=7db30e557e5b4d789838af5eb5985bf5, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=98cccf60a5424986b2e92b523542a640) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:22.660234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b495f3-799a-4b01-828a-07bb388741c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:22.661962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b495f3-799a-4b01-828a-07bb388741c5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:22.662721 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 348/701] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:22.663622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee1967-f4fe-40f6-90be-19f3722edb77 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:22.669738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 354/702] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:22 2022] GET /identity/v3/role_assignments?user.id=98cccf60a5424986b2e92b523542a640&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=7db30e557e5b4d789838af5eb5985bf5 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:22.670883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b495f3-799a-4b01-828a-07bb388741c5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:22.782462 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:22.807100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b495f3-799a-4b01-828a-07bb388741c5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:22.812382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:22.828652 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ee1967-f4fe-40f6-90be-19f3722edb77 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:22.866931 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43699771-783d-4c8c-ba23-c87d1d368cad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:22.867501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43699771-783d-4c8c-ba23-c87d1d368cad None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:22.867774 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43699771-783d-4c8c-ba23-c87d1d368cad None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:22.868041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43699771-783d-4c8c-ba23-c87d1d368cad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:22.872648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc0c72d-f687-44fd-9b7f-9842fafbc540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:22.873391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0c72d-f687-44fd-9b7f-9842fafbc540 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:22.873779 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0c72d-f687-44fd-9b7f-9842fafbc540 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:22.874159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc0c72d-f687-44fd-9b7f-9842fafbc540 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:22.875006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0c72d-f687-44fd-9b7f-9842fafbc540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:22.875416 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0c72d-f687-44fd-9b7f-9842fafbc540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:22.877013 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc0c72d-f687-44fd-9b7f-9842fafbc540 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:22.880547 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43699771-783d-4c8c-ba23-c87d1d368cad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:22.882177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43699771-783d-4c8c-ba23-c87d1d368cad None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:22.892989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 355/703] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:22.898599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c511c-222a-49a5-98f2-f15664a86f6d None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:22.898923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-43699771-783d-4c8c-ba23-c87d1d368cad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:22.898923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:22.898923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:22.898923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:22.898923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:22.898923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:22.898923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:22.898923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:22.898923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:22.898923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:22.898923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:22.898923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:22.898923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:22.898923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:22.898923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:22.899831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:22.900763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:22.900763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:22.900763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:22.900763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:22.900763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 349/704] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:22.901419 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c511c-222a-49a5-98f2-f15664a86f6d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:22.901706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c511c-222a-49a5-98f2-f15664a86f6d None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:22.903204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 356/705] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:22.904919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43699771-783d-4c8c-ba23-c87d1d368cad None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:22.909698 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a5ec5-f65a-4d50-b2eb-4629520da73c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:22.909844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a5ec5-f65a-4d50-b2eb-4629520da73c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:22.910232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9a5ec5-f65a-4d50-b2eb-4629520da73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:22.935529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5a9a5ec5-f65a-4d50-b2eb-4629520da73c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:22.937486 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5a9a5ec5-f65a-4d50-b2eb-4629520da73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:23.028001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 357/706] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:23.028856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a5ec5-f65a-4d50-b2eb-4629520da73c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:23.032674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43699771-783d-4c8c-ba23-c87d1d368cad None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:23.068666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:23.076855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befba443-5b1c-41ac-a173-dbca302db3b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:23.077474 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befba443-5b1c-41ac-a173-dbca302db3b7 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:23.077751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befba443-5b1c-41ac-a173-dbca302db3b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:23.078021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befba443-5b1c-41ac-a173-dbca302db3b7 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:23.078712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befba443-5b1c-41ac-a173-dbca302db3b7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:23.080152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befba443-5b1c-41ac-a173-dbca302db3b7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:23.102508 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 350/707] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:09:22 2022] POST /identity/v3/users => generated 254 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:09:23.104081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcdf70-ecb8-4f0b-a3be-66d5943cceb1 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:23.104568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcdf70-ecb8-4f0b-a3be-66d5943cceb1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:23.105021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcdf70-ecb8-4f0b-a3be-66d5943cceb1 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:23.106447 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 351/708] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:23.107037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcdf70-ecb8-4f0b-a3be-66d5943cceb1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:23.141757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:23.153504 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9a5ec5-f65a-4d50-b2eb-4629520da73c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:23.211472 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fce163-84e2-4145-9bbb-de2e3f00093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:23.213719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fce163-84e2-4145-9bbb-de2e3f00093c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:23.214224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fce163-84e2-4145-9bbb-de2e3f00093c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:23.215377 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fce163-84e2-4145-9bbb-de2e3f00093c None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:23.216618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fce163-84e2-4145-9bbb-de2e3f00093c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:23.217324 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fce163-84e2-4145-9bbb-de2e3f00093c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:23.219223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fce163-84e2-4145-9bbb-de2e3f00093c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:23.237364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 358/709] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:23.239717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e7d68-f94d-4330-9491-26ba1cb73dae None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:23.240181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e7d68-f94d-4330-9491-26ba1cb73dae None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:23.240620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3e7d68-f94d-4330-9491-26ba1cb73dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:23.249690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcdf70-ecb8-4f0b-a3be-66d5943cceb1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:23.265744 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8e3e7d68-f94d-4330-9491-26ba1cb73dae None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:23.268066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8e3e7d68-f94d-4330-9491-26ba1cb73dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:23.295338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb6720-11c4-4e4c-b12a-990614082544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:23.296632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb6720-11c4-4e4c-b12a-990614082544 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:23.297085 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb6720-11c4-4e4c-b12a-990614082544 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:23.297543 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb6720-11c4-4e4c-b12a-990614082544 None admin] PATH_INFO: `/v3/services/network` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:23.298405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb6720-11c4-4e4c-b12a-990614082544 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:23.299854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb6720-11c4-4e4c-b12a-990614082544 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-40eb6720-11c4-4e4c-b12a-990614082544 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:23.314913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:23.315965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:23.318501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:23.318501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:23.318501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:23.318501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:23.318501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:23.318501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:23.318501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:23.318501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:23.318501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:23.318501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:23.318501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:23.318501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:23.318501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:09:23.318501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:23.318501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 352/710] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:23 2022] GET /identity/v3/services/network => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:23.319322 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb6720-11c4-4e4c-b12a-990614082544 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:23.361937 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 359/711] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:23.363009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e7d68-f94d-4330-9491-26ba1cb73dae None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:23.391484 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:23.456209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:23.462044 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb6720-11c4-4e4c-b12a-990614082544 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:23.473880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3e7d68-f94d-4330-9491-26ba1cb73dae None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:23.499267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7299cce-7ed9-4092-9100-4ce89b454525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:23.499910 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299cce-7ed9-4092-9100-4ce89b454525 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:23.500184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299cce-7ed9-4092-9100-4ce89b454525 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:23.500452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7299cce-7ed9-4092-9100-4ce89b454525 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:23.507556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7299cce-7ed9-4092-9100-4ce89b454525 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:23.509062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7299cce-7ed9-4092-9100-4ce89b454525 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:23.510150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526edd2-781c-4fe3-a005-5b8538984dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:23.510824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526edd2-781c-4fe3-a005-5b8538984dbb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:23.511107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526edd2-781c-4fe3-a005-5b8538984dbb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:23.511381 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3526edd2-781c-4fe3-a005-5b8538984dbb None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:23.512069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526edd2-781c-4fe3-a005-5b8538984dbb None admin] RBAC: Adding query filter params (name=network) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:23.512374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526edd2-781c-4fe3-a005-5b8538984dbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:23.513725 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3526edd2-781c-4fe3-a005-5b8538984dbb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:23.518815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 360/712] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 1 14:09:23 2022] GET /identity/v3/services?name=network => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:23.519700 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526edd2-781c-4fe3-a005-5b8538984dbb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:23.521380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-f7299cce-7ed9-4092-9100-4ce89b454525 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:23.521380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:23.521380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:23.521380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:23.521380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:23.521380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:23.521380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:23.521380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:23.521380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:23.521380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:23.521380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:23.521380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:23.521380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:23.521380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:23.521380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:23.522227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:23.523563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:23.523563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:23.523563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:23.523563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:23.523563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:23.523563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:23.523563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:23.523563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:23.523563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 353/713] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:23.524057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7299cce-7ed9-4092-9100-4ce89b454525 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:23.627369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3526edd2-781c-4fe3-a005-5b8538984dbb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:23.633077 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7299cce-7ed9-4092-9100-4ce89b454525 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:23.642816 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:23.664931 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8a53d-5fd6-4beb-9c1a-fef320448113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:23.666031 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8a53d-5fd6-4beb-9c1a-fef320448113 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:23.666439 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8a53d-5fd6-4beb-9c1a-fef320448113 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:23.666766 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f8a53d-5fd6-4beb-9c1a-fef320448113 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:23.667399 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8a53d-5fd6-4beb-9c1a-fef320448113 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:23.668815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f8a53d-5fd6-4beb-9c1a-fef320448113 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:23.670240 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19593cc-cfc4-4c7f-9779-1d3eca37fb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:23.670950 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19593cc-cfc4-4c7f-9779-1d3eca37fb16 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:23.671286 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19593cc-cfc4-4c7f-9779-1d3eca37fb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:23.671624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19593cc-cfc4-4c7f-9779-1d3eca37fb16 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:23.672362 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19593cc-cfc4-4c7f-9779-1d3eca37fb16 None admin] RBAC: Adding query filter params (type=network) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:23.672725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19593cc-cfc4-4c7f-9779-1d3eca37fb16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:23.674173 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19593cc-cfc4-4c7f-9779-1d3eca37fb16 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:23.681270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 354/714] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 1 14:09:23 2022] GET /identity/v3/services?type=network => generated 124 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-a0f8a53d-5fd6-4beb-9c1a-fef320448113 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:23.681510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:23.683599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:23.685432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:23.685432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:23.685432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:23.685432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:23.685432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:23.685432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:23.685432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:23.685432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:23.685432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:23.685432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:23.685432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:23.685432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:23.685432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:23.685432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:09:23.685432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:23.686401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19593cc-cfc4-4c7f-9779-1d3eca37fb16 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:23.686497 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 361/715] 10.222.0.70 () {56 vars in 1129 bytes} [Mon Aug 1 14:09:23 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:23.695896 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8a53d-5fd6-4beb-9c1a-fef320448113 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:23.747059 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:23.875194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19593cc-cfc4-4c7f-9779-1d3eca37fb16 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:23.875415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f8a53d-5fd6-4beb-9c1a-fef320448113 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:23.918487 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c74a5b-0858-4207-886f-870497e5a184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:23.919035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00376ca7-1918-44e0-a7b6-434ee5331969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:23.919216 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c74a5b-0858-4207-886f-870497e5a184 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:23.919491 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c74a5b-0858-4207-886f-870497e5a184 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:23.919652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00376ca7-1918-44e0-a7b6-434ee5331969 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:23.919819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c74a5b-0858-4207-886f-870497e5a184 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:23.919958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00376ca7-1918-44e0-a7b6-434ee5331969 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:23.920258 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00376ca7-1918-44e0-a7b6-434ee5331969 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:23.920416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c74a5b-0858-4207-886f-870497e5a184 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:23.920696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c74a5b-0858-4207-886f-870497e5a184 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:23.920868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00376ca7-1918-44e0-a7b6-434ee5331969 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:23.922000 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00376ca7-1918-44e0-a7b6-434ee5331969 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:23.922178 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c74a5b-0858-4207-886f-870497e5a184 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:23.922517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00376ca7-1918-44e0-a7b6-434ee5331969 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:23.934201 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 362/716] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Aug 1 14:09:23 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:23.935148 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00376ca7-1918-44e0-a7b6-434ee5331969 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:23.940275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 355/717] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:23.946041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c74a5b-0858-4207-886f-870497e5a184 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:23.990169 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:24.071517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:24.106295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00376ca7-1918-44e0-a7b6-434ee5331969 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:24.147957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c74a5b-0858-4207-886f-870497e5a184 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:24.159012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4caa3e9e-506c-4bbb-aca1-dc239db0bb3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:24.159632 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa3e9e-506c-4bbb-aca1-dc239db0bb3f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:24.159907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa3e9e-506c-4bbb-aca1-dc239db0bb3f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:24.160180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4caa3e9e-506c-4bbb-aca1-dc239db0bb3f None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:24.160903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa3e9e-506c-4bbb-aca1-dc239db0bb3f None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:24.161205 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa3e9e-506c-4bbb-aca1-dc239db0bb3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:24.162648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4caa3e9e-506c-4bbb-aca1-dc239db0bb3f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:24.174444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 363/718] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Aug 1 14:09:23 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:24.195717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4d6d45-78ce-4f65-b958-bb6bef8ad1c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:24.196350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d6d45-78ce-4f65-b958-bb6bef8ad1c3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:24.196627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d6d45-78ce-4f65-b958-bb6bef8ad1c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:24.196898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4d6d45-78ce-4f65-b958-bb6bef8ad1c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:24.197682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d6d45-78ce-4f65-b958-bb6bef8ad1c3 None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=e856fd5aff914cfb8b8dd86b39c89bd0) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:24.197986 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d6d45-78ce-4f65-b958-bb6bef8ad1c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:24.199471 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4d6d45-78ce-4f65-b958-bb6bef8ad1c3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:24.205630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 356/719] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:23 2022] GET /identity/v3/role_assignments?user.id=e856fd5aff914cfb8b8dd86b39c89bd0&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=0681632796d144f6a7ac8eca157001ec => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:25.028742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5de82d-7fec-46c6-a4c7-457f3f528275 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:25.029721 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5de82d-7fec-46c6-a4c7-457f3f528275 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:25.030208 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5de82d-7fec-46c6-a4c7-457f3f528275 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:25.032040 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 364/720] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:25.037088 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9423a-c3a0-450c-8316-d7f23525e7c5 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:25.037900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9423a-c3a0-450c-8316-d7f23525e7c5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:25.038389 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9423a-c3a0-450c-8316-d7f23525e7c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:25.059435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9db9423a-c3a0-450c-8316-d7f23525e7c5 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:25.060987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9db9423a-c3a0-450c-8316-d7f23525e7c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:25.157333 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 357/721] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:25.199047 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5de82d-7fec-46c6-a4c7-457f3f528275 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:25.340200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5de82d-7fec-46c6-a4c7-457f3f528275 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:25.390088 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e99ee-d6e4-47f7-b1ca-ed504b1266ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:25.390760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e99ee-d6e4-47f7-b1ca-ed504b1266ab None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:25.391045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e99ee-d6e4-47f7-b1ca-ed504b1266ab None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:25.391319 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e99ee-d6e4-47f7-b1ca-ed504b1266ab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:25.405124 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:25.411755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33e99ee-d6e4-47f7-b1ca-ed504b1266ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f33e99ee-d6e4-47f7-b1ca-ed504b1266ab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:25.416713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:25.417660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:25.418598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:25.418598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:25.418598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:25.418598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:25.418598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:25.418598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:25.418598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:25.418598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:25.418598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:25.418598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:25.418598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:09:25.418598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:25.422898 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 365/722] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:09:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:25.424356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9423a-c3a0-450c-8316-d7f23525e7c5 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:25.466254 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:25.563587 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9423a-c3a0-450c-8316-d7f23525e7c5 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:25.616442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298dba65-f733-4aa5-a100-92fd9b9d2645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:25.617013 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dba65-f733-4aa5-a100-92fd9b9d2645 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:25.617294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dba65-f733-4aa5-a100-92fd9b9d2645 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:25.617566 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298dba65-f733-4aa5-a100-92fd9b9d2645 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:25.618370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dba65-f733-4aa5-a100-92fd9b9d2645 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:25.618710 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dba65-f733-4aa5-a100-92fd9b9d2645 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:25.620170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298dba65-f733-4aa5-a100-92fd9b9d2645 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:25.633116 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 358/723] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:09:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:25.638821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e99ee-d6e4-47f7-b1ca-ed504b1266ab None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:25.700401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af22150-9d42-45a4-a3c7-4196f8f11684 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:25.700698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af22150-9d42-45a4-a3c7-4196f8f11684 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:25.700964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af22150-9d42-45a4-a3c7-4196f8f11684 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:25.702566 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 359/724] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:09:25.707288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6fc69-6b9d-4fcb-beb1-335e80d3dd8d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:25.707617 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6fc69-6b9d-4fcb-beb1-335e80d3dd8d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:25.707916 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d6fc69-6b9d-4fcb-beb1-335e80d3dd8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:25.735735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-01d6fc69-6b9d-4fcb-beb1-335e80d3dd8d None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:25.736918 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-01d6fc69-6b9d-4fcb-beb1-335e80d3dd8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:25.805529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e99ee-d6e4-47f7-b1ca-ed504b1266ab None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:25.846554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30429ecf-30f7-455a-a864-f03f1fe881d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:25.847236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30429ecf-30f7-455a-a864-f03f1fe881d5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:25.847514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30429ecf-30f7-455a-a864-f03f1fe881d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:25.847785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30429ecf-30f7-455a-a864-f03f1fe881d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:25.874950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30429ecf-30f7-455a-a864-f03f1fe881d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:25.876325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30429ecf-30f7-455a-a864-f03f1fe881d5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:25.878377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 360/725] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 01 14:09:25.893426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-30429ecf-30f7-455a-a864-f03f1fe881d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:25.893426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:25.893426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:25.893426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:25.893426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:25.893426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:25.893426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:25.893426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:25.893426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:25.893426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:25.893426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:25.893426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:25.893426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:25.893426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:25.893426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:25.894403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:25.895346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:25.895346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:25.895346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:25.895346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:25.895346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 366/726] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:25.903859 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6fc69-6b9d-4fcb-beb1-335e80d3dd8d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:25.923686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30429ecf-30f7-455a-a864-f03f1fe881d5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:25.936000 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:25.989941 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:26.090663 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d6fc69-6b9d-4fcb-beb1-335e80d3dd8d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:26.093966 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30429ecf-30f7-455a-a864-f03f1fe881d5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:26.134310 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822a4bf-ecb9-4bb5-9d19-f9b10ce33e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:26.134892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822a4bf-ecb9-4bb5-9d19-f9b10ce33e09 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:26.135172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822a4bf-ecb9-4bb5-9d19-f9b10ce33e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:26.135491 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822a4bf-ecb9-4bb5-9d19-f9b10ce33e09 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:26.136193 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822a4bf-ecb9-4bb5-9d19-f9b10ce33e09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:26.136496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822a4bf-ecb9-4bb5-9d19-f9b10ce33e09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:26.137955 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822a4bf-ecb9-4bb5-9d19-f9b10ce33e09 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:26.151232 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 361/727] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:26.156384 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822a4bf-ecb9-4bb5-9d19-f9b10ce33e09 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:26.160748 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681b3f9-e33f-491b-8e8c-e73e058db337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:26.161921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681b3f9-e33f-491b-8e8c-e73e058db337 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:26.162202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681b3f9-e33f-491b-8e8c-e73e058db337 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:26.162478 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681b3f9-e33f-491b-8e8c-e73e058db337 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:26.180404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681b3f9-e33f-491b-8e8c-e73e058db337 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f681b3f9-e33f-491b-8e8c-e73e058db337 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:26.185791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:26.186767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:26.187631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:26.187631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:26.187631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:26.187631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:26.187631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:26.187631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:26.187631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:26.187631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:26.187631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:26.187631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:26.187631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:26.187631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:26.187631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 367/728] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:26.194236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681b3f9-e33f-491b-8e8c-e73e058db337 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:26.248477 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:26.276054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822a4bf-ecb9-4bb5-9d19-f9b10ce33e09 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:26.320063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b46c5e-d60e-46b6-9b8d-a92594b44aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:26.320720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b46c5e-d60e-46b6-9b8d-a92594b44aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:26.321002 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b46c5e-d60e-46b6-9b8d-a92594b44aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:26.321281 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b46c5e-d60e-46b6-9b8d-a92594b44aa8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:26.329381 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b46c5e-d60e-46b6-9b8d-a92594b44aa8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:26.330883 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b46c5e-d60e-46b6-9b8d-a92594b44aa8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-37b46c5e-d60e-46b6-9b8d-a92594b44aa8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:26.343933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:26.344938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:26.345894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:26.345894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:26.345894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:26.345894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:26.345894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:26.345894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:26.345894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:26.345894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:26.345894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:09:26.345894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:26.345894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 362/729] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:09:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:26.347037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea61d5-7c85-4dcc-a0d8-f477ae01acfc None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:26.347138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea61d5-7c85-4dcc-a0d8-f477ae01acfc None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:26.347355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea61d5-7c85-4dcc-a0d8-f477ae01acfc None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:26.353024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 363/730] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:26.353024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea61d5-7c85-4dcc-a0d8-f477ae01acfc None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:26.365689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681b3f9-e33f-491b-8e8c-e73e058db337 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:26.383801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:26.413876 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dec992-ef29-462f-b7a7-a48320bb05cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:26.414415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dec992-ef29-462f-b7a7-a48320bb05cc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:26.414742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dec992-ef29-462f-b7a7-a48320bb05cc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:26.415243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dec992-ef29-462f-b7a7-a48320bb05cc None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:26.415976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dec992-ef29-462f-b7a7-a48320bb05cc None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:26.416277 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dec992-ef29-462f-b7a7-a48320bb05cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:26.418420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dec992-ef29-462f-b7a7-a48320bb05cc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:26.429430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 368/731] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:26.430945 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34487639-1063-4828-a2da-6fa266e54615 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:26.431230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34487639-1063-4828-a2da-6fa266e54615 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:26.431503 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34487639-1063-4828-a2da-6fa266e54615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:26.455656 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-34487639-1063-4828-a2da-6fa266e54615 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:26.457249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-34487639-1063-4828-a2da-6fa266e54615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:26.484744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea61d5-7c85-4dcc-a0d8-f477ae01acfc None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:26.520941 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbf196-dd52-436c-aa0d-88e171d098e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:26.521557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbf196-dd52-436c-aa0d-88e171d098e1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:26.521831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbf196-dd52-436c-aa0d-88e171d098e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:26.522101 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fbf196-dd52-436c-aa0d-88e171d098e1 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:26.522934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbf196-dd52-436c-aa0d-88e171d098e1 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:26.523330 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbf196-dd52-436c-aa0d-88e171d098e1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:26.524673 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4fbf196-dd52-436c-aa0d-88e171d098e1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:26.535398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:26.542188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 369/732] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:26.543422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34487639-1063-4828-a2da-6fa266e54615 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:26.546076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 364/733] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Aug 1 14:09:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:26.552401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbf196-dd52-436c-aa0d-88e171d098e1 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:26.674521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fbf196-dd52-436c-aa0d-88e171d098e1 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:26.701249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34487639-1063-4828-a2da-6fa266e54615 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:26.703562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:26.712317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb75741-3d13-49a1-9c4a-9f1d5393d6f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:26.713185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb75741-3d13-49a1-9c4a-9f1d5393d6f5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:26.713459 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb75741-3d13-49a1-9c4a-9f1d5393d6f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:26.713724 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb75741-3d13-49a1-9c4a-9f1d5393d6f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:26.737150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277815f1-e1f1-4ca5-a4d0-ad9a698db5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:26.737788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277815f1-e1f1-4ca5-a4d0-ad9a698db5b0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:26.738070 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277815f1-e1f1-4ca5-a4d0-ad9a698db5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:26.738418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277815f1-e1f1-4ca5-a4d0-ad9a698db5b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:26.748962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277815f1-e1f1-4ca5-a4d0-ad9a698db5b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:26.750402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-277815f1-e1f1-4ca5-a4d0-ad9a698db5b0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:26.765430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-277815f1-e1f1-4ca5-a4d0-ad9a698db5b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:26.765430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:26.765430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:26.765430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:26.765430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:26.765430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:26.765430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:26.765430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:26.765430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:26.765430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:26.765430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:26.765430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:26.765430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:26.765430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:26.765430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:26.766391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:26.767351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:26.767351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:26.767351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:26.767351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:26.767351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 370/734] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:26.767351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277815f1-e1f1-4ca5-a4d0-ad9a698db5b0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:26.774813 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:26.782005 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb75741-3d13-49a1-9c4a-9f1d5393d6f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:26.783516 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb75741-3d13-49a1-9c4a-9f1d5393d6f5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:26.868859 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277815f1-e1f1-4ca5-a4d0-ad9a698db5b0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:26.881469 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 365/735] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 01 14:09:26.882816 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7437e3-d57b-4d5d-bfa5-54da7a61a074 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:26.883176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7437e3-d57b-4d5d-bfa5-54da7a61a074 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:26.883523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7437e3-d57b-4d5d-bfa5-54da7a61a074 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:26.884985 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 366/736] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:26.887226 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2244a3-e510-4325-88fb-03f29f9cbf45 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:26.887515 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2244a3-e510-4325-88fb-03f29f9cbf45 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:26.887789 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2244a3-e510-4325-88fb-03f29f9cbf45 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:26.889128 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 367/737] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:26.889829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2244a3-e510-4325-88fb-03f29f9cbf45 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:26.903478 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c7415-c2cb-4bd9-ba6c-bec09340832c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:26.904091 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c7415-c2cb-4bd9-ba6c-bec09340832c None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:26.904377 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c7415-c2cb-4bd9-ba6c-bec09340832c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:26.904648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71c7415-c2cb-4bd9-ba6c-bec09340832c None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:26.905331 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c7415-c2cb-4bd9-ba6c-bec09340832c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:26.906744 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71c7415-c2cb-4bd9-ba6c-bec09340832c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:26.930865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 371/738] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 1 14:09:26 2022] POST /identity/v3/services => generated 240 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:09:26.932141 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c7415-c2cb-4bd9-ba6c-bec09340832c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:26.956635 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:27.007913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:27.022975 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2244a3-e510-4325-88fb-03f29f9cbf45 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:27.052805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71c7415-c2cb-4bd9-ba6c-bec09340832c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:27.064180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59178cb3-0729-4ae2-b5c5-7027c97507d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:27.064823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59178cb3-0729-4ae2-b5c5-7027c97507d8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:27.065091 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59178cb3-0729-4ae2-b5c5-7027c97507d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:27.065358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59178cb3-0729-4ae2-b5c5-7027c97507d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:27.066053 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59178cb3-0729-4ae2-b5c5-7027c97507d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:27.066467 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59178cb3-0729-4ae2-b5c5-7027c97507d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:27.068580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59178cb3-0729-4ae2-b5c5-7027c97507d8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:27.083439 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 368/739] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:27.084519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdd6a8-3365-4667-9086-1fa27a289349 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:27.084818 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdd6a8-3365-4667-9086-1fa27a289349 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:27.085084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bdd6a8-3365-4667-9086-1fa27a289349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:27.090878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2487c8-2909-4754-80a5-cb59ac2363cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:27.091634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2487c8-2909-4754-80a5-cb59ac2363cc None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:27.091923 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2487c8-2909-4754-80a5-cb59ac2363cc None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:27.092179 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2487c8-2909-4754-80a5-cb59ac2363cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:27.104400 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2487c8-2909-4754-80a5-cb59ac2363cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:27.105883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2487c8-2909-4754-80a5-cb59ac2363cc None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:27.106282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-31bdd6a8-3365-4667-9086-1fa27a289349 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:27.107544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-31bdd6a8-3365-4667-9086-1fa27a289349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:27.121501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-9f2487c8-2909-4754-80a5-cb59ac2363cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:27.121501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:27.121501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:27.121501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:27.121501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:27.121501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:27.121501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:27.121501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:27.121501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:27.121501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:27.121501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:27.121501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:27.121501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:27.121501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:27.121501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:27.122418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:27.124422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:27.124422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:27.124422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:27.124422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:27.124422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 372/740] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:27.124422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443ca2b-263c-454a-b847-2d8fa5de0f90 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:27.124422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443ca2b-263c-454a-b847-2d8fa5de0f90 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:27.124422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2443ca2b-263c-454a-b847-2d8fa5de0f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:27.143311 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2443ca2b-263c-454a-b847-2d8fa5de0f90 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:27.144497 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2443ca2b-263c-454a-b847-2d8fa5de0f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:27.189224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 369/741] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:27 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:27.190276 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdd6a8-3365-4667-9086-1fa27a289349 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:27.221718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:27.228187 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 373/742] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:27 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 01 14:09:27.228877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443ca2b-263c-454a-b847-2d8fa5de0f90 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:27.297736 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:27.320571 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bdd6a8-3365-4667-9086-1fa27a289349 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:27.331520 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2443ca2b-263c-454a-b847-2d8fa5de0f90 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:27.359680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f13df3-c9cb-448b-9b39-037867e49241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:27.360634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f13df3-c9cb-448b-9b39-037867e49241 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:27.360914 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f13df3-c9cb-448b-9b39-037867e49241 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:27.361184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f13df3-c9cb-448b-9b39-037867e49241 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:27.368741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f13df3-c9cb-448b-9b39-037867e49241 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:27.370196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f13df3-c9cb-448b-9b39-037867e49241 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:27.370555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9139ea-8c20-4855-9a36-518a0ff4ed15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:27.371215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9139ea-8c20-4855-9a36-518a0ff4ed15 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:27.371497 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9139ea-8c20-4855-9a36-518a0ff4ed15 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:27.371770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9139ea-8c20-4855-9a36-518a0ff4ed15 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:27.372460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9139ea-8c20-4855-9a36-518a0ff4ed15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:27.372766 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9139ea-8c20-4855-9a36-518a0ff4ed15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:27.374115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9139ea-8c20-4855-9a36-518a0ff4ed15 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d3f13df3-c9cb-448b-9b39-037867e49241 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:27.384076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:27.385696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:27.387680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:27.387680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:27.387680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:27.387680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:27.387680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:27.387680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:27.387680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:27.387680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:27.387680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:09:27.387680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:27.390659 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 370/743] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 1 14:09:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:27.391440 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f13df3-c9cb-448b-9b39-037867e49241 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:27.397535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 374/744] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:27.397535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9139ea-8c20-4855-9a36-518a0ff4ed15 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:27.459354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:27.502356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f13df3-c9cb-448b-9b39-037867e49241 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:27.507659 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9139ea-8c20-4855-9a36-518a0ff4ed15 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:27.536770 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95933d-0d3b-4d82-8493-d0f6e4e9f574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:27.537406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95933d-0d3b-4d82-8493-d0f6e4e9f574 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:27.537683 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95933d-0d3b-4d82-8493-d0f6e4e9f574 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:27.537956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea95933d-0d3b-4d82-8493-d0f6e4e9f574 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:27.546017 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546d043-35e3-44e8-8175-f3ff4644c7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:27.546618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546d043-35e3-44e8-8175-f3ff4644c7eb None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:27.546900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546d043-35e3-44e8-8175-f3ff4644c7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:27.547169 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8546d043-35e3-44e8-8175-f3ff4644c7eb None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:27.547844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546d043-35e3-44e8-8175-f3ff4644c7eb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:27.548872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea95933d-0d3b-4d82-8493-d0f6e4e9f574 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:27.549200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8546d043-35e3-44e8-8175-f3ff4644c7eb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-ea95933d-0d3b-4d82-8493-d0f6e4e9f574 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:27.554831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:27.561451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:27.563807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:27.563807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:27.563807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:27.563807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:27.563807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:27.563807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:27.563807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:27.563807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:27.563807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:27.563807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:27.563807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:09:27.563807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:27.563807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 371/745] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:09:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:27.563807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95933d-0d3b-4d82-8493-d0f6e4e9f574 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:27.565226 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:27.576965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 375/746] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 1 14:09:27 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:09:27.577963 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546d043-35e3-44e8-8175-f3ff4644c7eb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:27.698736 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea95933d-0d3b-4d82-8493-d0f6e4e9f574 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:27.744651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8546d043-35e3-44e8-8175-f3ff4644c7eb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:27.749733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a692f4-22dc-4290-b717-62d5162faa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:27.750468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a692f4-22dc-4290-b717-62d5162faa06 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:27.750907 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a692f4-22dc-4290-b717-62d5162faa06 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:27.751361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a692f4-22dc-4290-b717-62d5162faa06 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:27.752280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a692f4-22dc-4290-b717-62d5162faa06 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:27.752680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a692f4-22dc-4290-b717-62d5162faa06 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:27.754203 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a692f4-22dc-4290-b717-62d5162faa06 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:27.762880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:27.774337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 372/747] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Aug 1 14:09:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:27.775444 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a692f4-22dc-4290-b717-62d5162faa06 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:27.789032 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa8c17-16b5-4cd7-9c1c-5a61f347c3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:27.790003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa8c17-16b5-4cd7-9c1c-5a61f347c3fb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:27.790385 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa8c17-16b5-4cd7-9c1c-5a61f347c3fb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:27.790978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fa8c17-16b5-4cd7-9c1c-5a61f347c3fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:27.802473 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa8c17-16b5-4cd7-9c1c-5a61f347c3fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:27.804059 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fa8c17-16b5-4cd7-9c1c-5a61f347c3fb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:27.818506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-98fa8c17-16b5-4cd7-9c1c-5a61f347c3fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:27.818506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:27.818506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:27.818506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:27.818506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:27.818506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:27.818506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:27.818506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:27.818506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:27.818506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:27.818506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:27.818506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:27.818506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:27.818506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:27.818506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:27.819610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:27.820746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:27.820746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:27.820746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:27.820746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:27.820746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:27.820746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:27.820746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:27.820746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:27.823340 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 376/748] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:27.824750 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa8c17-16b5-4cd7-9c1c-5a61f347c3fb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:27.846900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:27.910009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a692f4-22dc-4290-b717-62d5162faa06 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:27.934534 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fa8c17-16b5-4cd7-9c1c-5a61f347c3fb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:27.973979 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b24b86-3481-45c5-b937-6a588c6f4a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:27.974667 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b24b86-3481-45c5-b937-6a588c6f4a21 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:27.974946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b24b86-3481-45c5-b937-6a588c6f4a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:27.975214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b24b86-3481-45c5-b937-6a588c6f4a21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:28.028754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:28.058706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b24b86-3481-45c5-b937-6a588c6f4a21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:28.060437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b24b86-3481-45c5-b937-6a588c6f4a21 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:28.094920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4547d8-d02c-444b-970a-b3d67fbd1bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:28.095544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4547d8-d02c-444b-970a-b3d67fbd1bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:28.095818 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4547d8-d02c-444b-970a-b3d67fbd1bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:28.096082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4547d8-d02c-444b-970a-b3d67fbd1bd5 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:28.096809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4547d8-d02c-444b-970a-b3d67fbd1bd5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:28.097107 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4547d8-d02c-444b-970a-b3d67fbd1bd5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:28.099276 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4547d8-d02c-444b-970a-b3d67fbd1bd5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:28.109017 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 373/749] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:09:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:28.109901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4547d8-d02c-444b-970a-b3d67fbd1bd5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:28.181444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 377/750] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:27 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:09:28.181444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b24b86-3481-45c5-b937-6a588c6f4a21 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:28.234177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4547d8-d02c-444b-970a-b3d67fbd1bd5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:28.252143 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:28.259173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:28.272139 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcec459-18d8-4123-a4ca-64e229630792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:28.273027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcec459-18d8-4123-a4ca-64e229630792 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:28.273450 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcec459-18d8-4123-a4ca-64e229630792 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:28.273930 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcec459-18d8-4123-a4ca-64e229630792 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:28.274876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcec459-18d8-4123-a4ca-64e229630792 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:28.275407 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcec459-18d8-4123-a4ca-64e229630792 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:28.277072 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcec459-18d8-4123-a4ca-64e229630792 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:28.282813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b24b86-3481-45c5-b937-6a588c6f4a21 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:28.290805 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 374/751] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:28.291870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcec459-18d8-4123-a4ca-64e229630792 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:28.318789 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac73f42-cd3d-48cf-bdc3-a6bf5a4368ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:28.319423 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac73f42-cd3d-48cf-bdc3-a6bf5a4368ff None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:28.319700 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac73f42-cd3d-48cf-bdc3-a6bf5a4368ff None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:28.319970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac73f42-cd3d-48cf-bdc3-a6bf5a4368ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:28.330196 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac73f42-cd3d-48cf-bdc3-a6bf5a4368ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:28.331763 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac73f42-cd3d-48cf-bdc3-a6bf5a4368ff None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:28.347921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-bac73f42-cd3d-48cf-bdc3-a6bf5a4368ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:28.347921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:28.347921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:28.347921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:28.347921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:28.347921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:28.347921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:28.347921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:28.347921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:28.347921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:28.347921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:28.347921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:28.347921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:28.347921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:28.347921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:28.350188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:28.351108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:28.351108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:28.351108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:28.351108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:28.351108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 378/752] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:28.351108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac73f42-cd3d-48cf-bdc3-a6bf5a4368ff None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:28.402089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcec459-18d8-4123-a4ca-64e229630792 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:28.438212 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f412b-9273-4658-b7e0-7c556568d12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:28.439317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f412b-9273-4658-b7e0-7c556568d12e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:28.439798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f412b-9273-4658-b7e0-7c556568d12e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:28.440269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f412b-9273-4658-b7e0-7c556568d12e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:28.453095 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f412b-9273-4658-b7e0-7c556568d12e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:28.454924 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f412b-9273-4658-b7e0-7c556568d12e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:28.456565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac73f42-cd3d-48cf-bdc3-a6bf5a4368ff None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:28.471183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-1e0f412b-9273-4658-b7e0-7c556568d12e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:28.471183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:28.471183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:28.471183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:28.471183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:28.471183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:28.471183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:28.471183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:28.471183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:28.471183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:28.471183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:28.471183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:28.471183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:28.471183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:28.471183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:28.472076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:28.472964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:28.472964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:28.472964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:28.472964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:28.480061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 375/753] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:28.481115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f412b-9273-4658-b7e0-7c556568d12e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:28.492974 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ad99a-3cd9-4fe7-bc94-911c60c556ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:28.493705 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ad99a-3cd9-4fe7-bc94-911c60c556ff None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:28.493905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ad99a-3cd9-4fe7-bc94-911c60c556ff None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:28.494134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720ad99a-3cd9-4fe7-bc94-911c60c556ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:28.494961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ad99a-3cd9-4fe7-bc94-911c60c556ff None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=98cccf60a5424986b2e92b523542a640) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:28.495272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ad99a-3cd9-4fe7-bc94-911c60c556ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:28.496705 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720ad99a-3cd9-4fe7-bc94-911c60c556ff None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:28.502730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 379/754] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:28 2022] GET /identity/v3/role_assignments?user.id=98cccf60a5424986b2e92b523542a640&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=0681632796d144f6a7ac8eca157001ec => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:28.503062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:28.507206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ad99a-3cd9-4fe7-bc94-911c60c556ff None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:28.517164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:28.611610 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f412b-9273-4658-b7e0-7c556568d12e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:28.643506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720ad99a-3cd9-4fe7-bc94-911c60c556ff None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:28.655792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b5cc7-a0cf-4ecb-b58c-64b59cb49fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:28.656748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b5cc7-a0cf-4ecb-b58c-64b59cb49fbe None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:28.657168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b5cc7-a0cf-4ecb-b58c-64b59cb49fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:28.657654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50b5cc7-a0cf-4ecb-b58c-64b59cb49fbe None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:28.658527 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b5cc7-a0cf-4ecb-b58c-64b59cb49fbe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:28.659063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b5cc7-a0cf-4ecb-b58c-64b59cb49fbe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:28.660711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50b5cc7-a0cf-4ecb-b58c-64b59cb49fbe None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:28.673777 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 376/755] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:28.679557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b5cc7-a0cf-4ecb-b58c-64b59cb49fbe None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:28.688467 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087fffd-663e-441c-97d8-bbceb1513108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:28.689098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087fffd-663e-441c-97d8-bbceb1513108 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:28.689379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087fffd-663e-441c-97d8-bbceb1513108 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:28.689657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8087fffd-663e-441c-97d8-bbceb1513108 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:28.690993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087fffd-663e-441c-97d8-bbceb1513108 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:28.691319 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087fffd-663e-441c-97d8-bbceb1513108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:28.693502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8087fffd-663e-441c-97d8-bbceb1513108 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:28.712193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 380/756] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:28.719079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087fffd-663e-441c-97d8-bbceb1513108 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:28.788735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:28.799727 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50b5cc7-a0cf-4ecb-b58c-64b59cb49fbe None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:28.827143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:28.837965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a98cc-7c79-4e6d-98af-58454ae8234d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:28.839327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a98cc-7c79-4e6d-98af-58454ae8234d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:28.839758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a98cc-7c79-4e6d-98af-58454ae8234d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:28.840308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-314a98cc-7c79-4e6d-98af-58454ae8234d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:28.849479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a98cc-7c79-4e6d-98af-58454ae8234d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:28.851275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-314a98cc-7c79-4e6d-98af-58454ae8234d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-314a98cc-7c79-4e6d-98af-58454ae8234d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:28.863329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:28.864535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:28.865616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:28.865616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:28.865616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:28.865616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:28.865616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:28.865616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:28.865616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:28.865616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:28.865616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:09:28.865616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:28.867855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 377/757] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 1 14:09:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:28.873398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a98cc-7c79-4e6d-98af-58454ae8234d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:28.875198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8087fffd-663e-441c-97d8-bbceb1513108 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:28.955324 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fac96c-d74a-4f00-8bda-d433d7e6350b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:28.956073 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fac96c-d74a-4f00-8bda-d433d7e6350b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:28.956250 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fac96c-d74a-4f00-8bda-d433d7e6350b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:28.956521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fac96c-d74a-4f00-8bda-d433d7e6350b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:28.964924 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fac96c-d74a-4f00-8bda-d433d7e6350b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:28.971616 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fac96c-d74a-4f00-8bda-d433d7e6350b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:28.995633 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-314a98cc-7c79-4e6d-98af-58454ae8234d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:29.005316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-33fac96c-d74a-4f00-8bda-d433d7e6350b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:29.005316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:29.005316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:29.005316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:29.005316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:29.005316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:29.005316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:29.005316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:29.005316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:29.005316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:29.005316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:29.005316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:29.005316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:29.005316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:29.005316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:29.006237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:29.007150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:29.007150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:29.007150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:29.007150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:29.007150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:29.007150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:29.007150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:29.007150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:29.007150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 381/758] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:29.014891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fac96c-d74a-4f00-8bda-d433d7e6350b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:29.058149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d008fa7-49a3-436e-b952-d2c47614fcbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:29.058727 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d008fa7-49a3-436e-b952-d2c47614fcbb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:29.059011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d008fa7-49a3-436e-b952-d2c47614fcbb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:29.059289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d008fa7-49a3-436e-b952-d2c47614fcbb None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:29.060259 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d008fa7-49a3-436e-b952-d2c47614fcbb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:29.061377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d008fa7-49a3-436e-b952-d2c47614fcbb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:29.062872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d008fa7-49a3-436e-b952-d2c47614fcbb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:29.086543 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 378/759] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 1 14:09:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:29.088177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf7a98-7553-43b8-bab0-c3581b3d5cf4 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:29.088463 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf7a98-7553-43b8-bab0-c3581b3d5cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:29.088741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bf7a98-7553-43b8-bab0-c3581b3d5cf4 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:29.094437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 379/760] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:29.095534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf7a98-7553-43b8-bab0-c3581b3d5cf4 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:29.109015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:29.139743 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fac96c-d74a-4f00-8bda-d433d7e6350b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:29.150949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:29.175642 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0259758d-c095-4366-b0cb-65bba0d11550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:29.176447 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259758d-c095-4366-b0cb-65bba0d11550 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:29.176572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259758d-c095-4366-b0cb-65bba0d11550 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:29.176847 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0259758d-c095-4366-b0cb-65bba0d11550 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:29.177599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259758d-c095-4366-b0cb-65bba0d11550 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:29.177928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259758d-c095-4366-b0cb-65bba0d11550 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:29.179421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0259758d-c095-4366-b0cb-65bba0d11550 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:29.191498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 382/761] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:29.192823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f0258-5f57-4b20-bb26-bb613bb98661 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:29.193116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f0258-5f57-4b20-bb26-bb613bb98661 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:29.193457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d6f0258-5f57-4b20-bb26-bb613bb98661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:29.212728 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5d6f0258-5f57-4b20-bb26-bb613bb98661 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:29.213766 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5d6f0258-5f57-4b20-bb26-bb613bb98661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:29.229586 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bf7a98-7553-43b8-bab0-c3581b3d5cf4 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:29.274181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9cba4-cf9a-40c4-832e-c16a55e68f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:29.274987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9cba4-cf9a-40c4-832e-c16a55e68f31 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:29.275410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9cba4-cf9a-40c4-832e-c16a55e68f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:29.275851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da9cba4-cf9a-40c4-832e-c16a55e68f31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:29.287398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9cba4-cf9a-40c4-832e-c16a55e68f31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:29.289080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da9cba4-cf9a-40c4-832e-c16a55e68f31 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:29.297740 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 383/762] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:29.298873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f0258-5f57-4b20-bb26-bb613bb98661 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:29.315460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-5da9cba4-cf9a-40c4-832e-c16a55e68f31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:29.315460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:29.315460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:29.315460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:29.315460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:29.315460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:29.315460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:29.315460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:29.315460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:29.315460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:29.315460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:29.315460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:29.315460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:29.315460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:29.315460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:29.316351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:29.317660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:29.317660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:29.317660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:29.317660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:29.317660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 380/763] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:29.322645 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9cba4-cf9a-40c4-832e-c16a55e68f31 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:29.391219 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:29.442535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:29.447346 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da9cba4-cf9a-40c4-832e-c16a55e68f31 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:29.447702 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d6f0258-5f57-4b20-bb26-bb613bb98661 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:29.492225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760869b-fc3d-48e4-8bfd-7683ef4fee9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:29.492860 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760869b-fc3d-48e4-8bfd-7683ef4fee9d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:29.493199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760869b-fc3d-48e4-8bfd-7683ef4fee9d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:29.493477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a760869b-fc3d-48e4-8bfd-7683ef4fee9d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:29.494262 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760869b-fc3d-48e4-8bfd-7683ef4fee9d None admin] RBAC: Adding query filter params (role.id=7db30e557e5b4d789838af5eb5985bf5, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=83ab2b0e5f244881900f6f3f7f591983) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:29.494566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760869b-fc3d-48e4-8bfd-7683ef4fee9d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:29.496127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a760869b-fc3d-48e4-8bfd-7683ef4fee9d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:29.497581 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eb1eb-8d1e-4429-9632-8e28ec766771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:29.498734 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eb1eb-8d1e-4429-9632-8e28ec766771 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:29.499760 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eb1eb-8d1e-4429-9632-8e28ec766771 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:29.500262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9eb1eb-8d1e-4429-9632-8e28ec766771 None admin] PATH_INFO: `/v3/services/network` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:29.501343 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eb1eb-8d1e-4429-9632-8e28ec766771 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:29.502715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 384/764] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:29 2022] GET /identity/v3/role_assignments?user.id=83ab2b0e5f244881900f6f3f7f591983&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=7db30e557e5b4d789838af5eb5985bf5 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:29.503397 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9eb1eb-8d1e-4429-9632-8e28ec766771 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:29.503632 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760869b-fc3d-48e4-8bfd-7683ef4fee9d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-0c9eb1eb-8d1e-4429-9632-8e28ec766771 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:29.516287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:29.517320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:29.518149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:29.518149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:29.518149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:29.518149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:29.518149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:29.518149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:29.518149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:29.518149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:29.518149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:29.518149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:29.518149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:29.518149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:29.518149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:09:29.518149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:29.526801 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 381/765] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:29 2022] GET /identity/v3/services/network => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:29.529550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eb1eb-8d1e-4429-9632-8e28ec766771 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:29.628213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a760869b-fc3d-48e4-8bfd-7683ef4fee9d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:29.672501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9eb1eb-8d1e-4429-9632-8e28ec766771 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:29.714402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa421ea0-c376-47ea-8935-515b1c5d6df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:29.715715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa421ea0-c376-47ea-8935-515b1c5d6df2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:29.715995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa421ea0-c376-47ea-8935-515b1c5d6df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:29.716266 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa421ea0-c376-47ea-8935-515b1c5d6df2 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:29.716962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa421ea0-c376-47ea-8935-515b1c5d6df2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:29.717262 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa421ea0-c376-47ea-8935-515b1c5d6df2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:29.718652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa421ea0-c376-47ea-8935-515b1c5d6df2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:29.722354 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:29.735897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1ebf4-caea-444e-bc41-c3cdf9251fcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:29.736896 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1ebf4-caea-444e-bc41-c3cdf9251fcc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:29.737381 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1ebf4-caea-444e-bc41-c3cdf9251fcc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:29.737869 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b1ebf4-caea-444e-bc41-c3cdf9251fcc None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:29.739492 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1ebf4-caea-444e-bc41-c3cdf9251fcc None admin] RBAC: Adding query filter params (name=network) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:29.740008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1ebf4-caea-444e-bc41-c3cdf9251fcc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:29.740333 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 385/766] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:29.741801 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b1ebf4-caea-444e-bc41-c3cdf9251fcc None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:29.745760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa421ea0-c376-47ea-8935-515b1c5d6df2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:29.752410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 382/767] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 1 14:09:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:29.768081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1ebf4-caea-444e-bc41-c3cdf9251fcc None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:29.778401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:29.860512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa421ea0-c376-47ea-8935-515b1c5d6df2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:29.905125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f4f55-ee6f-43f6-a85a-527a55b6086b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:29.906098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f4f55-ee6f-43f6-a85a-527a55b6086b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:29.906646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f4f55-ee6f-43f6-a85a-527a55b6086b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:29.907119 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f4f55-ee6f-43f6-a85a-527a55b6086b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:29.914637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f4f55-ee6f-43f6-a85a-527a55b6086b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:29.916347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f4f55-ee6f-43f6-a85a-527a55b6086b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:29.928815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-378f4f55-ee6f-43f6-a85a-527a55b6086b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:29.928815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:29.928815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:29.928815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:29.928815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:29.928815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:29.928815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:29.928815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:29.928815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:29.928815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:29.928815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:29.928815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:29.928815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:29.928815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:29.928815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:29.929735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:29.931116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:29.931116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:29.931116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:29.931116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:29.931116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:29.931116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:29.931116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:29.931116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:29.933252 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 386/768] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:29.934818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b166ad-80ca-4479-8a07-fe4a9af23b19 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:29.935304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b166ad-80ca-4479-8a07-fe4a9af23b19 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:29.935792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b166ad-80ca-4479-8a07-fe4a9af23b19 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:29.941239 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b1ebf4-caea-444e-bc41-c3cdf9251fcc None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:29.941575 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 387/769] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:29.943177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b166ad-80ca-4479-8a07-fe4a9af23b19 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:29.976915 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edca30c4-61d4-4900-8830-ed598a78ff80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:29.977542 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca30c4-61d4-4900-8830-ed598a78ff80 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:29.977821 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca30c4-61d4-4900-8830-ed598a78ff80 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:29.978172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edca30c4-61d4-4900-8830-ed598a78ff80 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:29.978994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca30c4-61d4-4900-8830-ed598a78ff80 None admin] RBAC: Adding query filter params (type=network) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:29.979303 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca30c4-61d4-4900-8830-ed598a78ff80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:29.980886 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edca30c4-61d4-4900-8830-ed598a78ff80 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:29.992953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 383/770] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 1 14:09:29 2022] GET /identity/v3/services?type=network => generated 350 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:29.994817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d1809-a830-41fa-82b6-68d70c1a424f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:29.995420 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d1809-a830-41fa-82b6-68d70c1a424f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:29.995906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199d1809-a830-41fa-82b6-68d70c1a424f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:30.019388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-199d1809-a830-41fa-82b6-68d70c1a424f None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:30.021111 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-199d1809-a830-41fa-82b6-68d70c1a424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:30.046619 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:30.073001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b166ad-80ca-4479-8a07-fe4a9af23b19 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:30.083528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:30.114304 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 384/771] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:30.115545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d1809-a830-41fa-82b6-68d70c1a424f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:30.119445 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8100d-d026-494d-b053-574656dcbfd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:30.119987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8100d-d026-494d-b053-574656dcbfd2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:30.120265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8100d-d026-494d-b053-574656dcbfd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:30.120537 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8100d-d026-494d-b053-574656dcbfd2 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:30.121493 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8100d-d026-494d-b053-574656dcbfd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:30.121846 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8100d-d026-494d-b053-574656dcbfd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:30.123297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8100d-d026-494d-b053-574656dcbfd2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:30.153207 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 388/772] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:30.154184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8100d-d026-494d-b053-574656dcbfd2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:30.248763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199d1809-a830-41fa-82b6-68d70c1a424f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:30.272249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8100d-d026-494d-b053-574656dcbfd2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:30.288689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae45cd-592a-4786-b837-1f68f656f9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:30.289311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae45cd-592a-4786-b837-1f68f656f9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:30.289590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae45cd-592a-4786-b837-1f68f656f9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:30.289855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ae45cd-592a-4786-b837-1f68f656f9b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:30.290624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae45cd-592a-4786-b837-1f68f656f9b6 None admin] RBAC: Adding query filter params (interface=public, service_id=f41424049f034277b7970daec15b4894, region_id=RegionOne) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:30.290929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae45cd-592a-4786-b837-1f68f656f9b6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:30.292358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ae45cd-592a-4786-b837-1f68f656f9b6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:30.304435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 385/773] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 1 14:09:30 2022] GET /identity/v3/endpoints?service_id=f41424049f034277b7970daec15b4894&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:30.305260 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae45cd-592a-4786-b837-1f68f656f9b6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:30.312496 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2085fb-a96f-4a02-ab41-cea62c03aff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:30.313145 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2085fb-a96f-4a02-ab41-cea62c03aff9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:30.313427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2085fb-a96f-4a02-ab41-cea62c03aff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:30.313698 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2085fb-a96f-4a02-ab41-cea62c03aff9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:30.314323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2085fb-a96f-4a02-ab41-cea62c03aff9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:30.316261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2085fb-a96f-4a02-ab41-cea62c03aff9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-1e2085fb-a96f-4a02-ab41-cea62c03aff9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:30.329551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:30.330533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:30.331405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 389/774] 10.222.0.70 () {56 vars in 1129 bytes} [Mon Aug 1 14:09:30 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:30.332242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2085fb-a96f-4a02-ab41-cea62c03aff9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:30.349789 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:30.371849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:30.435547 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ae45cd-592a-4786-b837-1f68f656f9b6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:30.465024 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2085fb-a96f-4a02-ab41-cea62c03aff9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:30.477561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e068bd7-f38e-445c-b7a0-527a7520690e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:30.477561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e068bd7-f38e-445c-b7a0-527a7520690e None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:30.477561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e068bd7-f38e-445c-b7a0-527a7520690e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:30.477561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e068bd7-f38e-445c-b7a0-527a7520690e None admin] PATH_INFO: `/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/e856fd5aff914cfb8b8dd86b39c89bd0/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:30.479278 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e068bd7-f38e-445c-b7a0-527a7520690e None admin] RBAC: Authorizing `identity:create_grant(project_id=c8bcd31836684fe5b43fd604df3d3e8b, user_id=e856fd5aff914cfb8b8dd86b39c89bd0, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:30.480909 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e068bd7-f38e-445c-b7a0-527a7520690e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:30.497125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 386/775] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:09:30 2022] PUT /identity/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/e856fd5aff914cfb8b8dd86b39c89bd0/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:09:30.498713 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e068bd7-f38e-445c-b7a0-527a7520690e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:30.511334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886c371-de06-4f36-81af-8bfd116d6e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:30.512283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886c371-de06-4f36-81af-8bfd116d6e26 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:30.512710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886c371-de06-4f36-81af-8bfd116d6e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:30.513150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886c371-de06-4f36-81af-8bfd116d6e26 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:30.514170 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886c371-de06-4f36-81af-8bfd116d6e26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:30.515954 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886c371-de06-4f36-81af-8bfd116d6e26 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:30.522875 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 390/776] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 1 14:09:30 2022] GET /identity/v3/services => generated 772 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:30.647934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e068bd7-f38e-445c-b7a0-527a7520690e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:30.657906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:30.696728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e49eeb-6d5e-4cd3-aac8-5847bf8cb2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:30.697606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e49eeb-6d5e-4cd3-aac8-5847bf8cb2c9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:30.698029 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e49eeb-6d5e-4cd3-aac8-5847bf8cb2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:30.698439 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e49eeb-6d5e-4cd3-aac8-5847bf8cb2c9 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:30.699281 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e49eeb-6d5e-4cd3-aac8-5847bf8cb2c9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:30.699868 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e49eeb-6d5e-4cd3-aac8-5847bf8cb2c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:30.701443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e49eeb-6d5e-4cd3-aac8-5847bf8cb2c9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:30.707879 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 387/777] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Aug 1 14:09:30 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:30.713366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886c371-de06-4f36-81af-8bfd116d6e26 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:30.795127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:30.953547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886c371-de06-4f36-81af-8bfd116d6e26 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:31.009166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614d9d35-2b64-4b59-879b-224c0a5799d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:31.009783 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d9d35-2b64-4b59-879b-224c0a5799d6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:31.010057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d9d35-2b64-4b59-879b-224c0a5799d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:31.010324 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614d9d35-2b64-4b59-879b-224c0a5799d6 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:31.011020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d9d35-2b64-4b59-879b-224c0a5799d6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:31.011320 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d9d35-2b64-4b59-879b-224c0a5799d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:31.012670 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614d9d35-2b64-4b59-879b-224c0a5799d6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:31.023796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 391/778] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Aug 1 14:09:30 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:31.029825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e49eeb-6d5e-4cd3-aac8-5847bf8cb2c9 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:31.159176 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9e789-dce0-464c-8a76-f9b04b5436de None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:31.159365 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9e789-dce0-464c-8a76-f9b04b5436de None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:31.159625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c9e789-dce0-464c-8a76-f9b04b5436de None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:31.161235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 392/779] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:31.166403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a32265-6046-41d8-8c37-ebb2f14ea824 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:31.166713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a32265-6046-41d8-8c37-ebb2f14ea824 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:31.166988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a32265-6046-41d8-8c37-ebb2f14ea824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:31.185442 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-43a32265-6046-41d8-8c37-ebb2f14ea824 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:31.186652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-43a32265-6046-41d8-8c37-ebb2f14ea824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:31.190124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e49eeb-6d5e-4cd3-aac8-5847bf8cb2c9 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:31.230790 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f1264-19cb-4a1e-9920-dc554f234534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:31.231417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f1264-19cb-4a1e-9920-dc554f234534 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:31.231699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f1264-19cb-4a1e-9920-dc554f234534 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:31.231974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46f1264-19cb-4a1e-9920-dc554f234534 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:31.232734 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f1264-19cb-4a1e-9920-dc554f234534 None admin] RBAC: Adding query filter params (interface=public, service_id=421cd43a732446dab5687b19a6a2b806, region_id=RegionOne) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:31.233045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f1264-19cb-4a1e-9920-dc554f234534 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:31.234568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46f1264-19cb-4a1e-9920-dc554f234534 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:31.240936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 388/780] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 1 14:09:31 2022] GET /identity/v3/endpoints?service_id=421cd43a732446dab5687b19a6a2b806&interface=public®ion_id=RegionOne => generated 194 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:31.245920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f1264-19cb-4a1e-9920-dc554f234534 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:31.289919 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 393/781] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:31.306920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:31.367029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a32265-6046-41d8-8c37-ebb2f14ea824 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:31.385900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46f1264-19cb-4a1e-9920-dc554f234534 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:31.425581 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edd281-6b79-4515-8105-39ed02b98399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:31.426153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edd281-6b79-4515-8105-39ed02b98399 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:31.426430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edd281-6b79-4515-8105-39ed02b98399 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:31.426730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edd281-6b79-4515-8105-39ed02b98399 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:31.430105 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edd281-6b79-4515-8105-39ed02b98399 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:31.430105 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edd281-6b79-4515-8105-39ed02b98399 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:31.442773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 389/782] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 1 14:09:31 2022] GET /identity/v3/services => generated 772 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:31.487813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:31.533538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a32265-6046-41d8-8c37-ebb2f14ea824 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:31.586497 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0874b6-f609-4309-9773-c6234f5a98f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:31.587661 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0874b6-f609-4309-9773-c6234f5a98f4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:31.588113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0874b6-f609-4309-9773-c6234f5a98f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:31.588545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0874b6-f609-4309-9773-c6234f5a98f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:31.603761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0874b6-f609-4309-9773-c6234f5a98f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-4d0874b6-f609-4309-9773-c6234f5a98f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:31.608857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:31.609986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:31.611049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:31.611049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:31.611049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:31.611049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:31.611049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:31.611049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:31.611049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:31.611049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:31.611049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:31.611049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:31.611049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:09:31.611049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:31.613445 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 394/783] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:09:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:31.619024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edd281-6b79-4515-8105-39ed02b98399 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:31.733514 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:31.739192 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edd281-6b79-4515-8105-39ed02b98399 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:31.775571 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd5174d-ea5c-4696-95b8-041cee3b5330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:31.776422 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5174d-ea5c-4696-95b8-041cee3b5330 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:31.776846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5174d-ea5c-4696-95b8-041cee3b5330 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:31.777289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd5174d-ea5c-4696-95b8-041cee3b5330 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:31.778156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5174d-ea5c-4696-95b8-041cee3b5330 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:31.778692 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5174d-ea5c-4696-95b8-041cee3b5330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:31.780217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd5174d-ea5c-4696-95b8-041cee3b5330 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:31.792124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 390/784] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:09:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:31.797715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0874b6-f609-4309-9773-c6234f5a98f4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:31.925370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0874b6-f609-4309-9773-c6234f5a98f4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:31.929033 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce14795-75ea-4e11-8b72-cc3df5fc14d4 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:31.929329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce14795-75ea-4e11-8b72-cc3df5fc14d4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:31.929607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce14795-75ea-4e11-8b72-cc3df5fc14d4 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:31.931257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 391/785] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:31.942878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2a20d-3f45-40fe-8b7d-f49606b63b73 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:31.943153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2a20d-3f45-40fe-8b7d-f49606b63b73 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:31.943435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b2a20d-3f45-40fe-8b7d-f49606b63b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:31.954973 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:31.965317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f13612-d24c-450a-8eee-7224152f2251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:31.965998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f13612-d24c-450a-8eee-7224152f2251 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:31.966279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f13612-d24c-450a-8eee-7224152f2251 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:31.966549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f13612-d24c-450a-8eee-7224152f2251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:31.979219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f13612-d24c-450a-8eee-7224152f2251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:31.980788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f13612-d24c-450a-8eee-7224152f2251 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:31.991745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-42b2a20d-3f45-40fe-8b7d-f49606b63b73 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:31.992882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-42b2a20d-3f45-40fe-8b7d-f49606b63b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:31.997663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-93f13612-d24c-450a-8eee-7224152f2251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:31.997663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:31.997663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:31.997663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:31.997663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:31.997663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:31.997663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:31.997663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:31.997663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:31.997663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:31.997663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:31.997663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:31.997663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:31.997663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:31.997663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:31.998556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:31.999485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:31.999485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:31.999485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:31.999485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:31.999485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 395/786] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:32.008974 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f13612-d24c-450a-8eee-7224152f2251 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:32.103220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 392/787] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:31 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:32.133145 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2a20d-3f45-40fe-8b7d-f49606b63b73 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:32.189514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f13612-d24c-450a-8eee-7224152f2251 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:32.251648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c0de1-5694-499e-b003-d938b3695e5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:32.252492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0de1-5694-499e-b003-d938b3695e5c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:32.252926 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0de1-5694-499e-b003-d938b3695e5c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:32.253365 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c0de1-5694-499e-b003-d938b3695e5c None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:32.254248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c0de1-5694-499e-b003-d938b3695e5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:32.255275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c0de1-5694-499e-b003-d938b3695e5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:32.257775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c0de1-5694-499e-b003-d938b3695e5c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:32.265882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:32.276572 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b2a20d-3f45-40fe-8b7d-f49606b63b73 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:32.282053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 396/788] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:32.287718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c0de1-5694-499e-b003-d938b3695e5c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:32.324431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32645416-32be-42d3-9373-490b26752bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:32.325090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32645416-32be-42d3-9373-490b26752bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:32.325352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32645416-32be-42d3-9373-490b26752bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:32.325623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32645416-32be-42d3-9373-490b26752bb4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:32.336401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32645416-32be-42d3-9373-490b26752bb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-32645416-32be-42d3-9373-490b26752bb4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:32.341537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:32.342478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:32.343353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:32.343353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:32.343353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:32.343353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:32.343353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:32.343353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:32.343353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:32.343353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:32.343353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:32.343353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:32.343353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:32.343353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:32.343353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 393/789] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:32.354612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32645416-32be-42d3-9373-490b26752bb4 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:32.381149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:32.452905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c0de1-5694-499e-b003-d938b3695e5c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:32.518918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3bec9-92e4-4201-ba65-a7bb1c0569da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:32.519485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3bec9-92e4-4201-ba65-a7bb1c0569da None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:32.519791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3bec9-92e4-4201-ba65-a7bb1c0569da None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:32.520068 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec3bec9-92e4-4201-ba65-a7bb1c0569da None admin] PATH_INFO: `/v3/users/swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:32.533710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3bec9-92e4-4201-ba65-a7bb1c0569da None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:32.546403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32645416-32be-42d3-9373-490b26752bb4 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:32.549151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec3bec9-92e4-4201-ba65-a7bb1c0569da None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-dec3bec9-92e4-4201-ba65-a7bb1c0569da None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:32.562437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:32.564481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:32.565538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:32.565538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:32.565538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:32.565538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:32.565538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:32.565538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:32.565538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:32.565538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:32.565538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:09:32.565538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:32.565538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 397/790] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:09:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:32.571597 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3bec9-92e4-4201-ba65-a7bb1c0569da None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:32.602846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429138-ec98-4d6c-af8e-d5c39107b78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:32.603901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429138-ec98-4d6c-af8e-d5c39107b78d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:32.604625 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429138-ec98-4d6c-af8e-d5c39107b78d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:32.605727 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0429138-ec98-4d6c-af8e-d5c39107b78d None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:32.606707 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0429138-ec98-4d6c-af8e-d5c39107b78d None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:32.607388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0429138-ec98-4d6c-af8e-d5c39107b78d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:32.610228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0429138-ec98-4d6c-af8e-d5c39107b78d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:32.627284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 394/791] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:32.633300 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429138-ec98-4d6c-af8e-d5c39107b78d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:32.653855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:32.751495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0429138-ec98-4d6c-af8e-d5c39107b78d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:32.801114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501bbc7-ba3b-490c-9e87-7e3b08201f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:32.801770 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501bbc7-ba3b-490c-9e87-7e3b08201f37 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:32.802299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501bbc7-ba3b-490c-9e87-7e3b08201f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:32.802594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3501bbc7-ba3b-490c-9e87-7e3b08201f37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:32.818378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501bbc7-ba3b-490c-9e87-7e3b08201f37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:32.819879 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3501bbc7-ba3b-490c-9e87-7e3b08201f37 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:32.820586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:32.826390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec3bec9-92e4-4201-ba65-a7bb1c0569da None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:32.849528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-3501bbc7-ba3b-490c-9e87-7e3b08201f37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:32.849528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:32.849528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:32.849528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:32.849528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:32.849528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:32.849528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:32.849528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:32.849528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:32.849528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:32.849528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:32.849528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:32.849528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:32.849528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:32.849528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:32.850482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:32.851438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:32.851438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:32.851438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:32.851438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:32.851692 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 395/792] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:32.859349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501bbc7-ba3b-490c-9e87-7e3b08201f37 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:32.893916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c54df-21ba-4fb0-82c8-4603b42bb62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:32.894534 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c54df-21ba-4fb0-82c8-4603b42bb62d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:32.895370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c54df-21ba-4fb0-82c8-4603b42bb62d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:32.895644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6c54df-21ba-4fb0-82c8-4603b42bb62d None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:32.896438 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c54df-21ba-4fb0-82c8-4603b42bb62d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:32.896741 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c54df-21ba-4fb0-82c8-4603b42bb62d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:32.898163 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6c54df-21ba-4fb0-82c8-4603b42bb62d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:32.935980 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 398/793] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Aug 1 14:09:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:32.948006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c54df-21ba-4fb0-82c8-4603b42bb62d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:32.958256 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:33.011773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3501bbc7-ba3b-490c-9e87-7e3b08201f37 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:33.047118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b4a7c0-264a-47ff-8bff-6298590593f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:33.047739 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4a7c0-264a-47ff-8bff-6298590593f3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:33.048017 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4a7c0-264a-47ff-8bff-6298590593f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:33.048289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b4a7c0-264a-47ff-8bff-6298590593f3 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:33.048979 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4a7c0-264a-47ff-8bff-6298590593f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:33.049281 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4a7c0-264a-47ff-8bff-6298590593f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:33.050689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b4a7c0-264a-47ff-8bff-6298590593f3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:33.070760 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 396/794] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:33.072193 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c70d76-2fcf-416c-979c-49e3f5f63332 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:33.072618 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c70d76-2fcf-416c-979c-49e3f5f63332 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:33.073010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c70d76-2fcf-416c-979c-49e3f5f63332 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:33.078475 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 397/795] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:33.078475 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c70d76-2fcf-416c-979c-49e3f5f63332 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:33.080380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6c54df-21ba-4fb0-82c8-4603b42bb62d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:33.122604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d21479-3bc2-44c4-b940-c47e90577001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:33.123262 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21479-3bc2-44c4-b940-c47e90577001 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:33.123541 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21479-3bc2-44c4-b940-c47e90577001 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:33.123814 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d21479-3bc2-44c4-b940-c47e90577001 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:33.134858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d21479-3bc2-44c4-b940-c47e90577001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:33.136334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d21479-3bc2-44c4-b940-c47e90577001 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:33.151988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-03d21479-3bc2-44c4-b940-c47e90577001 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:33.151988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:33.151988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:33.151988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:33.151988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:33.151988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:33.151988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:33.151988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:33.151988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:33.151988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:33.151988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:33.151988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:33.151988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:33.151988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:33.151988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:33.152921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:33.153834 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:33.153834 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:33.153834 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:33.153834 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:33.153834 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 399/796] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:33.155516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7f81d-d5a5-4592-aca3-48e8af062d9a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:33.155516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7f81d-d5a5-4592-aca3-48e8af062d9a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:33.155516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc7f81d-d5a5-4592-aca3-48e8af062d9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:33.173454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6bc7f81d-d5a5-4592-aca3-48e8af062d9a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:33.174678 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6bc7f81d-d5a5-4592-aca3-48e8af062d9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:33.176711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:33.197073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c70d76-2fcf-416c-979c-49e3f5f63332 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:33.222529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:33.234398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff50f70-7648-4fc0-89cc-da5f48ca4417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:33.235071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff50f70-7648-4fc0-89cc-da5f48ca4417 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:33.235352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff50f70-7648-4fc0-89cc-da5f48ca4417 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:33.235623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff50f70-7648-4fc0-89cc-da5f48ca4417 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:33.242944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff50f70-7648-4fc0-89cc-da5f48ca4417 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:33.244409 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff50f70-7648-4fc0-89cc-da5f48ca4417 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:33.254615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 400/797] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:33.254615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe58507-6d65-4fc0-b22c-3e0c136fb6a9 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:33.254615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe58507-6d65-4fc0-b22c-3e0c136fb6a9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:33.254615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe58507-6d65-4fc0-b22c-3e0c136fb6a9 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:33.254615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 401/798] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:33.254615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe58507-6d65-4fc0-b22c-3e0c136fb6a9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-aff50f70-7648-4fc0-89cc-da5f48ca4417 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:33.263352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:33.264479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:33.265614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:33.265614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:33.265614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:33.265614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:33.265614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:33.265614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:33.265614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:33.265614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:33.265614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:09:33.265614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:33.267265 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 398/799] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 1 14:09:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:33.271424 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774e494-2948-47f1-85d5-f2944930791e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:33.271712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774e494-2948-47f1-85d5-f2944930791e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:33.271994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8774e494-2948-47f1-85d5-f2944930791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:33.290175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8774e494-2948-47f1-85d5-f2944930791e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:33.291404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8774e494-2948-47f1-85d5-f2944930791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:33.359861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 399/800] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:33.367835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774e494-2948-47f1-85d5-f2944930791e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:33.374268 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe58507-6d65-4fc0-b22c-3e0c136fb6a9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:33.411239 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9687f-61ba-4c04-9b00-b5d0f4b21822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:33.411880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9687f-61ba-4c04-9b00-b5d0f4b21822 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:33.412174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9687f-61ba-4c04-9b00-b5d0f4b21822 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:33.412376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec9687f-61ba-4c04-9b00-b5d0f4b21822 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:33.413199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9687f-61ba-4c04-9b00-b5d0f4b21822 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:33.413505 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9687f-61ba-4c04-9b00-b5d0f4b21822 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:33.415024 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec9687f-61ba-4c04-9b00-b5d0f4b21822 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:33.421902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:33.434615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 402/801] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:33.434615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9687f-61ba-4c04-9b00-b5d0f4b21822 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:33.479568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8774e494-2948-47f1-85d5-f2944930791e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:33.494311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:33.516183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2258f0e-a6a7-4653-a117-a17020c37350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:33.517019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2258f0e-a6a7-4653-a117-a17020c37350 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:33.517375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2258f0e-a6a7-4653-a117-a17020c37350 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:33.517706 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2258f0e-a6a7-4653-a117-a17020c37350 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:33.518561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2258f0e-a6a7-4653-a117-a17020c37350 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:33.518960 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2258f0e-a6a7-4653-a117-a17020c37350 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:33.520667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2258f0e-a6a7-4653-a117-a17020c37350 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:33.537934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 400/802] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Aug 1 14:09:33 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:33.538912 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2258f0e-a6a7-4653-a117-a17020c37350 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:33.546166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec9687f-61ba-4c04-9b00-b5d0f4b21822 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:33.583336 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23849afb-96e0-420e-b8d0-12e88f35f554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:33.584165 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23849afb-96e0-420e-b8d0-12e88f35f554 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:33.584568 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23849afb-96e0-420e-b8d0-12e88f35f554 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:33.584901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23849afb-96e0-420e-b8d0-12e88f35f554 None admin] PATH_INFO: `/v3/services/network` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:33.585529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23849afb-96e0-420e-b8d0-12e88f35f554 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:33.586945 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23849afb-96e0-420e-b8d0-12e88f35f554 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-23849afb-96e0-420e-b8d0-12e88f35f554 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:33.599820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:33.600882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:33.601730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:33.601730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:33.601730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:33.601730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:33.601730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:33.601730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:33.601730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:33.601730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:33.601730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:33.601730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:33.601730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:33.601730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:33.601730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 01 14:09:33.601730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:33.601730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 403/803] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:33 2022] GET /identity/v3/services/network => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:33.602527 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23849afb-96e0-420e-b8d0-12e88f35f554 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:33.659294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2258f0e-a6a7-4653-a117-a17020c37350 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:33.675840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:33.698678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbe8a7-cfe4-4d79-b8eb-a2b3960dcafc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:33.699881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbe8a7-cfe4-4d79-b8eb-a2b3960dcafc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:33.700429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbe8a7-cfe4-4d79-b8eb-a2b3960dcafc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:33.700708 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dbe8a7-cfe4-4d79-b8eb-a2b3960dcafc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:33.714499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dbe8a7-cfe4-4d79-b8eb-a2b3960dcafc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:33.717443 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23849afb-96e0-420e-b8d0-12e88f35f554 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-e2dbe8a7-cfe4-4d79-b8eb-a2b3960dcafc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:33.721010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:33.722120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:33.723184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:33.723184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:33.723184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:33.723184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:33.723184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:33.723184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:33.723184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:33.723184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:33.723184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:33.723184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:33.723184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:09:33.723184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:33.726160 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 401/804] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:09:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:33.727274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbe8a7-cfe4-4d79-b8eb-a2b3960dcafc None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:33.756607 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a71542-d420-4b5c-b6f2-3a449a20dbfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:33.757392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a71542-d420-4b5c-b6f2-3a449a20dbfe None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:33.757769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a71542-d420-4b5c-b6f2-3a449a20dbfe None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:33.758140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a71542-d420-4b5c-b6f2-3a449a20dbfe None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:33.765368 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a71542-d420-4b5c-b6f2-3a449a20dbfe None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:33.765597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:33.767183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a71542-d420-4b5c-b6f2-3a449a20dbfe None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:33.779193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c4a71542-d420-4b5c-b6f2-3a449a20dbfe None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:33.779193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:33.779193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:33.779193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:33.779193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:33.779193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:33.779193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:33.779193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:33.779193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:33.779193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:33.779193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:33.779193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:33.779193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:33.779193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:33.779193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:33.780354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:33.781312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:33.781312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:33.781312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:33.781312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:33.781312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:33.781312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:33.781312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:33.781312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:33.781312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 404/805] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:33.781809 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a71542-d420-4b5c-b6f2-3a449a20dbfe None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:33.850795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dbe8a7-cfe4-4d79-b8eb-a2b3960dcafc None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:33.887011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf9e8f-9301-40b2-a16a-36b490a7d8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:33.887812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf9e8f-9301-40b2-a16a-36b490a7d8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:33.888193 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf9e8f-9301-40b2-a16a-36b490a7d8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:33.888571 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baf9e8f-9301-40b2-a16a-36b490a7d8c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:33.889293 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a71542-d420-4b5c-b6f2-3a449a20dbfe None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:33.899169 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf9e8f-9301-40b2-a16a-36b490a7d8c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:33.900811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baf9e8f-9301-40b2-a16a-36b490a7d8c5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:33.913358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:33.916945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-1baf9e8f-9301-40b2-a16a-36b490a7d8c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:33.916945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:33.916945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:33.916945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:33.916945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:33.916945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:33.916945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:33.916945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:33.916945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:33.916945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:33.916945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:33.916945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:33.916945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:33.916945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:33.916945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:33.917982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:33.919082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:33.919082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:33.919082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:33.919082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:33.920377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 402/806] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:33.921244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf9e8f-9301-40b2-a16a-36b490a7d8c5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:33.934848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132f736-e7b9-484d-afa3-5a50c6e76505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:33.935589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132f736-e7b9-484d-afa3-5a50c6e76505 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:33.935872 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132f736-e7b9-484d-afa3-5a50c6e76505 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:33.936146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3132f736-e7b9-484d-afa3-5a50c6e76505 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:33.936833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132f736-e7b9-484d-afa3-5a50c6e76505 None admin] RBAC: Adding query filter params (name=network) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:33.937134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132f736-e7b9-484d-afa3-5a50c6e76505 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:33.938621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3132f736-e7b9-484d-afa3-5a50c6e76505 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:33.947881 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 405/807] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 1 14:09:33 2022] GET /identity/v3/services?name=network => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:33.947881 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132f736-e7b9-484d-afa3-5a50c6e76505 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:34.016860 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:34.033503 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baf9e8f-9301-40b2-a16a-36b490a7d8c5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:34.060408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3132f736-e7b9-484d-afa3-5a50c6e76505 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:34.070990 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee20fed-dab4-471d-a562-35f1c6c799e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:34.071611 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee20fed-dab4-471d-a562-35f1c6c799e5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:34.071893 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee20fed-dab4-471d-a562-35f1c6c799e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:34.072170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee20fed-dab4-471d-a562-35f1c6c799e5 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:34.072886 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee20fed-dab4-471d-a562-35f1c6c799e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:34.073194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee20fed-dab4-471d-a562-35f1c6c799e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:34.074600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee20fed-dab4-471d-a562-35f1c6c799e5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:34.082782 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 403/808] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:09:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:34.083568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee20fed-dab4-471d-a562-35f1c6c799e5 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:34.095163 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de6ac4-eb97-4350-9d09-1397fea22404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:34.095776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de6ac4-eb97-4350-9d09-1397fea22404 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:34.096053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de6ac4-eb97-4350-9d09-1397fea22404 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:34.096325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72de6ac4-eb97-4350-9d09-1397fea22404 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:34.097067 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de6ac4-eb97-4350-9d09-1397fea22404 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:34.097370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de6ac4-eb97-4350-9d09-1397fea22404 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:34.099400 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72de6ac4-eb97-4350-9d09-1397fea22404 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:34.111253 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 406/809] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:34.112026 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de6ac4-eb97-4350-9d09-1397fea22404 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:34.157587 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:34.187006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee20fed-dab4-471d-a562-35f1c6c799e5 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:34.210865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72de6ac4-eb97-4350-9d09-1397fea22404 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:34.219808 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2964433-c066-4c21-8308-49e6caec8ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:34.220419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2964433-c066-4c21-8308-49e6caec8ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:34.220696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2964433-c066-4c21-8308-49e6caec8ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:34.220964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2964433-c066-4c21-8308-49e6caec8ab2 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:34.221646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2964433-c066-4c21-8308-49e6caec8ab2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:34.221947 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2964433-c066-4c21-8308-49e6caec8ab2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:34.223853 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2964433-c066-4c21-8308-49e6caec8ab2 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:34.235671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 404/810] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:34.236843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff105b-0659-4a07-85ff-4eb9757974cc None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:34.237128 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff105b-0659-4a07-85ff-4eb9757974cc None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:34.237396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff105b-0659-4a07-85ff-4eb9757974cc None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:34.242630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 405/811] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:34.242630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff105b-0659-4a07-85ff-4eb9757974cc None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:34.248606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:34.250488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948c47b-7bc0-4b94-a9c1-634686d89ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:34.251149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948c47b-7bc0-4b94-a9c1-634686d89ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:34.251786 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948c47b-7bc0-4b94-a9c1-634686d89ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:34.252063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6948c47b-7bc0-4b94-a9c1-634686d89ce6 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:34.252741 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948c47b-7bc0-4b94-a9c1-634686d89ce6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:34.253047 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948c47b-7bc0-4b94-a9c1-634686d89ce6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:34.254438 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6948c47b-7bc0-4b94-a9c1-634686d89ce6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:34.259236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 407/812] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 1 14:09:34 2022] GET /identity/v3/services?type=network => generated 350 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:34.259996 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948c47b-7bc0-4b94-a9c1-634686d89ce6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:34.344596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff105b-0659-4a07-85ff-4eb9757974cc None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:34.358151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6948c47b-7bc0-4b94-a9c1-634686d89ce6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:34.369175 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:34.378921 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157e9c2-5c39-4db9-ba14-8ff057eec041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:34.379558 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157e9c2-5c39-4db9-ba14-8ff057eec041 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:34.379831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157e9c2-5c39-4db9-ba14-8ff057eec041 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:34.380101 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3157e9c2-5c39-4db9-ba14-8ff057eec041 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:34.389850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157e9c2-5c39-4db9-ba14-8ff057eec041 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:34.391483 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3157e9c2-5c39-4db9-ba14-8ff057eec041 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:34.392885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a3952-c39c-4249-af0a-aa4b6cf641b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:34.393536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a3952-c39c-4249-af0a-aa4b6cf641b3 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:34.393813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a3952-c39c-4249-af0a-aa4b6cf641b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:34.394083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a3952-c39c-4249-af0a-aa4b6cf641b3 None admin] PATH_INFO: `/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/98cccf60a5424986b2e92b523542a640/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:34.396560 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a3952-c39c-4249-af0a-aa4b6cf641b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8bcd31836684fe5b43fd604df3d3e8b, user_id=98cccf60a5424986b2e92b523542a640, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:34.397957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a3952-c39c-4249-af0a-aa4b6cf641b3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:34.407642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-3157e9c2-5c39-4db9-ba14-8ff057eec041 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:34.407642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:34.407642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:34.407642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:34.407642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:34.407642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:34.407642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:34.407642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:34.407642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:34.407642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:34.407642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:34.407642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:34.407642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:34.407642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:34.407642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:34.408744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:34.410211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:34.410211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:34.410211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:34.410211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:34.410211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 406/813] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:34.410211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157e9c2-5c39-4db9-ba14-8ff057eec041 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:34.411917 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 408/814] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:09:34 2022] PUT /identity/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/98cccf60a5424986b2e92b523542a640/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:09:34.412899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4f0f3-8ca4-497e-aaf2-229e35cc37ad None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:34.413184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4f0f3-8ca4-497e-aaf2-229e35cc37ad None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:34.413457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4f0f3-8ca4-497e-aaf2-229e35cc37ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:34.432532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0da4f0f3-8ca4-497e-aaf2-229e35cc37ad None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:34.433758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0da4f0f3-8ca4-497e-aaf2-229e35cc37ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:34.489127 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:34.513987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 409/815] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:34.515576 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4f0f3-8ca4-497e-aaf2-229e35cc37ad None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:34.541995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3157e9c2-5c39-4db9-ba14-8ff057eec041 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:34.583305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d048c05-8787-4bb4-91e8-a3f03805e62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:34.583946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d048c05-8787-4bb4-91e8-a3f03805e62d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:34.584221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d048c05-8787-4bb4-91e8-a3f03805e62d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:34.584488 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d048c05-8787-4bb4-91e8-a3f03805e62d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:34.591820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d048c05-8787-4bb4-91e8-a3f03805e62d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:34.593371 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d048c05-8787-4bb4-91e8-a3f03805e62d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:34.605412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-7d048c05-8787-4bb4-91e8-a3f03805e62d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:34.605412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:34.605412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:34.605412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:34.605412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:34.605412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:34.605412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:34.605412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:34.605412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:34.605412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:34.605412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:34.605412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:34.605412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:34.605412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:34.605412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:34.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:34.607348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:34.607348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:34.607348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:34.607348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:34.607348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:34.607348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:34.607348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:34.607348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:34.607348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 407/816] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:34.607842 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d048c05-8787-4bb4-91e8-a3f03805e62d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:34.641456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:34.644611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4f0f3-8ca4-497e-aaf2-229e35cc37ad None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:34.683318 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a6913-1318-4504-9db6-723600adf2e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:34.683574 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a6913-1318-4504-9db6-723600adf2e4 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:34.683672 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a6913-1318-4504-9db6-723600adf2e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:34.683920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac6a6913-1318-4504-9db6-723600adf2e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:34.684629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a6913-1318-4504-9db6-723600adf2e4 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:34.685996 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac6a6913-1318-4504-9db6-723600adf2e4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:34.711281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 410/817] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:09:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:09:34.712108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a6913-1318-4504-9db6-723600adf2e4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:34.727814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d048c05-8787-4bb4-91e8-a3f03805e62d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:34.755602 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:34.788432 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d67961-3c4b-4bff-bcbb-b1f13f318929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:34.789913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d67961-3c4b-4bff-bcbb-b1f13f318929 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:34.790198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d67961-3c4b-4bff-bcbb-b1f13f318929 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:34.790470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d67961-3c4b-4bff-bcbb-b1f13f318929 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:34.791209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d67961-3c4b-4bff-bcbb-b1f13f318929 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:34.791513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d67961-3c4b-4bff-bcbb-b1f13f318929 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:34.792931 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d67961-3c4b-4bff-bcbb-b1f13f318929 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:34.811612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 408/818] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:34.812586 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d67961-3c4b-4bff-bcbb-b1f13f318929 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:34.846757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac6a6913-1318-4504-9db6-723600adf2e4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:34.887378 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29332588-f50c-438f-81c3-6478f0da055b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:34.888245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29332588-f50c-438f-81c3-6478f0da055b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:34.888778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29332588-f50c-438f-81c3-6478f0da055b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:34.889151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29332588-f50c-438f-81c3-6478f0da055b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:34.889890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29332588-f50c-438f-81c3-6478f0da055b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:34.891293 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29332588-f50c-438f-81c3-6478f0da055b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-29332588-f50c-438f-81c3-6478f0da055b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:34.902364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:34.903572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:34.904594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 411/819] 10.222.0.70 () {56 vars in 1129 bytes} [Mon Aug 1 14:09:34 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:34.905616 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29332588-f50c-438f-81c3-6478f0da055b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:34.935345 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:34.936290 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d67961-3c4b-4bff-bcbb-b1f13f318929 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:34.987106 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d9b69-f557-4c90-a1b4-62ab1793328d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:34.987843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d9b69-f557-4c90-a1b4-62ab1793328d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:34.988206 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d9b69-f557-4c90-a1b4-62ab1793328d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:34.989098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762d9b69-f557-4c90-a1b4-62ab1793328d None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:34.989965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d9b69-f557-4c90-a1b4-62ab1793328d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:34.990354 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d9b69-f557-4c90-a1b4-62ab1793328d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:34.991923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762d9b69-f557-4c90-a1b4-62ab1793328d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:35.010728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 409/820] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:35.010728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d9b69-f557-4c90-a1b4-62ab1793328d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:35.037702 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29332588-f50c-438f-81c3-6478f0da055b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:35.044594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:35.077730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440e377-bf5a-4bdb-9105-f07e38770b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:35.078677 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e377-bf5a-4bdb-9105-f07e38770b96 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:35.079104 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e377-bf5a-4bdb-9105-f07e38770b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:35.079523 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c440e377-bf5a-4bdb-9105-f07e38770b96 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:35.088531 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440e377-bf5a-4bdb-9105-f07e38770b96 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:35.090165 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c440e377-bf5a-4bdb-9105-f07e38770b96 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c440e377-bf5a-4bdb-9105-f07e38770b96 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:35.102998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:35.104130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:35.105216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:35.105216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:35.105216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:35.105216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:35.105216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:35.105216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:35.105216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:35.105216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:35.105216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:09:35.105216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:35.111670 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 412/821] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 1 14:09:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:35.112189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440e377-bf5a-4bdb-9105-f07e38770b96 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:35.117900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762d9b69-f557-4c90-a1b4-62ab1793328d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:35.153743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc460bd6-e6ad-4965-bd15-70a4420e08c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:35.154358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc460bd6-e6ad-4965-bd15-70a4420e08c9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:35.154672 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc460bd6-e6ad-4965-bd15-70a4420e08c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:35.154949 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc460bd6-e6ad-4965-bd15-70a4420e08c9 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:35.155622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc460bd6-e6ad-4965-bd15-70a4420e08c9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:35.155923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc460bd6-e6ad-4965-bd15-70a4420e08c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:35.157298 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc460bd6-e6ad-4965-bd15-70a4420e08c9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:35.162296 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 410/822] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Aug 1 14:09:35 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:35.163103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc460bd6-e6ad-4965-bd15-70a4420e08c9 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:35.203397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:35.225715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c440e377-bf5a-4bdb-9105-f07e38770b96 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:35.261078 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5439e6c-c3e4-45c5-b019-33cad81bf846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:35.261666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5439e6c-c3e4-45c5-b019-33cad81bf846 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:35.261950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5439e6c-c3e4-45c5-b019-33cad81bf846 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:35.262227 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5439e6c-c3e4-45c5-b019-33cad81bf846 None admin] PATH_INFO: `/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/83ab2b0e5f244881900f6f3f7f591983/roles/7db30e557e5b4d789838af5eb5985bf5` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:35.267637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:35.272033 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc460bd6-e6ad-4965-bd15-70a4420e08c9 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:35.278171 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5439e6c-c3e4-45c5-b019-33cad81bf846 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8bcd31836684fe5b43fd604df3d3e8b, user_id=83ab2b0e5f244881900f6f3f7f591983, role_id=7db30e557e5b4d789838af5eb5985bf5)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:35.279645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5439e6c-c3e4-45c5-b019-33cad81bf846 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:35.302610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 413/823] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:09:35 2022] PUT /identity/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/83ab2b0e5f244881900f6f3f7f591983/roles/7db30e557e5b4d789838af5eb5985bf5 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:09:35.302610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5439e6c-c3e4-45c5-b019-33cad81bf846 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:35.308775 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98da3c3-8c8a-4f04-af9c-7dd12769f1ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:35.309406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98da3c3-8c8a-4f04-af9c-7dd12769f1ea None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:35.309684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98da3c3-8c8a-4f04-af9c-7dd12769f1ea None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:35.309955 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98da3c3-8c8a-4f04-af9c-7dd12769f1ea None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:35.310788 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98da3c3-8c8a-4f04-af9c-7dd12769f1ea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:35.311094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98da3c3-8c8a-4f04-af9c-7dd12769f1ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:35.312569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98da3c3-8c8a-4f04-af9c-7dd12769f1ea None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:35.333533 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 411/824] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 1 14:09:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:35.339420 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98da3c3-8c8a-4f04-af9c-7dd12769f1ea None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:35.438902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5439e6c-c3e4-45c5-b019-33cad81bf846 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:35.475113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98da3c3-8c8a-4f04-af9c-7dd12769f1ea None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:35.478082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:35.484918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5eb0cb-beb3-4ca2-982f-0901757ede68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:35.485676 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5eb0cb-beb3-4ca2-982f-0901757ede68 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:35.486055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5eb0cb-beb3-4ca2-982f-0901757ede68 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:35.486431 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5eb0cb-beb3-4ca2-982f-0901757ede68 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:35.487330 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5eb0cb-beb3-4ca2-982f-0901757ede68 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:35.487871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5eb0cb-beb3-4ca2-982f-0901757ede68 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:35.489934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5eb0cb-beb3-4ca2-982f-0901757ede68 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:35.496329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 414/825] 10.222.0.70 () {56 vars in 1124 bytes} [Mon Aug 1 14:09:35 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:35.502749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5eb0cb-beb3-4ca2-982f-0901757ede68 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:35.516709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a7d42-61b9-4c7b-ad83-d735fa1f004c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:35.517268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a7d42-61b9-4c7b-ad83-d735fa1f004c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:35.517560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a7d42-61b9-4c7b-ad83-d735fa1f004c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:35.517824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a7d42-61b9-4c7b-ad83-d735fa1f004c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:35.547725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:35.600169 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a7d42-61b9-4c7b-ad83-d735fa1f004c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:35.602159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985a7d42-61b9-4c7b-ad83-d735fa1f004c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:35.625143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5eb0cb-beb3-4ca2-982f-0901757ede68 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:35.661198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dcd0e-f84d-4f4b-8f53-d99c3a3a2362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:35.661826 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dcd0e-f84d-4f4b-8f53-d99c3a3a2362 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:35.662110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dcd0e-f84d-4f4b-8f53-d99c3a3a2362 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:35.662387 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5dcd0e-f84d-4f4b-8f53-d99c3a3a2362 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:35.663146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dcd0e-f84d-4f4b-8f53-d99c3a3a2362 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:35.664545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5dcd0e-f84d-4f4b-8f53-d99c3a3a2362 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:35.687369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 415/826] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:09:35 2022] POST /identity/v3/endpoints => generated 346 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:09:35.725075 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 412/827] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:35 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 14:09:35.730682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dcd0e-f84d-4f4b-8f53-d99c3a3a2362 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:35.789139 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:35.850596 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5dcd0e-f84d-4f4b-8f53-d99c3a3a2362 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:35.886195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbaaaa-5ac5-41db-87ae-b174cb85da56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:35.886873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbaaaa-5ac5-41db-87ae-b174cb85da56 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:35.887156 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbaaaa-5ac5-41db-87ae-b174cb85da56 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:35.887429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cbaaaa-5ac5-41db-87ae-b174cb85da56 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:35.899283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbaaaa-5ac5-41db-87ae-b174cb85da56 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:35.900733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cbaaaa-5ac5-41db-87ae-b174cb85da56 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:35.916408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-84cbaaaa-5ac5-41db-87ae-b174cb85da56 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:35.916408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:35.916408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:35.916408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:35.916408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:35.916408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:35.916408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:35.916408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:35.916408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:35.916408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:35.916408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:35.916408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:35.916408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:35.916408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:35.916408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:35.917327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:35.918217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:35.918217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:35.918217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:35.918217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:35.920426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 416/828] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:35.925727 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a7d42-61b9-4c7b-ad83-d735fa1f004c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:35.986285 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:36.032699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985a7d42-61b9-4c7b-ad83-d735fa1f004c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:36.068322 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978f16a-cb7f-4c53-84f2-d5007cc5efb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:36.069066 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978f16a-cb7f-4c53-84f2-d5007cc5efb7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:36.069444 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978f16a-cb7f-4c53-84f2-d5007cc5efb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:36.069818 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1978f16a-cb7f-4c53-84f2-d5007cc5efb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:36.070687 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978f16a-cb7f-4c53-84f2-d5007cc5efb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:36.071092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978f16a-cb7f-4c53-84f2-d5007cc5efb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:36.072675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1978f16a-cb7f-4c53-84f2-d5007cc5efb7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:36.085615 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 413/829] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:36.091410 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbaaaa-5ac5-41db-87ae-b174cb85da56 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:36.193437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:36.198603 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cbaaaa-5ac5-41db-87ae-b174cb85da56 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:36.232572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a138b-dcdc-469c-b583-af7a5927f037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:36.233284 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a138b-dcdc-469c-b583-af7a5927f037 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:36.233567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a138b-dcdc-469c-b583-af7a5927f037 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:36.233842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43a138b-dcdc-469c-b583-af7a5927f037 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:36.241371 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a138b-dcdc-469c-b583-af7a5927f037 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:36.243219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43a138b-dcdc-469c-b583-af7a5927f037 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:36.255376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e43a138b-dcdc-469c-b583-af7a5927f037 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:36.255376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:36.255376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:36.255376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:36.255376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:36.255376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:36.255376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:36.255376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:36.255376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:36.255376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:36.255376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:36.255376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:36.255376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:36.255376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:36.255376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:36.256267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:36.257223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:36.257223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:36.257223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:36.257223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:36.257223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:36.257223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:36.257223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:36.257223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:36.257223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 417/830] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:36.262626 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978f16a-cb7f-4c53-84f2-d5007cc5efb7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:36.366451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1978f16a-cb7f-4c53-84f2-d5007cc5efb7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:36.386976 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:36.401587 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c9def2-4898-4847-8a02-0c542a27a2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:36.402220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9def2-4898-4847-8a02-0c542a27a2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:36.402845 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9def2-4898-4847-8a02-0c542a27a2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:36.403187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c9def2-4898-4847-8a02-0c542a27a2b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:36.404005 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9def2-4898-4847-8a02-0c542a27a2b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:36.404380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9def2-4898-4847-8a02-0c542a27a2b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:36.405880 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c9def2-4898-4847-8a02-0c542a27a2b4 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:36.419508 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 414/831] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:36.425028 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a138b-dcdc-469c-b583-af7a5927f037 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:36.490562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bea920-f3af-4ec6-a71e-6f9158b71982 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:36.491539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bea920-f3af-4ec6-a71e-6f9158b71982 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:36.492010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bea920-f3af-4ec6-a71e-6f9158b71982 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:36.493792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 415/832] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:09:36.498809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8ce11-af72-4007-b206-c41da3cafbcd None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:36.499307 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8ce11-af72-4007-b206-c41da3cafbcd None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:36.499794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d8ce11-af72-4007-b206-c41da3cafbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:36.518482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-65d8ce11-af72-4007-b206-c41da3cafbcd None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:36.520060 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-65d8ce11-af72-4007-b206-c41da3cafbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:36.540310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43a138b-dcdc-469c-b583-af7a5927f037 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:36.589140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb13f1-5eeb-468c-a3cc-5832706b9a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:36.589767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb13f1-5eeb-468c-a3cc-5832706b9a10 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:36.590196 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb13f1-5eeb-468c-a3cc-5832706b9a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:36.590477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdb13f1-5eeb-468c-a3cc-5832706b9a10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:36.591641 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb13f1-5eeb-468c-a3cc-5832706b9a10 None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=e856fd5aff914cfb8b8dd86b39c89bd0) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:36.592219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb13f1-5eeb-468c-a3cc-5832706b9a10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:36.593898 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdb13f1-5eeb-468c-a3cc-5832706b9a10 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:36.599474 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 416/833] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:36 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:09:36.604971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 418/834] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:36 2022] GET /identity/v3/role_assignments?user.id=e856fd5aff914cfb8b8dd86b39c89bd0&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=0681632796d144f6a7ac8eca157001ec => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:36.622820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8ce11-af72-4007-b206-c41da3cafbcd None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:36.752167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d8ce11-af72-4007-b206-c41da3cafbcd None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:36.762385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:36.791583 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a633d-f161-413d-9a08-84a74524cfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:36.792232 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a633d-f161-413d-9a08-84a74524cfb4 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:36.792571 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a633d-f161-413d-9a08-84a74524cfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:36.792920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2a633d-f161-413d-9a08-84a74524cfb4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:36.803714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2a633d-f161-413d-9a08-84a74524cfb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-4f2a633d-f161-413d-9a08-84a74524cfb4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:36.808536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:36.809442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:36.810270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:36.810270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:36.810270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:36.810270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:36.810270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:36.810270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:36.810270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:36.810270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:36.810270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:36.810270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:36.810270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:09:36.810270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:36.810270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 417/835] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:09:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:36.815908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb13f1-5eeb-468c-a3cc-5832706b9a10 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:36.858166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:36.943558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdb13f1-5eeb-468c-a3cc-5832706b9a10 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:36.983691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4bd3b-48dc-40cc-aa77-2cc4a7b3ccda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:36.984653 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4bd3b-48dc-40cc-aa77-2cc4a7b3ccda None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:36.985119 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4bd3b-48dc-40cc-aa77-2cc4a7b3ccda None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:36.985573 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4bd3b-48dc-40cc-aa77-2cc4a7b3ccda None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:36.986528 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4bd3b-48dc-40cc-aa77-2cc4a7b3ccda None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:36.987053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4bd3b-48dc-40cc-aa77-2cc4a7b3ccda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:36.988715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4bd3b-48dc-40cc-aa77-2cc4a7b3ccda None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:37.001793 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 419/836] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:09:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:37.007935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a633d-f161-413d-9a08-84a74524cfb4 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:37.123771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2a633d-f161-413d-9a08-84a74524cfb4 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:37.159681 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89e9b8-5891-419e-8718-db35e106298a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:37.160656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89e9b8-5891-419e-8718-db35e106298a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:37.161122 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89e9b8-5891-419e-8718-db35e106298a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:37.161581 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89e9b8-5891-419e-8718-db35e106298a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:37.173042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89e9b8-5891-419e-8718-db35e106298a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:37.174817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89e9b8-5891-419e-8718-db35e106298a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:37.189839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-da89e9b8-5891-419e-8718-db35e106298a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:37.189839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:37.189839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:37.189839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:37.189839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:37.189839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:37.189839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:37.189839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:37.189839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:37.189839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:37.189839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:37.189839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:37.189839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:37.189839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:37.189839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:37.190791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:37.192253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:37.192253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:37.192253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:37.192253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:37.194222 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 418/837] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:37.199600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4bd3b-48dc-40cc-aa77-2cc4a7b3ccda None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:37.289322 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:37.306972 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4bd3b-48dc-40cc-aa77-2cc4a7b3ccda None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:37.342674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2c64f-3ea6-4a06-ac61-0e77e1749746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:37.343300 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2c64f-3ea6-4a06-ac61-0e77e1749746 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:37.343578 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2c64f-3ea6-4a06-ac61-0e77e1749746 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:37.343849 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff2c64f-3ea6-4a06-ac61-0e77e1749746 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:37.344535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2c64f-3ea6-4a06-ac61-0e77e1749746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:37.344838 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2c64f-3ea6-4a06-ac61-0e77e1749746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:37.346197 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff2c64f-3ea6-4a06-ac61-0e77e1749746 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:37.358997 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 420/838] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:37.365057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89e9b8-5891-419e-8718-db35e106298a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:37.391608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:37.480839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89e9b8-5891-419e-8718-db35e106298a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:37.516576 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa955d2-3d25-4208-b721-22b770a2c7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:37.517966 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa955d2-3d25-4208-b721-22b770a2c7f3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:37.518448 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa955d2-3d25-4208-b721-22b770a2c7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:37.518927 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa955d2-3d25-4208-b721-22b770a2c7f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:37.527124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa955d2-3d25-4208-b721-22b770a2c7f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:37.528850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa955d2-3d25-4208-b721-22b770a2c7f3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-faa955d2-3d25-4208-b721-22b770a2c7f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:37.540605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:37.541594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:37.542607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:37.542607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:37.542607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:37.542607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:37.542607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:37.542607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:37.542607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:37.542607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:37.542607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 01 14:09:37.542607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:37.544811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 419/839] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:09:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:37.554614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2c64f-3ea6-4a06-ac61-0e77e1749746 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:37.589598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9cdd4-a66e-4e9e-8e10-67c80708b3a3 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:37.589932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9cdd4-a66e-4e9e-8e10-67c80708b3a3 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:37.590160 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b9cdd4-a66e-4e9e-8e10-67c80708b3a3 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:37.591783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 420/840] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:09:37.597305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1811a4-b5a4-42ba-acc1-7d90bdbf4d9d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:37.597593 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1811a4-b5a4-42ba-acc1-7d90bdbf4d9d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:37.598438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1811a4-b5a4-42ba-acc1-7d90bdbf4d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:37.621941 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-6d1811a4-b5a4-42ba-acc1-7d90bdbf4d9d None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:37.623423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6d1811a4-b5a4-42ba-acc1-7d90bdbf4d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:37.670782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff2c64f-3ea6-4a06-ac61-0e77e1749746 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:37.714225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b4504-eea7-4205-9980-7adf21aad8c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:37.714872 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b4504-eea7-4205-9980-7adf21aad8c7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:37.715146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b4504-eea7-4205-9980-7adf21aad8c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:37.715419 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735b4504-eea7-4205-9980-7adf21aad8c7 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:37.716210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b4504-eea7-4205-9980-7adf21aad8c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:37.716513 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b4504-eea7-4205-9980-7adf21aad8c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:37.717945 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735b4504-eea7-4205-9980-7adf21aad8c7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:37.726252 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 421/841] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:37 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:09:37.742828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 421/842] 10.222.0.70 () {56 vars in 1135 bytes} [Mon Aug 1 14:09:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:37.747629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1811a4-b5a4-42ba-acc1-7d90bdbf4d9d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:37.749723 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b4504-eea7-4205-9980-7adf21aad8c7 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:37.752721 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:37.761307 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:37.861063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1811a4-b5a4-42ba-acc1-7d90bdbf4d9d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:37.878747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735b4504-eea7-4205-9980-7adf21aad8c7 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:37.897961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedea224-a9a0-4f3d-8a42-5dd99078151e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:37.898627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedea224-a9a0-4f3d-8a42-5dd99078151e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:37.898911 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedea224-a9a0-4f3d-8a42-5dd99078151e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:37.899182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedea224-a9a0-4f3d-8a42-5dd99078151e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:37.924936 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e1777b-2786-4fde-aed0-7078f08a5328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:37.925575 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1777b-2786-4fde-aed0-7078f08a5328 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:37.926519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1777b-2786-4fde-aed0-7078f08a5328 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:37.926861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e1777b-2786-4fde-aed0-7078f08a5328 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:37.937178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e1777b-2786-4fde-aed0-7078f08a5328 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-d5e1777b-2786-4fde-aed0-7078f08a5328 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:37.941991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:37.943135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:37.943976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:37.943976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:37.943976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:37.943976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:37.943976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:37.943976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:37.943976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:37.943976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:37.943976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:37.943976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:37.943976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:09:37.943976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:37.943976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 422/843] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:09:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:37.944748 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37150875-2ef3-4974-a9c1-6294780daee9 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:37.944748 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37150875-2ef3-4974-a9c1-6294780daee9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:37.944882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37150875-2ef3-4974-a9c1-6294780daee9 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:37.946197 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 423/844] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:37.948775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37150875-2ef3-4974-a9c1-6294780daee9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:37.978712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedea224-a9a0-4f3d-8a42-5dd99078151e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:37.981201 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedea224-a9a0-4f3d-8a42-5dd99078151e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:37.993443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:38.017088 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:38.058770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37150875-2ef3-4974-a9c1-6294780daee9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:38.100710 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 422/845] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:37 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:09:38.100884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8970b-4705-47b3-a196-e36a8b720f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:38.100884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8970b-4705-47b3-a196-e36a8b720f54 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:38.100884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8970b-4705-47b3-a196-e36a8b720f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:38.100884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c8970b-4705-47b3-a196-e36a8b720f54 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:38.101192 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dbd80-1f16-47fd-9eaa-0181a8ff89ba None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:38.101264 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8970b-4705-47b3-a196-e36a8b720f54 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:38.101342 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dbd80-1f16-47fd-9eaa-0181a8ff89ba None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:38.101413 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8970b-4705-47b3-a196-e36a8b720f54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:38.101482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19dbd80-1f16-47fd-9eaa-0181a8ff89ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:38.101550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c8970b-4705-47b3-a196-e36a8b720f54 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:38.110784 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 424/846] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:09:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:38.115036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8970b-4705-47b3-a196-e36a8b720f54 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:38.121021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c19dbd80-1f16-47fd-9eaa-0181a8ff89ba None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:38.122386 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c19dbd80-1f16-47fd-9eaa-0181a8ff89ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:38.192788 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 423/847] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:38 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:38.194083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dbd80-1f16-47fd-9eaa-0181a8ff89ba None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:38.224571 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c8970b-4705-47b3-a196-e36a8b720f54 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:38.244248 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:38.249264 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:38.261917 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad095950-326d-4322-9789-43b320d4ca90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:38.262556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad095950-326d-4322-9789-43b320d4ca90 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:38.262862 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad095950-326d-4322-9789-43b320d4ca90 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:38.263136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad095950-326d-4322-9789-43b320d4ca90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:38.273703 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad095950-326d-4322-9789-43b320d4ca90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:38.275227 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad095950-326d-4322-9789-43b320d4ca90 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:38.290887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ad095950-326d-4322-9789-43b320d4ca90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:38.290887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:38.290887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:38.290887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:38.290887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:38.290887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:38.290887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:38.290887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:38.290887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:38.290887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:38.290887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:38.290887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:38.290887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:38.290887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:38.290887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:38.291844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:38.292737 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:38.292737 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:38.292737 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:38.292737 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:38.292737 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 425/848] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:38.293023 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad095950-326d-4322-9789-43b320d4ca90 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:38.311385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19dbd80-1f16-47fd-9eaa-0181a8ff89ba None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:38.346832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65e50c-95d4-4ca4-8d93-89f8ecfd878c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:38.347474 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65e50c-95d4-4ca4-8d93-89f8ecfd878c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:38.348292 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65e50c-95d4-4ca4-8d93-89f8ecfd878c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:38.348565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b65e50c-95d4-4ca4-8d93-89f8ecfd878c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:38.358867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65e50c-95d4-4ca4-8d93-89f8ecfd878c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:38.360332 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b65e50c-95d4-4ca4-8d93-89f8ecfd878c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:38.375358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-1b65e50c-95d4-4ca4-8d93-89f8ecfd878c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:38.375358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:38.375358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:38.375358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:38.375358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:38.375358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:38.375358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:38.375358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:38.375358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:38.375358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:38.375358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:38.375358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:38.375358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:38.375358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:38.375358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:38.376277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:38.377175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:38.377175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:38.377175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:38.377175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:38.377175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 424/849] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:38.377473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65e50c-95d4-4ca4-8d93-89f8ecfd878c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:38.408485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad095950-326d-4322-9789-43b320d4ca90 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:38.449306 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bef36d-15d3-4185-aaef-aa5e65ff25a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:38.450334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bef36d-15d3-4185-aaef-aa5e65ff25a4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:38.450752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bef36d-15d3-4185-aaef-aa5e65ff25a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:38.451029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bef36d-15d3-4185-aaef-aa5e65ff25a4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:38.451654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bef36d-15d3-4185-aaef-aa5e65ff25a4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:38.453030 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bef36d-15d3-4185-aaef-aa5e65ff25a4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b7bef36d-15d3-4185-aaef-aa5e65ff25a4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:38.462884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:38.463915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:38.464739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:38.464739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:38.464739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:38.464739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:38.464739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:38.464739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:38.464739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:38.464739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:38.464739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:38.464739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:38.464739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:38.464739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:38.464739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:09:38.464739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:38.468058 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 426/850] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:09:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:38.468058 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bef36d-15d3-4185-aaef-aa5e65ff25a4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:38.484197 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:38.496703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b65e50c-95d4-4ca4-8d93-89f8ecfd878c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:38.512974 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:38.538183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fd72b-9dea-4007-b91a-6c9d6b923ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:38.538838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fd72b-9dea-4007-b91a-6c9d6b923ecb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:38.539116 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fd72b-9dea-4007-b91a-6c9d6b923ecb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:38.539387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6fd72b-9dea-4007-b91a-6c9d6b923ecb None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:38.540073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fd72b-9dea-4007-b91a-6c9d6b923ecb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:38.540372 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fd72b-9dea-4007-b91a-6c9d6b923ecb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:38.541753 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6fd72b-9dea-4007-b91a-6c9d6b923ecb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:38.555257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 425/851] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:38.555873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fd72b-9dea-4007-b91a-6c9d6b923ecb None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:38.581243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bef36d-15d3-4185-aaef-aa5e65ff25a4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:38.618002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8678a06-f8a7-4ab1-a510-cf781f92be8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:38.618641 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8678a06-f8a7-4ab1-a510-cf781f92be8d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:38.618932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8678a06-f8a7-4ab1-a510-cf781f92be8d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:38.619204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8678a06-f8a7-4ab1-a510-cf781f92be8d None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:38.619947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8678a06-f8a7-4ab1-a510-cf781f92be8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:38.620272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8678a06-f8a7-4ab1-a510-cf781f92be8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:38.621744 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8678a06-f8a7-4ab1-a510-cf781f92be8d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:38.635812 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 427/852] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:38.639449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8678a06-f8a7-4ab1-a510-cf781f92be8d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:38.666368 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6fd72b-9dea-4007-b91a-6c9d6b923ecb None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:38.704177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b31c0b-f8f7-4395-a519-1188acdcb7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:38.704806 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b31c0b-f8f7-4395-a519-1188acdcb7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:38.705094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b31c0b-f8f7-4395-a519-1188acdcb7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:38.705371 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b31c0b-f8f7-4395-a519-1188acdcb7a7 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:38.706047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b31c0b-f8f7-4395-a519-1188acdcb7a7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:38.706351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b31c0b-f8f7-4395-a519-1188acdcb7a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:38.707849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b31c0b-f8f7-4395-a519-1188acdcb7a7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:38.713397 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 426/853] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:09:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:38.718734 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b31c0b-f8f7-4395-a519-1188acdcb7a7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:38.739748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:38.757446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:38.760451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8678a06-f8a7-4ab1-a510-cf781f92be8d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:38.796855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18ba76-0262-41be-876c-0825a5460c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:38.797499 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18ba76-0262-41be-876c-0825a5460c04 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:38.797773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18ba76-0262-41be-876c-0825a5460c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:38.798086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe18ba76-0262-41be-876c-0825a5460c04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:38.804599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18ba76-0262-41be-876c-0825a5460c04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:38.806039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe18ba76-0262-41be-876c-0825a5460c04 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:38.817564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-fe18ba76-0262-41be-876c-0825a5460c04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:38.817564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:38.817564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:38.817564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:38.817564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:38.817564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:38.817564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:38.817564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:38.817564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:38.817564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:38.817564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:38.817564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:38.817564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:38.817564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:38.817564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:38.818454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:38.820215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:38.820215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:38.820215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:38.820215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:38.820215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:38.820215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:38.820215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:38.820215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:38.820215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 428/854] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:38.820215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18ba76-0262-41be-876c-0825a5460c04 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:38.843581 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b31c0b-f8f7-4395-a519-1188acdcb7a7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:38.876772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a137d5-1052-4430-a442-c57b638712de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:38.877405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a137d5-1052-4430-a442-c57b638712de None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:38.877685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a137d5-1052-4430-a442-c57b638712de None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:38.877962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a137d5-1052-4430-a442-c57b638712de None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:38.884861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a137d5-1052-4430-a442-c57b638712de None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:38.886308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a137d5-1052-4430-a442-c57b638712de None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-02a137d5-1052-4430-a442-c57b638712de None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:38.898316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:38.899287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:38.900251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:38.900251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:38.900251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:38.900251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:38.900251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:38.900251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:38.900251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:38.900251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:38.900251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:09:38.900251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:38.900251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 427/855] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 1 14:09:38 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:38.900849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b6ae9-254b-46d0-a05d-9fad634565e7 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:38.900919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b6ae9-254b-46d0-a05d-9fad634565e7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:38.901244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044b6ae9-254b-46d0-a05d-9fad634565e7 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:38.902473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 428/856] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:38 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:38.903124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b6ae9-254b-46d0-a05d-9fad634565e7 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:38.921118 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe18ba76-0262-41be-876c-0825a5460c04 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:38.953986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fb13a-82db-412a-bbf6-7464573de9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:38.954612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fb13a-82db-412a-bbf6-7464573de9f4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:38.954901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fb13a-82db-412a-bbf6-7464573de9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:38.955175 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6fb13a-82db-412a-bbf6-7464573de9f4 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:38.955848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fb13a-82db-412a-bbf6-7464573de9f4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:38.956153 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fb13a-82db-412a-bbf6-7464573de9f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:38.958059 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6fb13a-82db-412a-bbf6-7464573de9f4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:38.962970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 429/857] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:09:38 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:38.963586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fb13a-82db-412a-bbf6-7464573de9f4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:38.983546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:39.004308 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:39.016318 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044b6ae9-254b-46d0-a05d-9fad634565e7 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:39.056088 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952d1ccd-62f6-41c6-88f6-3d71dfde3d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:39.057111 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d1ccd-62f6-41c6-88f6-3d71dfde3d7d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:39.057734 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d1ccd-62f6-41c6-88f6-3d71dfde3d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:39.058207 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952d1ccd-62f6-41c6-88f6-3d71dfde3d7d None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:39.059280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d1ccd-62f6-41c6-88f6-3d71dfde3d7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:39.059659 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d1ccd-62f6-41c6-88f6-3d71dfde3d7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:39.061205 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952d1ccd-62f6-41c6-88f6-3d71dfde3d7d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:39.080598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 429/858] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:39.080598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11186028-23a7-4651-82d3-bd48b43d3547 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:39.080598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11186028-23a7-4651-82d3-bd48b43d3547 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:39.080598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11186028-23a7-4651-82d3-bd48b43d3547 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:39.105077 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-11186028-23a7-4651-82d3-bd48b43d3547 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:39.106326 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-11186028-23a7-4651-82d3-bd48b43d3547 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:39.106610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6fb13a-82db-412a-bbf6-7464573de9f4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:39.151270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3f923-20b5-4b64-b6b1-24596072d719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:39.151902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3f923-20b5-4b64-b6b1-24596072d719 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:39.152181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3f923-20b5-4b64-b6b1-24596072d719 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:39.152455 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb3f923-20b5-4b64-b6b1-24596072d719 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:39.153250 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3f923-20b5-4b64-b6b1-24596072d719 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:39.153559 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3f923-20b5-4b64-b6b1-24596072d719 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:39.155016 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb3f923-20b5-4b64-b6b1-24596072d719 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:39.178745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 430/859] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Aug 1 14:09:38 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:39.179646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3f923-20b5-4b64-b6b1-24596072d719 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:39.215585 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 430/860] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:39 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:39.216880 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11186028-23a7-4651-82d3-bd48b43d3547 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:39.306050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:39.307836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:39.333723 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb3f923-20b5-4b64-b6b1-24596072d719 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:39.352651 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11186028-23a7-4651-82d3-bd48b43d3547 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:39.374555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33134988-2f84-484a-9c5b-87d7d8c67947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:39.375211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33134988-2f84-484a-9c5b-87d7d8c67947 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:39.375495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33134988-2f84-484a-9c5b-87d7d8c67947 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:39.375871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33134988-2f84-484a-9c5b-87d7d8c67947 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:39.376705 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33134988-2f84-484a-9c5b-87d7d8c67947 None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=98cccf60a5424986b2e92b523542a640) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:39.377017 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33134988-2f84-484a-9c5b-87d7d8c67947 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:39.378704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33134988-2f84-484a-9c5b-87d7d8c67947 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:39.390054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f008a-3855-4f3e-8875-183ef3b0b3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:39.390726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f008a-3855-4f3e-8875-183ef3b0b3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:39.390973 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 431/861] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:39 2022] GET /identity/v3/role_assignments?user.id=98cccf60a5424986b2e92b523542a640&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=0681632796d144f6a7ac8eca157001ec => generated 608 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:39.391099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f008a-3855-4f3e-8875-183ef3b0b3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:39.391269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518f008a-3855-4f3e-8875-183ef3b0b3a2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:39.391891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33134988-2f84-484a-9c5b-87d7d8c67947 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:39.487024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f008a-3855-4f3e-8875-183ef3b0b3a2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:39.489089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518f008a-3855-4f3e-8875-183ef3b0b3a2 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:39.601704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33134988-2f84-484a-9c5b-87d7d8c67947 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:39.610996 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:39.653009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55a4b7-5be9-4f6f-8412-2bce8da1d8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:39.653665 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55a4b7-5be9-4f6f-8412-2bce8da1d8cf None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:39.653946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55a4b7-5be9-4f6f-8412-2bce8da1d8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:39.654219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa55a4b7-5be9-4f6f-8412-2bce8da1d8cf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:39.655245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55a4b7-5be9-4f6f-8412-2bce8da1d8cf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:39.657076 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa55a4b7-5be9-4f6f-8412-2bce8da1d8cf None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:39.662634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 431/862] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:39 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-fa55a4b7-5be9-4f6f-8412-2bce8da1d8cf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:39.667025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:39.668229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:39.669290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:39.669290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:39.669290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:39.669290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:39.669290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:39.669290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:39.669290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:39.669290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:39.669290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:39.669290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:39.669290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:39.669290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:39.669290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:39.669290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:09:39.669290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:39.671653 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 432/863] 10.222.0.70 () {56 vars in 1132 bytes} [Mon Aug 1 14:09:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:39.672769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f008a-3855-4f3e-8875-183ef3b0b3a2 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:39.679429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55a4b7-5be9-4f6f-8412-2bce8da1d8cf None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:39.696083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:39.787124 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa55a4b7-5be9-4f6f-8412-2bce8da1d8cf None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:39.791057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518f008a-3855-4f3e-8875-183ef3b0b3a2 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:39.822549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7f9e4-b04b-4541-9779-0942dbc07c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:39.823204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7f9e4-b04b-4541-9779-0942dbc07c3a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:39.823483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7f9e4-b04b-4541-9779-0942dbc07c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:39.823750 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc7f9e4-b04b-4541-9779-0942dbc07c3a None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:39.824426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7f9e4-b04b-4541-9779-0942dbc07c3a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:39.824727 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7f9e4-b04b-4541-9779-0942dbc07c3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:39.826155 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc7f9e4-b04b-4541-9779-0942dbc07c3a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:39.837993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 433/864] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 1 14:09:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:39.838714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543cf58-3158-40e0-8d2e-58e9d3f5ea18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:39.838714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543cf58-3158-40e0-8d2e-58e9d3f5ea18 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:39.838714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543cf58-3158-40e0-8d2e-58e9d3f5ea18 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:39.838968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b543cf58-3158-40e0-8d2e-58e9d3f5ea18 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:39.844140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7f9e4-b04b-4541-9779-0942dbc07c3a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:39.855476 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543cf58-3158-40e0-8d2e-58e9d3f5ea18 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:39.857307 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b543cf58-3158-40e0-8d2e-58e9d3f5ea18 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:39.876370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-b543cf58-3158-40e0-8d2e-58e9d3f5ea18 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:39.876370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:39.876370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:39.876370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:39.876370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:39.876370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:39.876370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:39.876370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:39.876370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:39.876370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:39.876370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:39.876370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:39.876370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:39.876370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:39.876370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:39.877280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:39.878163 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:39.878163 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:39.878163 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:39.878163 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:39.882264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 432/865] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:39.883646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543cf58-3158-40e0-8d2e-58e9d3f5ea18 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:39.906481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:39.948629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:39.985872 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc7f9e4-b04b-4541-9779-0942dbc07c3a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:40.011140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b543cf58-3158-40e0-8d2e-58e9d3f5ea18 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:40.036642 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2591de-f9dd-4483-8375-922c90e05f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:40.037671 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2591de-f9dd-4483-8375-922c90e05f79 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:40.037978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2591de-f9dd-4483-8375-922c90e05f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:40.038254 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2591de-f9dd-4483-8375-922c90e05f79 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:40.039109 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2591de-f9dd-4483-8375-922c90e05f79 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:40.039553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2591de-f9dd-4483-8375-922c90e05f79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:40.041198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2591de-f9dd-4483-8375-922c90e05f79 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:40.050674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 434/866] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 1 14:09:39 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:40.061143 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44af5fc-e5a6-431d-8e35-6b589e77a42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:40.062161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44af5fc-e5a6-431d-8e35-6b589e77a42b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:40.062708 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44af5fc-e5a6-431d-8e35-6b589e77a42b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:40.063189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44af5fc-e5a6-431d-8e35-6b589e77a42b None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:40.064234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44af5fc-e5a6-431d-8e35-6b589e77a42b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:40.064786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44af5fc-e5a6-431d-8e35-6b589e77a42b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:40.066553 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44af5fc-e5a6-431d-8e35-6b589e77a42b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:40.081536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 433/867] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:40.087608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2591de-f9dd-4483-8375-922c90e05f79 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:40.203523 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2591de-f9dd-4483-8375-922c90e05f79 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:40.241848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8016cef-a032-45d5-93c6-74b01aae6c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:40.242487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8016cef-a032-45d5-93c6-74b01aae6c9e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:40.242788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8016cef-a032-45d5-93c6-74b01aae6c9e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:40.243056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8016cef-a032-45d5-93c6-74b01aae6c9e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:40.249816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8016cef-a032-45d5-93c6-74b01aae6c9e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:40.251309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8016cef-a032-45d5-93c6-74b01aae6c9e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:40.253298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:40.264130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b8016cef-a032-45d5-93c6-74b01aae6c9e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:40.264130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:40.264130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:40.264130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:40.264130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:40.264130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:40.264130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:40.264130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:40.264130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:40.264130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:40.264130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:40.264130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:40.264130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:40.264130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:40.264130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:40.265066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:40.266404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:40.266404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:40.266404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:40.266404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:40.266404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:40.266404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:40.266404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:40.266404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:40.266404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 435/868] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:40.274260 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44af5fc-e5a6-431d-8e35-6b589e77a42b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:40.356383 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:40.380394 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44af5fc-e5a6-431d-8e35-6b589e77a42b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:40.418509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1483f2-c3e0-42c3-b51f-8ccae5fd7efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:40.419160 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1483f2-c3e0-42c3-b51f-8ccae5fd7efb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:40.419439 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1483f2-c3e0-42c3-b51f-8ccae5fd7efb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:40.419714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1483f2-c3e0-42c3-b51f-8ccae5fd7efb None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:40.420461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1483f2-c3e0-42c3-b51f-8ccae5fd7efb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:40.420765 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1483f2-c3e0-42c3-b51f-8ccae5fd7efb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:40.422212 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1483f2-c3e0-42c3-b51f-8ccae5fd7efb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:40.434717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 434/869] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:40.440469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8016cef-a032-45d5-93c6-74b01aae6c9e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:40.552773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8016cef-a032-45d5-93c6-74b01aae6c9e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:40.589005 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37355d0d-b386-44cd-b374-c10cef790316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:40.589627 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37355d0d-b386-44cd-b374-c10cef790316 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:40.589909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37355d0d-b386-44cd-b374-c10cef790316 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:40.590188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37355d0d-b386-44cd-b374-c10cef790316 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:40.591008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37355d0d-b386-44cd-b374-c10cef790316 None admin] RBAC: Adding query filter params (role.id=7db30e557e5b4d789838af5eb5985bf5, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=83ab2b0e5f244881900f6f3f7f591983) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:40.591317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37355d0d-b386-44cd-b374-c10cef790316 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:40.592752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37355d0d-b386-44cd-b374-c10cef790316 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:40.606766 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 436/870] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:40 2022] GET /identity/v3/role_assignments?user.id=83ab2b0e5f244881900f6f3f7f591983&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=7db30e557e5b4d789838af5eb5985bf5 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:41.043640 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9dd57-bc50-4434-8600-81d2b12790b8 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:41.044151 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9dd57-bc50-4434-8600-81d2b12790b8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:41.044151 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b9dd57-bc50-4434-8600-81d2b12790b8 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:41.045768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 435/871] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:41.051375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca9878-123b-4d62-ba4d-a49c344584a1 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:41.051666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca9878-123b-4d62-ba4d-a49c344584a1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:41.051943 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ca9878-123b-4d62-ba4d-a49c344584a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:41.071026 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-42ca9878-123b-4d62-ba4d-a49c344584a1 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:41.072229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-42ca9878-123b-4d62-ba4d-a49c344584a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:41.136406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:41.149958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 437/872] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:41.172393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9dd57-bc50-4434-8600-81d2b12790b8 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:41.283980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b9dd57-bc50-4434-8600-81d2b12790b8 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:41.320452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49341f55-f658-469c-8e3c-acc57f0eaa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:41.321382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49341f55-f658-469c-8e3c-acc57f0eaa29 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:41.321872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49341f55-f658-469c-8e3c-acc57f0eaa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:41.322327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49341f55-f658-469c-8e3c-acc57f0eaa29 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:41.323227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49341f55-f658-469c-8e3c-acc57f0eaa29 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:41.324812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49341f55-f658-469c-8e3c-acc57f0eaa29 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:41.330402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:41.347323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 436/873] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 1 14:09:41 2022] POST /identity/v3/services => generated 251 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:09:41.571916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0221b-1ccc-4e06-b9df-e5633a553edc None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:41.572160 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0221b-1ccc-4e06-b9df-e5633a553edc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:41.572387 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b0221b-1ccc-4e06-b9df-e5633a553edc None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:41.573970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 438/874] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:41.579068 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c8158-3179-4255-8494-39b31a824884 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:41.579593 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c8158-3179-4255-8494-39b31a824884 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:41.580185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802c8158-3179-4255-8494-39b31a824884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:41.599949 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-802c8158-3179-4255-8494-39b31a824884 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:41.601522 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-802c8158-3179-4255-8494-39b31a824884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:41.682172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 437/875] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:41 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:41.703865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0221b-1ccc-4e06-b9df-e5633a553edc None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:41.810401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b0221b-1ccc-4e06-b9df-e5633a553edc None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:41.851229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89522e-da41-48e9-9884-6d25dc826b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:41.851864 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89522e-da41-48e9-9884-6d25dc826b67 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:41.852155 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89522e-da41-48e9-9884-6d25dc826b67 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:41.852427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89522e-da41-48e9-9884-6d25dc826b67 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:41.853062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89522e-da41-48e9-9884-6d25dc826b67 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:41.854443 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89522e-da41-48e9-9884-6d25dc826b67 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-6f89522e-da41-48e9-9884-6d25dc826b67 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:41.864799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:41.865848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:41.866720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:41.866720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:41.866720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:41.866720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:41.866720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:41.866720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:41.866720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:41.866720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:41.866720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:41.866720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:41.866720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:41.866720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:41.866720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:09:41.866720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:41.866720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 439/876] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 1 14:09:41 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:41.872463 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c8158-3179-4255-8494-39b31a824884 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:41.985706 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802c8158-3179-4255-8494-39b31a824884 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:42.010721 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:42.024070 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b81b39f-7542-4c5b-8767-2e32705dfcb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:42.024698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81b39f-7542-4c5b-8767-2e32705dfcb7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:42.024978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81b39f-7542-4c5b-8767-2e32705dfcb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:42.025253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b81b39f-7542-4c5b-8767-2e32705dfcb7 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:42.025939 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81b39f-7542-4c5b-8767-2e32705dfcb7 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:42.026238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81b39f-7542-4c5b-8767-2e32705dfcb7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:42.027659 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b81b39f-7542-4c5b-8767-2e32705dfcb7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:42.032757 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 438/877] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 1 14:09:41 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:42.039054 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89522e-da41-48e9-9884-6d25dc826b67 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:42.098986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:42.142732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89522e-da41-48e9-9884-6d25dc826b67 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:42.182225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff17ed8-f57c-45c6-bd3f-b9df9dbdc760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:42.182225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff17ed8-f57c-45c6-bd3f-b9df9dbdc760 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:42.182225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff17ed8-f57c-45c6-bd3f-b9df9dbdc760 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:42.182225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff17ed8-f57c-45c6-bd3f-b9df9dbdc760 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:42.184237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff17ed8-f57c-45c6-bd3f-b9df9dbdc760 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:42.184423 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff17ed8-f57c-45c6-bd3f-b9df9dbdc760 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:42.185749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff17ed8-f57c-45c6-bd3f-b9df9dbdc760 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:42.193881 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 440/878] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 1 14:09:42 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:42.239877 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467af6a-f9cb-4421-8c83-da9d4c110793 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:42.240439 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467af6a-f9cb-4421-8c83-da9d4c110793 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:42.240439 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9467af6a-f9cb-4421-8c83-da9d4c110793 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:42.242111 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 439/879] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:42.248061 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a96671-ebb2-4e2c-9b87-b82b18bcfe9f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:42.248403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a96671-ebb2-4e2c-9b87-b82b18bcfe9f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:42.248635 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a96671-ebb2-4e2c-9b87-b82b18bcfe9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:42.268684 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-15a96671-ebb2-4e2c-9b87-b82b18bcfe9f None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:42.270476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-15a96671-ebb2-4e2c-9b87-b82b18bcfe9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:42.352033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 441/880] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:42 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:42.374124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467af6a-f9cb-4421-8c83-da9d4c110793 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:42.485394 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9467af6a-f9cb-4421-8c83-da9d4c110793 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:42.521977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2680c893-04b9-4286-950a-0cba25c03ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:42.522688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680c893-04b9-4286-950a-0cba25c03ef0 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:42.522970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680c893-04b9-4286-950a-0cba25c03ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:42.523242 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2680c893-04b9-4286-950a-0cba25c03ef0 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:42.524000 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680c893-04b9-4286-950a-0cba25c03ef0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:42.525398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2680c893-04b9-4286-950a-0cba25c03ef0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:42.543877 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 440/881] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 1 14:09:42 2022] POST /identity/v3/services => generated 269 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:09:42.792082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8c04c-b165-4476-9f2a-d585e8b376a1 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:42.792586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8c04c-b165-4476-9f2a-d585e8b376a1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:42.792691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8c04c-b165-4476-9f2a-d585e8b376a1 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:42.794242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 442/882] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:42.799409 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b1745-d742-471f-b0fd-296868048c45 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:42.799697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b1745-d742-471f-b0fd-296868048c45 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:42.799973 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b1745-d742-471f-b0fd-296868048c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:42.818086 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-590b1745-d742-471f-b0fd-296868048c45 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:42.819316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-590b1745-d742-471f-b0fd-296868048c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:42.864882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:42.897703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 441/883] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:42 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:42.920299 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8c04c-b165-4476-9f2a-d585e8b376a1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:42.975461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:43.030995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8c04c-b165-4476-9f2a-d585e8b376a1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:43.067230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9113180-6ca1-434d-b318-c86a74ac7d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:43.067794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9113180-6ca1-434d-b318-c86a74ac7d7a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:43.068074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9113180-6ca1-434d-b318-c86a74ac7d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:43.068345 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9113180-6ca1-434d-b318-c86a74ac7d7a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:43.079083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9113180-6ca1-434d-b318-c86a74ac7d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-a9113180-6ca1-434d-b318-c86a74ac7d7a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:43.084581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:43.085511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:43.086347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:43.086347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:43.086347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:43.086347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:43.086347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:43.086347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:43.086347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:43.086347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:43.086347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:43.086347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:43.086347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:09:43.086347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:43.086347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 443/884] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Aug 1 14:09:42 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:43.092211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b1745-d742-471f-b0fd-296868048c45 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:43.195412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590b1745-d742-471f-b0fd-296868048c45 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:43.230788 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbe408-dd8b-47fd-a5bb-b10e116fcec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:43.231410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbe408-dd8b-47fd-a5bb-b10e116fcec0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:43.231688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbe408-dd8b-47fd-a5bb-b10e116fcec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:43.231963 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dbe408-dd8b-47fd-a5bb-b10e116fcec0 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:43.232678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbe408-dd8b-47fd-a5bb-b10e116fcec0 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:43.232977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbe408-dd8b-47fd-a5bb-b10e116fcec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:43.234361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dbe408-dd8b-47fd-a5bb-b10e116fcec0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:43.243518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 442/885] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Aug 1 14:09:43 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:43.249044 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9113180-6ca1-434d-b318-c86a74ac7d7a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:43.355971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9113180-6ca1-434d-b318-c86a74ac7d7a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:43.367846 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:43.394915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a42e72-4ec3-4796-a0f8-e2ad74db2470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:43.395575 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a42e72-4ec3-4796-a0f8-e2ad74db2470 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:43.395853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a42e72-4ec3-4796-a0f8-e2ad74db2470 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:43.396128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a42e72-4ec3-4796-a0f8-e2ad74db2470 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:43.406896 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a42e72-4ec3-4796-a0f8-e2ad74db2470 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:43.408397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a42e72-4ec3-4796-a0f8-e2ad74db2470 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:43.423314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-01a42e72-4ec3-4796-a0f8-e2ad74db2470 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:43.423314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:43.423314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:43.423314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:43.423314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:43.423314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:43.423314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:43.423314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:43.423314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:43.423314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:43.423314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:43.423314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:43.423314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:43.423314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:43.423314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:43.424246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:43.425128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:43.425128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:43.425128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:43.425128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:43.425128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 444/886] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:43.431013 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbe408-dd8b-47fd-a5bb-b10e116fcec0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:43.466970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:43.472895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b29a5e-e3c6-4b1f-b16f-106902145001 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:43.473231 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b29a5e-e3c6-4b1f-b16f-106902145001 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:43.473454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b29a5e-e3c6-4b1f-b16f-106902145001 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:43.474971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 445/887] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:43.479823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01e615-83ff-4a26-bcd5-b72ccd88e347 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:43.480112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01e615-83ff-4a26-bcd5-b72ccd88e347 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:43.480398 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01e615-83ff-4a26-bcd5-b72ccd88e347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:43.500406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5f01e615-83ff-4a26-bcd5-b72ccd88e347 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:43.501606 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5f01e615-83ff-4a26-bcd5-b72ccd88e347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:43.552008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dbe408-dd8b-47fd-a5bb-b10e116fcec0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:43.583456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 446/888] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:43 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:09:43.588450 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafd87b-f461-4151-a177-fbca55900f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:43.589080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafd87b-f461-4151-a177-fbca55900f4c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:43.589411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafd87b-f461-4151-a177-fbca55900f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:43.589659 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafd87b-f461-4151-a177-fbca55900f4c None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:43.590356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafd87b-f461-4151-a177-fbca55900f4c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:43.590682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafd87b-f461-4151-a177-fbca55900f4c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:43.592235 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafd87b-f461-4151-a177-fbca55900f4c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:43.606177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 443/889] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:43.606321 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01e615-83ff-4a26-bcd5-b72ccd88e347 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:43.610980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafd87b-f461-4151-a177-fbca55900f4c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:43.723880 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafd87b-f461-4151-a177-fbca55900f4c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:43.725886 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:43.726991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:43.744552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01e615-83ff-4a26-bcd5-b72ccd88e347 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:43.772269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3e008-4a99-48c5-b37e-07f29dcb1c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:43.772944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3e008-4a99-48c5-b37e-07f29dcb1c69 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:43.773608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3e008-4a99-48c5-b37e-07f29dcb1c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:43.773900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba3e008-4a99-48c5-b37e-07f29dcb1c69 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:43.781809 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e63c4d-c61b-4a83-ba43-04200c36c428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:43.782755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e63c4d-c61b-4a83-ba43-04200c36c428 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:43.782958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3e008-4a99-48c5-b37e-07f29dcb1c69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:43.783457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e63c4d-c61b-4a83-ba43-04200c36c428 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:43.783944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e63c4d-c61b-4a83-ba43-04200c36c428 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:43.784431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba3e008-4a99-48c5-b37e-07f29dcb1c69 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:43.785521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e63c4d-c61b-4a83-ba43-04200c36c428 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:43.787133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e63c4d-c61b-4a83-ba43-04200c36c428 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b1e63c4d-c61b-4a83-ba43-04200c36c428 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:43.797273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:43.798762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:43.799620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:43.799620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:43.799620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:43.799620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:43.799620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:43.799620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:43.799620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:43.799620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:43.799620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:43.799620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:43.799620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:43.799620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:43.799620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:09:43.799620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-0ba3e008-4a99-48c5-b37e-07f29dcb1c69 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:43.800369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:43.801840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:43.804165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:43.804165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:43.804165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:43.804165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:43.804165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:43.804165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:43.804165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:43.804165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:43.804165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:09:43.804165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:43.805451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 444/890] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 1 14:09:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:43.805605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3e008-4a99-48c5-b37e-07f29dcb1c69 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:43.807488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 447/891] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:09:43 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:43.816854 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e63c4d-c61b-4a83-ba43-04200c36c428 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:43.919772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e63c4d-c61b-4a83-ba43-04200c36c428 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:43.942230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba3e008-4a99-48c5-b37e-07f29dcb1c69 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:43.958835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa559a1-67f6-485d-bb99-1b44816cbea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:43.959576 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa559a1-67f6-485d-bb99-1b44816cbea2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:43.959955 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa559a1-67f6-485d-bb99-1b44816cbea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:43.960344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa559a1-67f6-485d-bb99-1b44816cbea2 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:43.961115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa559a1-67f6-485d-bb99-1b44816cbea2 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:43.961516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa559a1-67f6-485d-bb99-1b44816cbea2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:43.963244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa559a1-67f6-485d-bb99-1b44816cbea2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:43.973513 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 448/892] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:09:43 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:43.974833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa559a1-67f6-485d-bb99-1b44816cbea2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:43.984784 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03ffb-3a5b-4bcd-a0f7-701f8b7629b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:43.985414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03ffb-3a5b-4bcd-a0f7-701f8b7629b3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:43.985699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03ffb-3a5b-4bcd-a0f7-701f8b7629b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:43.985978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a03ffb-3a5b-4bcd-a0f7-701f8b7629b3 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:43.986807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03ffb-3a5b-4bcd-a0f7-701f8b7629b3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:43.987696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03ffb-3a5b-4bcd-a0f7-701f8b7629b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:43.989743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a03ffb-3a5b-4bcd-a0f7-701f8b7629b3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:44.005742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:44.022262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 445/893] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Aug 1 14:09:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:44.023720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03ffb-3a5b-4bcd-a0f7-701f8b7629b3 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:44.043175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:44.110464 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa559a1-67f6-485d-bb99-1b44816cbea2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:44.142524 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a03ffb-3a5b-4bcd-a0f7-701f8b7629b3 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:44.154332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e823524-02a8-4819-aa64-34d2819cef3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:44.155628 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e823524-02a8-4819-aa64-34d2819cef3b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:44.156221 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e823524-02a8-4819-aa64-34d2819cef3b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:44.156648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e823524-02a8-4819-aa64-34d2819cef3b None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:44.157477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e823524-02a8-4819-aa64-34d2819cef3b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:44.158093 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e823524-02a8-4819-aa64-34d2819cef3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:44.160849 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e823524-02a8-4819-aa64-34d2819cef3b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:44.167646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 449/894] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:09:43 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:44.173758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e823524-02a8-4819-aa64-34d2819cef3b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:44.186248 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2265632b-e25d-4762-9941-77866f8f0dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:44.186908 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265632b-e25d-4762-9941-77866f8f0dfe None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:44.187191 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265632b-e25d-4762-9941-77866f8f0dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:44.187467 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2265632b-e25d-4762-9941-77866f8f0dfe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:44.279848 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265632b-e25d-4762-9941-77866f8f0dfe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:44.281674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2265632b-e25d-4762-9941-77866f8f0dfe None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:44.284372 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:44.300317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:44.306342 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e823524-02a8-4819-aa64-34d2819cef3b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:44.349866 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d1ab61-fdea-4dda-a6b8-ffd3a85c2d33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:44.350498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1ab61-fdea-4dda-a6b8-ffd3a85c2d33 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:44.350832 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1ab61-fdea-4dda-a6b8-ffd3a85c2d33 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:44.351113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d1ab61-fdea-4dda-a6b8-ffd3a85c2d33 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:44.351875 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1ab61-fdea-4dda-a6b8-ffd3a85c2d33 None admin] RBAC: Adding query filter params (interface=public, service_id=6be2eedc668f44589ecbd3db3236288e, region_id=RegionOne) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:44.352186 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1ab61-fdea-4dda-a6b8-ffd3a85c2d33 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:44.353828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d1ab61-fdea-4dda-a6b8-ffd3a85c2d33 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:44.366601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 450/895] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 1 14:09:44 2022] GET /identity/v3/endpoints?service_id=6be2eedc668f44589ecbd3db3236288e&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:44.366601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bce428-468d-41c9-bc82-e6a955ef70aa None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:44.366601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bce428-468d-41c9-bc82-e6a955ef70aa None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:44.366601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bce428-468d-41c9-bc82-e6a955ef70aa None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:44.366601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 451/896] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:44.370654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bce428-468d-41c9-bc82-e6a955ef70aa None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:44.407542 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 446/897] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:44 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:09:44.407542 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2879c5-4d8a-4bae-a2dc-69e9392586e0 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:44.407542 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2879c5-4d8a-4bae-a2dc-69e9392586e0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:44.407542 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2879c5-4d8a-4bae-a2dc-69e9392586e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:44.422528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2f2879c5-4d8a-4bae-a2dc-69e9392586e0 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:44.423824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2f2879c5-4d8a-4bae-a2dc-69e9392586e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:44.486570 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bce428-468d-41c9-bc82-e6a955ef70aa None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:44.489102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 447/898] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:44 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:44.489930 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2879c5-4d8a-4bae-a2dc-69e9392586e0 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:44.538396 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4b973-364e-4ed3-9edd-43cec9c0c82c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:44.539061 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4b973-364e-4ed3-9edd-43cec9c0c82c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:44.539339 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4b973-364e-4ed3-9edd-43cec9c0c82c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:44.539857 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:44.539968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4b973-364e-4ed3-9edd-43cec9c0c82c None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:44.540731 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4b973-364e-4ed3-9edd-43cec9c0c82c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:44.542962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4b973-364e-4ed3-9edd-43cec9c0c82c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:44.562623 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 452/899] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 1 14:09:44 2022] GET /identity/v3/services => generated 1268 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:09:44.562623 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4b973-364e-4ed3-9edd-43cec9c0c82c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:44.596529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:44.609978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2879c5-4d8a-4bae-a2dc-69e9392586e0 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:44.664561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7f40ea-8066-4222-9966-ca9a67e5a6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:44.665519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f40ea-8066-4222-9966-ca9a67e5a6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:44.665799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f40ea-8066-4222-9966-ca9a67e5a6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:44.666094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7f40ea-8066-4222-9966-ca9a67e5a6f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:44.681141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f40ea-8066-4222-9966-ca9a67e5a6f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:44.682549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7f40ea-8066-4222-9966-ca9a67e5a6f9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:44.689055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4b973-364e-4ed3-9edd-43cec9c0c82c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:44.699887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-db7f40ea-8066-4222-9966-ca9a67e5a6f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:44.699887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:44.699887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:44.699887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:44.699887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:44.699887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:44.699887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:44.699887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:44.699887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:44.699887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:44.699887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:44.699887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:44.699887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:44.699887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:44.699887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:44.700884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:44.701793 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:44.701793 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:44.701793 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:44.701793 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:44.701793 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 448/900] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:44.702405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1970f8-5e20-40a0-a0c1-10b4d0eac456 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:44.702711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1970f8-5e20-40a0-a0c1-10b4d0eac456 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:44.702981 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1970f8-5e20-40a0-a0c1-10b4d0eac456 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:44.706276 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 449/901] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:44.707980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1970f8-5e20-40a0-a0c1-10b4d0eac456 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:44.738658 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330419ae-361c-4f97-9385-0fac15176356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:44.739272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330419ae-361c-4f97-9385-0fac15176356 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:44.739603 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330419ae-361c-4f97-9385-0fac15176356 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:44.740055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330419ae-361c-4f97-9385-0fac15176356 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:44.740757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330419ae-361c-4f97-9385-0fac15176356 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:44.742136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330419ae-361c-4f97-9385-0fac15176356 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:44.759375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 453/902] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 1 14:09:44 2022] POST /identity/v3/services => generated 241 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:09:44.760851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1502ce1-dd85-4a4b-b288-146314f72c4d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:44.761209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1502ce1-dd85-4a4b-b288-146314f72c4d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:44.761558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1502ce1-dd85-4a4b-b288-146314f72c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:44.781531 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c1502ce1-dd85-4a4b-b288-146314f72c4d None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:44.783243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c1502ce1-dd85-4a4b-b288-146314f72c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:44.821252 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:44.837831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1970f8-5e20-40a0-a0c1-10b4d0eac456 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:44.880835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b10842-caa5-4c1c-a003-846aec3f7d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:44.881777 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b10842-caa5-4c1c-a003-846aec3f7d12 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:44.882015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 454/903] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:44.882815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b10842-caa5-4c1c-a003-846aec3f7d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:44.883272 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b10842-caa5-4c1c-a003-846aec3f7d12 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:44.884217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b10842-caa5-4c1c-a003-846aec3f7d12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:44.884704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b10842-caa5-4c1c-a003-846aec3f7d12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:44.886356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b10842-caa5-4c1c-a003-846aec3f7d12 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:44.902989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 450/904] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:44.903962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1502ce1-dd85-4a4b-b288-146314f72c4d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:44.906143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:44.910665 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b10842-caa5-4c1c-a003-846aec3f7d12 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:45.036378 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1502ce1-dd85-4a4b-b288-146314f72c4d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:45.050098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b10842-caa5-4c1c-a003-846aec3f7d12 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:45.077035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfc2f4-f718-4a5d-986f-ad4835195c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:45.078308 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfc2f4-f718-4a5d-986f-ad4835195c30 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:45.079100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfc2f4-f718-4a5d-986f-ad4835195c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:45.079593 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cfc2f4-f718-4a5d-986f-ad4835195c30 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:45.081012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfc2f4-f718-4a5d-986f-ad4835195c30 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:45.083029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2cfc2f4-f718-4a5d-986f-ad4835195c30 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:45.091740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce0d04-9a21-4f2d-8418-25e3af3f53ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:45.092523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce0d04-9a21-4f2d-8418-25e3af3f53ae None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:45.092903 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce0d04-9a21-4f2d-8418-25e3af3f53ae None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:45.093279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ce0d04-9a21-4f2d-8418-25e3af3f53ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b2cfc2f4-f718-4a5d-986f-ad4835195c30 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:45.096746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:45.098451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:45.099521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:45.099521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:45.099521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:45.099521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:45.099521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:45.099521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:45.099521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:45.099521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:45.099521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:45.099521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:45.099521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:45.099521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:45.099521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:45.099521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:09:45.099521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:45.102164 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 455/905] 10.222.0.70 () {56 vars in 1132 bytes} [Mon Aug 1 14:09:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:45.108146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfc2f4-f718-4a5d-986f-ad4835195c30 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:45.108381 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce0d04-9a21-4f2d-8418-25e3af3f53ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:45.111080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ce0d04-9a21-4f2d-8418-25e3af3f53ae None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:45.126009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-55ce0d04-9a21-4f2d-8418-25e3af3f53ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:45.126009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:45.126009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:45.126009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:45.126009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:45.126009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:45.126009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:45.126009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:45.126009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:45.126009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:45.126009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:45.126009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:45.126009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:45.126009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:45.126009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:45.127129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:45.128015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:45.128015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:45.128015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:45.128015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:45.128015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:45.128015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:45.128015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:45.128015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:45.128015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 451/906] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:45.135165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce0d04-9a21-4f2d-8418-25e3af3f53ae None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:45.150392 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:45.198199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:45.243808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cfc2f4-f718-4a5d-986f-ad4835195c30 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:45.244800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ce0d04-9a21-4f2d-8418-25e3af3f53ae None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:45.279916 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49721257-1d60-4652-8a71-82612d2a3278 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:45.280555 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49721257-1d60-4652-8a71-82612d2a3278 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:45.280811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49721257-1d60-4652-8a71-82612d2a3278 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:45.280980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49721257-1d60-4652-8a71-82612d2a3278 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:45.281728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49721257-1d60-4652-8a71-82612d2a3278 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:45.282039 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49721257-1d60-4652-8a71-82612d2a3278 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:45.283557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49721257-1d60-4652-8a71-82612d2a3278 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:45.284421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6d1d7-5ae5-46d8-9670-3e418085c52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:45.285920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6d1d7-5ae5-46d8-9670-3e418085c52e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:45.286421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6d1d7-5ae5-46d8-9670-3e418085c52e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:45.287009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d6d1d7-5ae5-46d8-9670-3e418085c52e None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:45.287906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6d1d7-5ae5-46d8-9670-3e418085c52e None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:45.288425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6d1d7-5ae5-46d8-9670-3e418085c52e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:45.289982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d6d1d7-5ae5-46d8-9670-3e418085c52e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:45.301120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 452/907] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:45.301297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 456/908] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 1 14:09:45 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:45.302056 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49721257-1d60-4652-8a71-82612d2a3278 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:45.308023 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6d1d7-5ae5-46d8-9670-3e418085c52e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:45.398630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:45.437973 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d6d1d7-5ae5-46d8-9670-3e418085c52e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:45.440492 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49721257-1d60-4652-8a71-82612d2a3278 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:45.476679 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:45.477762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc0f86-2b12-4cb0-a57d-976534bfb3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:45.478678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc0f86-2b12-4cb0-a57d-976534bfb3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:45.479168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc0f86-2b12-4cb0-a57d-976534bfb3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:45.479778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddc0f86-2b12-4cb0-a57d-976534bfb3f6 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:45.480837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc0f86-2b12-4cb0-a57d-976534bfb3f6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:45.481656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc0f86-2b12-4cb0-a57d-976534bfb3f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:45.483793 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddc0f86-2b12-4cb0-a57d-976534bfb3f6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:45.483906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bd233-c6aa-4f31-aca5-0dcd8eeaea85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:45.484539 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bd233-c6aa-4f31-aca5-0dcd8eeaea85 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:45.484908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bd233-c6aa-4f31-aca5-0dcd8eeaea85 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:45.486152 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-394bd233-c6aa-4f31-aca5-0dcd8eeaea85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:45.487473 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bd233-c6aa-4f31-aca5-0dcd8eeaea85 None admin] RBAC: Adding query filter params (role.id=d1453841ab264a6b8a6be3c292a294ac, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=83ab2b0e5f244881900f6f3f7f591983) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:45.487795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bd233-c6aa-4f31-aca5-0dcd8eeaea85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:45.490089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-394bd233-c6aa-4f31-aca5-0dcd8eeaea85 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:45.494922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 453/909] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 1 14:09:45 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:45.499574 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 457/910] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:45 2022] GET /identity/v3/role_assignments?user.id=83ab2b0e5f244881900f6f3f7f591983&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=d1453841ab264a6b8a6be3c292a294ac => generated 259 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:45.500789 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc0f86-2b12-4cb0-a57d-976534bfb3f6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:45.634018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddc0f86-2b12-4cb0-a57d-976534bfb3f6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:45.673205 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9549160-3b85-4f8b-b50d-24e9536e08a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:45.673880 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9549160-3b85-4f8b-b50d-24e9536e08a7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:45.674166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9549160-3b85-4f8b-b50d-24e9536e08a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:45.674438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9549160-3b85-4f8b-b50d-24e9536e08a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:45.675224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9549160-3b85-4f8b-b50d-24e9536e08a7 None admin] RBAC: Adding query filter params (interface=public, service_id=0de832648324470b96e2fce927d2011a, region_id=RegionOne) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:45.675564 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9549160-3b85-4f8b-b50d-24e9536e08a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:45.676946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9549160-3b85-4f8b-b50d-24e9536e08a7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:45.678679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:45.687438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 454/911] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 1 14:09:45 2022] GET /identity/v3/endpoints?service_id=0de832648324470b96e2fce927d2011a&interface=public®ion_id=RegionOne => generated 194 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:45.689423 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bd233-c6aa-4f31-aca5-0dcd8eeaea85 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:45.799456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-394bd233-c6aa-4f31-aca5-0dcd8eeaea85 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:45.836308 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eebf4fa-1cad-4e24-b743-97b3102dddc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:45.836937 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebf4fa-1cad-4e24-b743-97b3102dddc6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:45.837486 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebf4fa-1cad-4e24-b743-97b3102dddc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:45.837763 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eebf4fa-1cad-4e24-b743-97b3102dddc6 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:45.838415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebf4fa-1cad-4e24-b743-97b3102dddc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:45.839840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eebf4fa-1cad-4e24-b743-97b3102dddc6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:45.846705 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 458/912] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 1 14:09:45 2022] GET /identity/v3/services => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:09:46.619407 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225e359-c139-45b8-a662-bf9227d060d3 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:46.619930 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225e359-c139-45b8-a662-bf9227d060d3 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:46.619930 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b225e359-c139-45b8-a662-bf9227d060d3 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:46.621500 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 455/913] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:46.627005 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba720f-b6ae-4675-824c-f04a9f5f1d2b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:46.627434 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba720f-b6ae-4675-824c-f04a9f5f1d2b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:46.627632 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba720f-b6ae-4675-824c-f04a9f5f1d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:46.648357 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4fba720f-b6ae-4675-824c-f04a9f5f1d2b None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:46.649569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4fba720f-b6ae-4675-824c-f04a9f5f1d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:46.705613 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:46.726700 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 459/914] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:46.744121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225e359-c139-45b8-a662-bf9227d060d3 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:46.858351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b225e359-c139-45b8-a662-bf9227d060d3 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:46.866363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81274-6536-4b86-9005-63fef5a415b9 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:46.866679 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81274-6536-4b86-9005-63fef5a415b9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:46.866960 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec81274-6536-4b86-9005-63fef5a415b9 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:46.868521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 460/915] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:46.873775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fe878-6ab2-4f3f-a92b-12d83b33cee9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:46.874001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fe878-6ab2-4f3f-a92b-12d83b33cee9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:46.874283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fe878-6ab2-4f3f-a92b-12d83b33cee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:46.892223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-de3fe878-6ab2-4f3f-a92b-12d83b33cee9 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:46.893424 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-de3fe878-6ab2-4f3f-a92b-12d83b33cee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:46.898394 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829838d8-9c5b-4b6c-ab36-f2bf50110cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:46.899276 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829838d8-9c5b-4b6c-ab36-f2bf50110cdc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:46.899767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829838d8-9c5b-4b6c-ab36-f2bf50110cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:46.900220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829838d8-9c5b-4b6c-ab36-f2bf50110cdc None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:46.901187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829838d8-9c5b-4b6c-ab36-f2bf50110cdc None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:46.902764 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829838d8-9c5b-4b6c-ab36-f2bf50110cdc None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-829838d8-9c5b-4b6c-ab36-f2bf50110cdc None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:46.913445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:46.914423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:46.915308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:46.915308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:46.915308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:46.915308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:46.915308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:46.915308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:46.915308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:46.915308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:46.915308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:46.915308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:46.915308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:46.915308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:46.915308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 01 14:09:46.915308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:46.917799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 456/916] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:09:46 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:46.927477 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829838d8-9c5b-4b6c-ab36-f2bf50110cdc None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:46.968248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 461/917] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:46 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:46.991133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fe878-6ab2-4f3f-a92b-12d83b33cee9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:47.005337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:47.051092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829838d8-9c5b-4b6c-ab36-f2bf50110cdc None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:47.086923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e925ea-980c-4b8e-8392-c4331dd40055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:47.087805 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e925ea-980c-4b8e-8392-c4331dd40055 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:47.088087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e925ea-980c-4b8e-8392-c4331dd40055 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:47.088360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e925ea-980c-4b8e-8392-c4331dd40055 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:47.089036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e925ea-980c-4b8e-8392-c4331dd40055 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:47.089782 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e925ea-980c-4b8e-8392-c4331dd40055 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:47.091027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e925ea-980c-4b8e-8392-c4331dd40055 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:47.096905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 457/918] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:09:46 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:47.103943 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e925ea-980c-4b8e-8392-c4331dd40055 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:47.108110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fe878-6ab2-4f3f-a92b-12d83b33cee9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:47.128327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:47.149786 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9109c3-73a7-40b4-b8b6-281b110c5aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:47.150809 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9109c3-73a7-40b4-b8b6-281b110c5aad None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:47.151270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9109c3-73a7-40b4-b8b6-281b110c5aad None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:47.151725 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9109c3-73a7-40b4-b8b6-281b110c5aad None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:47.152540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9109c3-73a7-40b4-b8b6-281b110c5aad None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:47.154106 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9109c3-73a7-40b4-b8b6-281b110c5aad None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-5e9109c3-73a7-40b4-b8b6-281b110c5aad None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:47.164278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:47.165282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:47.166143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:47.166143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:47.166143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:47.166143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:47.166143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:47.166143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:47.166143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:47.166143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:47.166143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:47.166143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:47.166143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:47.166143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:47.166143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:09:47.166143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:47.169021 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 462/919] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 1 14:09:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:47.177067 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9109c3-73a7-40b4-b8b6-281b110c5aad None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:47.227647 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e925ea-980c-4b8e-8392-c4331dd40055 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:47.255449 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:47.266290 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a0a8d-5bc7-4f93-b499-2cbe14cecf11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:47.266949 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a0a8d-5bc7-4f93-b499-2cbe14cecf11 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:47.267230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a0a8d-5bc7-4f93-b499-2cbe14cecf11 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:47.267503 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079a0a8d-5bc7-4f93-b499-2cbe14cecf11 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:47.268179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a0a8d-5bc7-4f93-b499-2cbe14cecf11 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:47.268482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a0a8d-5bc7-4f93-b499-2cbe14cecf11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:47.270511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079a0a8d-5bc7-4f93-b499-2cbe14cecf11 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:47.276422 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 458/920] 10.222.0.70 () {56 vars in 1114 bytes} [Mon Aug 1 14:09:47 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:47.280203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9109c3-73a7-40b4-b8b6-281b110c5aad None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:47.281641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a0a8d-5bc7-4f93-b499-2cbe14cecf11 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:47.332890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c91b3-6739-42e4-b427-540f811a39f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:47.333645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c91b3-6739-42e4-b427-540f811a39f4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:47.333998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c91b3-6739-42e4-b427-540f811a39f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:47.334547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7c91b3-6739-42e4-b427-540f811a39f4 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:47.335427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c91b3-6739-42e4-b427-540f811a39f4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:47.335803 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c91b3-6739-42e4-b427-540f811a39f4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:47.337550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7c91b3-6739-42e4-b427-540f811a39f4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:47.348181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 463/921] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 1 14:09:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:47.349285 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c91b3-6739-42e4-b427-540f811a39f4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:47.408413 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079a0a8d-5bc7-4f93-b499-2cbe14cecf11 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:47.412247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:47.448502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb552442-d03a-4e6f-920e-26fa73752e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:47.449503 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb552442-d03a-4e6f-920e-26fa73752e1d None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:47.450073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb552442-d03a-4e6f-920e-26fa73752e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:47.450490 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb552442-d03a-4e6f-920e-26fa73752e1d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:47.451430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb552442-d03a-4e6f-920e-26fa73752e1d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:47.453116 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb552442-d03a-4e6f-920e-26fa73752e1d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:47.479047 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7c91b3-6739-42e4-b427-540f811a39f4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:47.482895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 459/922] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:09:47 2022] POST /identity/v3/endpoints => generated 346 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:09:47.536856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db6e2a-986e-4baa-88d6-183fd58332a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:47.537496 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db6e2a-986e-4baa-88d6-183fd58332a8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:47.537778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db6e2a-986e-4baa-88d6-183fd58332a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:47.538052 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db6e2a-986e-4baa-88d6-183fd58332a8 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:47.538781 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db6e2a-986e-4baa-88d6-183fd58332a8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:47.539141 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db6e2a-986e-4baa-88d6-183fd58332a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:47.540624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db6e2a-986e-4baa-88d6-183fd58332a8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:47.547280 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 464/923] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 1 14:09:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:47.553580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb552442-d03a-4e6f-920e-26fa73752e1d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:47.593243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612e6a6-cda9-478e-bb34-41765507c43a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:47.593529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612e6a6-cda9-478e-bb34-41765507c43a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:47.593830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a612e6a6-cda9-478e-bb34-41765507c43a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:47.595588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 465/924] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:47.601693 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe9595-ea95-4f86-a75c-1f944e72b944 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:47.601972 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe9595-ea95-4f86-a75c-1f944e72b944 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:47.602249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fe9595-ea95-4f86-a75c-1f944e72b944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:47.618917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:47.621904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a5fe9595-ea95-4f86-a75c-1f944e72b944 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:47.623196 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a5fe9595-ea95-4f86-a75c-1f944e72b944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:47.703656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb552442-d03a-4e6f-920e-26fa73752e1d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:47.719651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 466/925] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:09:47.743880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe9595-ea95-4f86-a75c-1f944e72b944 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:47.754286 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e599f-558a-402c-bf1a-c4ce1a6eedff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:47.754945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e599f-558a-402c-bf1a-c4ce1a6eedff None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:47.755224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e599f-558a-402c-bf1a-c4ce1a6eedff None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:47.755493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e599f-558a-402c-bf1a-c4ce1a6eedff None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:47.756252 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e599f-558a-402c-bf1a-c4ce1a6eedff None admin] RBAC: Adding query filter params (interface=public, service_id=c48f58c5d23247a6a32213fe7aa5797c, region_id=RegionOne) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:47.756556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e599f-558a-402c-bf1a-c4ce1a6eedff None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:47.758357 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e599f-558a-402c-bf1a-c4ce1a6eedff None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:47.765639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 460/926] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 1 14:09:47 2022] GET /identity/v3/endpoints?service_id=c48f58c5d23247a6a32213fe7aa5797c&interface=public®ion_id=RegionOne => generated 194 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:47.771047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e599f-558a-402c-bf1a-c4ce1a6eedff None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:47.785902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:47.877191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fe9595-ea95-4f86-a75c-1f944e72b944 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:47.912841 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e599f-558a-402c-bf1a-c4ce1a6eedff None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:47.923476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03fcb6f-6bbd-4a3c-9a3a-4271a684cc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:47.924370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fcb6f-6bbd-4a3c-9a3a-4271a684cc81 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:47.924807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fcb6f-6bbd-4a3c-9a3a-4271a684cc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:47.925747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03fcb6f-6bbd-4a3c-9a3a-4271a684cc81 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:47.929697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:47.939526 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03fcb6f-6bbd-4a3c-9a3a-4271a684cc81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f03fcb6f-6bbd-4a3c-9a3a-4271a684cc81 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:47.946130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:47.947911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:47.948840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:47.948840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:47.948840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:47.948840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:47.948840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:47.948840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:47.948840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:47.948840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:47.948840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:47.948840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:47.948840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:09:47.948840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:47.950846 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 467/927] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Aug 1 14:09:47 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:47.952348 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35634364-da09-4d45-b422-70f69f6b72e9 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:47.952636 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35634364-da09-4d45-b422-70f69f6b72e9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:47.952909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35634364-da09-4d45-b422-70f69f6b72e9 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:47.954324 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 468/928] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:47.956571 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35634364-da09-4d45-b422-70f69f6b72e9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:47.963904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195b409d-813c-4287-b182-7b1776348dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:47.964520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b409d-813c-4287-b182-7b1776348dd5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:47.964796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b409d-813c-4287-b182-7b1776348dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:47.965065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b409d-813c-4287-b182-7b1776348dd5 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:47.965711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b409d-813c-4287-b182-7b1776348dd5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:47.967125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195b409d-813c-4287-b182-7b1776348dd5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:47.973311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 461/929] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 1 14:09:47 2022] GET /identity/v3/services => generated 1497 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:09:47.974449 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948aca1-e3e7-4c9e-8c0f-7dafe83fc5e3 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:47.974846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948aca1-e3e7-4c9e-8c0f-7dafe83fc5e3 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:47.975225 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3948aca1-e3e7-4c9e-8c0f-7dafe83fc5e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:48.004602 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-3948aca1-e3e7-4c9e-8c0f-7dafe83fc5e3 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:48.006132 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3948aca1-e3e7-4c9e-8c0f-7dafe83fc5e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:48.083953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 462/930] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:48.085540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:48.094177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35634364-da09-4d45-b422-70f69f6b72e9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:48.111695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948aca1-e3e7-4c9e-8c0f-7dafe83fc5e3 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:48.137880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a9e19-3be7-4ff4-b587-b207e586088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:48.138510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a9e19-3be7-4ff4-b587-b207e586088a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:48.138823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a9e19-3be7-4ff4-b587-b207e586088a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:48.139093 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6a9e19-3be7-4ff4-b587-b207e586088a None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:48.139821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a9e19-3be7-4ff4-b587-b207e586088a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:48.140139 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a9e19-3be7-4ff4-b587-b207e586088a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:48.141499 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6a9e19-3be7-4ff4-b587-b207e586088a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:48.154611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 469/931] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Aug 1 14:09:47 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:48.157296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a9e19-3be7-4ff4-b587-b207e586088a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:48.261678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3948aca1-e3e7-4c9e-8c0f-7dafe83fc5e3 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:48.270487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6a9e19-3be7-4ff4-b587-b207e586088a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:48.274935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:48.300118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bb87b-382d-41b6-a178-94b4fd56f416 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:48.300786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bb87b-382d-41b6-a178-94b4fd56f416 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:48.301058 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bb87b-382d-41b6-a178-94b4fd56f416 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:48.301326 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92bb87b-382d-41b6-a178-94b4fd56f416 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:48.302048 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bb87b-382d-41b6-a178-94b4fd56f416 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:48.303585 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92bb87b-382d-41b6-a178-94b4fd56f416 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:48.308359 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15c0bc-a6cc-425d-9800-eb1109b0c571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:48.309299 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15c0bc-a6cc-425d-9800-eb1109b0c571 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:48.309786 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15c0bc-a6cc-425d-9800-eb1109b0c571 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:48.310288 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae15c0bc-a6cc-425d-9800-eb1109b0c571 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-f92bb87b-382d-41b6-a178-94b4fd56f416 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:48.312892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:48.313904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:48.314795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 463/932] 10.222.0.70 () {56 vars in 1132 bytes} [Mon Aug 1 14:09:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:48.321780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bb87b-382d-41b6-a178-94b4fd56f416 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:48.325618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15c0bc-a6cc-425d-9800-eb1109b0c571 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:48.327541 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae15c0bc-a6cc-425d-9800-eb1109b0c571 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:48.343989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ae15c0bc-a6cc-425d-9800-eb1109b0c571 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:48.343989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:48.343989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:48.343989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:48.343989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:48.343989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:48.343989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:48.343989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:48.343989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:48.343989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:48.343989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:48.343989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:48.343989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:48.343989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:48.343989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:48.344948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:48.345843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:48.345843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:48.345843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:48.345843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:48.348151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 470/933] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:48.353931 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15c0bc-a6cc-425d-9800-eb1109b0c571 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:48.368639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:48.441574 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92bb87b-382d-41b6-a178-94b4fd56f416 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:48.465160 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae15c0bc-a6cc-425d-9800-eb1109b0c571 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:48.478654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d2489-e57b-436e-ab5d-977345f17143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:48.479669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d2489-e57b-436e-ab5d-977345f17143 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:48.480259 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d2489-e57b-436e-ab5d-977345f17143 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:48.480742 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d2489-e57b-436e-ab5d-977345f17143 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:48.481604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d2489-e57b-436e-ab5d-977345f17143 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:48.482111 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d2489-e57b-436e-ab5d-977345f17143 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:48.483991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d2489-e57b-436e-ab5d-977345f17143 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:48.490928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 464/934] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 1 14:09:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:48.501836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d2489-e57b-436e-ab5d-977345f17143 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:48.508778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6e60c-8903-4425-8758-9fe68b564a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:48.510061 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6e60c-8903-4425-8758-9fe68b564a5e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:48.510442 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6e60c-8903-4425-8758-9fe68b564a5e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:48.510857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca6e60c-8903-4425-8758-9fe68b564a5e None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:48.512163 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6e60c-8903-4425-8758-9fe68b564a5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:48.512523 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6e60c-8903-4425-8758-9fe68b564a5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:48.514732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca6e60c-8903-4425-8758-9fe68b564a5e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:48.530800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 471/935] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:48.539262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:48.539550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6e60c-8903-4425-8758-9fe68b564a5e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:48.629737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d2489-e57b-436e-ab5d-977345f17143 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:48.631022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:48.671696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca6e60c-8903-4425-8758-9fe68b564a5e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:48.671899 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b924623-72e3-404c-9f88-9e40162cb53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:48.672411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b924623-72e3-404c-9f88-9e40162cb53f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:48.672694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b924623-72e3-404c-9f88-9e40162cb53f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:48.672966 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b924623-72e3-404c-9f88-9e40162cb53f None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:48.673646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b924623-72e3-404c-9f88-9e40162cb53f None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:48.673946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b924623-72e3-404c-9f88-9e40162cb53f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:48.676895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b924623-72e3-404c-9f88-9e40162cb53f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:48.682489 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 465/936] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 1 14:09:48 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:48.691581 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b924623-72e3-404c-9f88-9e40162cb53f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:48.720021 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc6f84-0ca7-427c-ba69-ddea53edbf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:48.721972 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc6f84-0ca7-427c-ba69-ddea53edbf97 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:48.722424 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc6f84-0ca7-427c-ba69-ddea53edbf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:48.722878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc6f84-0ca7-427c-ba69-ddea53edbf97 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:48.734283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc6f84-0ca7-427c-ba69-ddea53edbf97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:48.736202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc6f84-0ca7-427c-ba69-ddea53edbf97 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-9cfc6f84-0ca7-427c-ba69-ddea53edbf97 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:48.752415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:48.756261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:48.757895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:48.757895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:48.757895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:48.757895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:48.757895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:48.757895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:48.757895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:48.757895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:48.757895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:09:48.757895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:48.759961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 472/937] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 1 14:09:48 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:48.760922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc6f84-0ca7-427c-ba69-ddea53edbf97 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:48.811469 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:48.819915 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b924623-72e3-404c-9f88-9e40162cb53f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:48.855106 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b106e0-c859-4b1e-9a91-52fb8d9a1df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:48.855880 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b106e0-c859-4b1e-9a91-52fb8d9a1df6 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:48.856253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b106e0-c859-4b1e-9a91-52fb8d9a1df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:48.856621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b106e0-c859-4b1e-9a91-52fb8d9a1df6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:48.857431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b106e0-c859-4b1e-9a91-52fb8d9a1df6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:48.859035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b106e0-c859-4b1e-9a91-52fb8d9a1df6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:48.873678 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc6f84-0ca7-427c-ba69-ddea53edbf97 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:48.881858 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 466/938] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:09:48 2022] POST /identity/v3/endpoints => generated 347 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:09:48.919775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:48.933701 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650de68-9e64-4267-b162-f909aa661944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:48.934857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650de68-9e64-4267-b162-f909aa661944 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:48.935308 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650de68-9e64-4267-b162-f909aa661944 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:48.935726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650de68-9e64-4267-b162-f909aa661944 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:48.936745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650de68-9e64-4267-b162-f909aa661944 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:48.937204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650de68-9e64-4267-b162-f909aa661944 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:48.938986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650de68-9e64-4267-b162-f909aa661944 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:48.959755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 473/939] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Aug 1 14:09:48 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:48.966138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b106e0-c859-4b1e-9a91-52fb8d9a1df6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:49.081385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b106e0-c859-4b1e-9a91-52fb8d9a1df6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:49.119279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5959e01-2720-4608-bbd3-e76f367aca4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:49.119996 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5959e01-2720-4608-bbd3-e76f367aca4d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:49.120281 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5959e01-2720-4608-bbd3-e76f367aca4d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:49.120549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5959e01-2720-4608-bbd3-e76f367aca4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:49.132172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5959e01-2720-4608-bbd3-e76f367aca4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:49.133651 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5959e01-2720-4608-bbd3-e76f367aca4d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:49.149050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d5959e01-2720-4608-bbd3-e76f367aca4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:49.149050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:49.149050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:49.149050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:49.149050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:49.149050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:49.149050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:49.149050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:49.149050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:49.149050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:49.149050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:49.149050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:49.149050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:49.149050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:49.149050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:49.149969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:49.150929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:49.150929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:49.150929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:49.150929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:49.150929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 467/940] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:49.156368 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650de68-9e64-4267-b162-f909aa661944 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:49.267040 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650de68-9e64-4267-b162-f909aa661944 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:49.305561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d23f2-42f9-4a51-a7bb-e683d30287c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:49.306232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d23f2-42f9-4a51-a7bb-e683d30287c5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:49.306563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d23f2-42f9-4a51-a7bb-e683d30287c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:49.306867 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d23f2-42f9-4a51-a7bb-e683d30287c5 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:49.307561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d23f2-42f9-4a51-a7bb-e683d30287c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:49.307865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d23f2-42f9-4a51-a7bb-e683d30287c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:49.309235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d23f2-42f9-4a51-a7bb-e683d30287c5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:49.321356 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 474/941] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:49.327046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5959e01-2720-4608-bbd3-e76f367aca4d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:49.331037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:49.436102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5959e01-2720-4608-bbd3-e76f367aca4d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:49.471472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cc22d-c8f1-4d7c-885b-ead5d11dde2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:49.472675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cc22d-c8f1-4d7c-885b-ead5d11dde2d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:49.472962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cc22d-c8f1-4d7c-885b-ead5d11dde2d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:49.473232 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30cc22d-c8f1-4d7c-885b-ead5d11dde2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:49.480356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cc22d-c8f1-4d7c-885b-ead5d11dde2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:49.481827 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30cc22d-c8f1-4d7c-885b-ead5d11dde2d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:49.493890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d30cc22d-c8f1-4d7c-885b-ead5d11dde2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:49.493890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:49.493890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:49.493890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:49.493890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:49.493890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:49.493890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:49.493890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:49.493890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:49.493890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:49.493890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:49.493890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:49.493890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:49.493890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:49.493890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:49.494836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:49.495716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:49.495716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:49.495716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:49.495716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:49.495716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:49.495716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:49.495716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:49.495716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:49.495716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 468/942] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:49.501207 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d23f2-42f9-4a51-a7bb-e683d30287c5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:49.551490 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:49.619394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d23f2-42f9-4a51-a7bb-e683d30287c5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:49.655611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c72acf-9736-4661-b78d-5c9fd245652c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:49.656236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c72acf-9736-4661-b78d-5c9fd245652c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:49.656516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c72acf-9736-4661-b78d-5c9fd245652c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:49.656792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c72acf-9736-4661-b78d-5c9fd245652c None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:49.657600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c72acf-9736-4661-b78d-5c9fd245652c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:49.657906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c72acf-9736-4661-b78d-5c9fd245652c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:49.659419 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c72acf-9736-4661-b78d-5c9fd245652c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:49.672452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 475/943] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:49.678294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cc22d-c8f1-4d7c-885b-ead5d11dde2d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:49.690105 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e069cf-2edf-4788-814b-9a35a5454c33 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:49.690373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e069cf-2edf-4788-814b-9a35a5454c33 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:49.690569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e069cf-2edf-4788-814b-9a35a5454c33 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:49.692708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 476/944] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:09:49.697594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c970a-1152-4462-8aad-76e8a89810ad None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:49.697877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c970a-1152-4462-8aad-76e8a89810ad None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:49.698145 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184c970a-1152-4462-8aad-76e8a89810ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:49.718119 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-184c970a-1152-4462-8aad-76e8a89810ad None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:49.719433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-184c970a-1152-4462-8aad-76e8a89810ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:49.748559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:49.794511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30cc22d-c8f1-4d7c-885b-ead5d11dde2d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:49.802303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 477/945] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:49 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:09:49.828028 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c970a-1152-4462-8aad-76e8a89810ad None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:49.844478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2e10d-9461-4a1d-88df-6a53faae9e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:49.845135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2e10d-9461-4a1d-88df-6a53faae9e9b None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:49.845415 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2e10d-9461-4a1d-88df-6a53faae9e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:49.845782 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e2e10d-9461-4a1d-88df-6a53faae9e9b None admin] PATH_INFO: `/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/83ab2b0e5f244881900f6f3f7f591983/roles/d1453841ab264a6b8a6be3c292a294ac` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:49.848115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2e10d-9461-4a1d-88df-6a53faae9e9b None admin] RBAC: Authorizing `identity:create_grant(project_id=c8bcd31836684fe5b43fd604df3d3e8b, user_id=83ab2b0e5f244881900f6f3f7f591983, role_id=d1453841ab264a6b8a6be3c292a294ac)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:49.849826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e2e10d-9461-4a1d-88df-6a53faae9e9b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:49.866393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 469/946] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:09:49 2022] PUT /identity/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/83ab2b0e5f244881900f6f3f7f591983/roles/d1453841ab264a6b8a6be3c292a294ac => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:09:49.872398 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:49.951167 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184c970a-1152-4462-8aad-76e8a89810ad None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:49.990632 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165c7b8e-9a50-45fe-8f90-2ddda8707678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:49.991369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c7b8e-9a50-45fe-8f90-2ddda8707678 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:49.991645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c7b8e-9a50-45fe-8f90-2ddda8707678 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:49.991916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165c7b8e-9a50-45fe-8f90-2ddda8707678 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:49.992611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c7b8e-9a50-45fe-8f90-2ddda8707678 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:49.994091 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165c7b8e-9a50-45fe-8f90-2ddda8707678 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:49.997774 dv-cinder-845990-5-smb devstack@keystone.service[80141]: WARNING keystone.server.flask.common [None req-165c7b8e-9a50-45fe-8f90-2ddda8707678 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 01 14:09:50.017397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.sql.core [None req-165c7b8e-9a50-45fe-8f90-2ddda8707678 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 14:09:50.017397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 14:09:50.017397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [parameters: {'id': '7771493830b441c79b746270c10b8be8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 14:09:50.017397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80141) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 14:09:50.025553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-165c7b8e-9a50-45fe-8f90-2ddda8707678 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7771493830b441c79b746270c10b8be8.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7771493830b441c79b746270c10b8be8. Aug 01 14:09:50.025553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:50.025553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 14:09:50.025553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 14:09:50.025553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 14:09:50.025553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 14:09:50.025553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 14:09:50.025553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 14:09:50.025553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 14:09:50.025553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application conn.query(q) Aug 01 14:09:50.025553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 14:09:50.025553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 14:09:50.025553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result.read() Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 01 14:09:50.026402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application next(self.gen) Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application yield resource Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application next(self.gen) Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise self.value Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application session.commit() Aug 01 14:09:50.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.session.flush() Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application compat.raise_( Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 14:09:50.028305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 14:09:50.029851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 14:09:50.029851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 14:09:50.029851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 14:09:50.029851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 14:09:50.029851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 01 14:09:50.029851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 01 14:09:50.029851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 14:09:50.029851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 14:09:50.029851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 14:09:50.029851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 14:09:50.029851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 14:09:50.029851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 14:09:50.029851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 14:09:50.029851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 14:09:50.029851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application conn.query(q) Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result.read() Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 14:09:50.031121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 14:09:50.031999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 14:09:50.031999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 14:09:50.031999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 14:09:50.031999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 14:09:50.031999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 14:09:50.031999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 14:09:50.031999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 01 14:09:50.031999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 01 14:09:50.031999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [parameters: {'id': '7771493830b441c79b746270c10b8be8', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 01 14:09:50.031999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 14:09:50.031999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:50.031999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:50.031999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:50.031999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:50.031999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:50.032802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:50.034310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:50.034310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 01 14:09:50.034310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 01 14:09:50.034310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:50.034310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:50.034310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 01 14:09:50.034310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 01 14:09:50.034310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7771493830b441c79b746270c10b8be8. Aug 01 14:09:50.034310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:50.034310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 478/947] 10.222.0.70 () {60 vars in 1140 bytes} [Mon Aug 1 14:09:49 2022] POST /identity/v3/projects => generated 262 bytes in 200 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:50.034995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2e10d-9461-4a1d-88df-6a53faae9e9b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:50.143661 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac6c60-a734-4d6c-b7ec-11158e34cad0 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:50.144148 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac6c60-a734-4d6c-b7ec-11158e34cad0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:50.144516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ac6c60-a734-4d6c-b7ec-11158e34cad0 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:50.149203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 479/948] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:09:50.150004 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e2e10d-9461-4a1d-88df-6a53faae9e9b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:50.154169 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ea8b6-5b9c-4141-a468-725a8ca5ba34 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:50.154547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ea8b6-5b9c-4141-a468-725a8ca5ba34 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:50.154945 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389ea8b6-5b9c-4141-a468-725a8ca5ba34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:50.173902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-389ea8b6-5b9c-4141-a468-725a8ca5ba34 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:50.176172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-389ea8b6-5b9c-4141-a468-725a8ca5ba34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:50.182913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:50.187069 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95aa31-14dd-481d-b9e5-1bb244b799fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:50.187827 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95aa31-14dd-481d-b9e5-1bb244b799fc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:50.188065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95aa31-14dd-481d-b9e5-1bb244b799fc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:50.188473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a95aa31-14dd-481d-b9e5-1bb244b799fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:50.196786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95aa31-14dd-481d-b9e5-1bb244b799fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:50.198334 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a95aa31-14dd-481d-b9e5-1bb244b799fc None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:50.210961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-5a95aa31-14dd-481d-b9e5-1bb244b799fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:50.210961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:50.210961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:50.210961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:50.210961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:50.210961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:50.210961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:50.210961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:50.210961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:50.210961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:50.210961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:50.210961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:50.210961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:50.210961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:50.210961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:50.212347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:50.213557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:50.213557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:50.213557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:50.213557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:50.213557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:50.213557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:50.213557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:50.213557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:50.213557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 470/949] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:50.218437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95aa31-14dd-481d-b9e5-1bb244b799fc None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:50.251760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 480/950] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:50.274554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ea8b6-5b9c-4141-a468-725a8ca5ba34 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:50.296210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:50.330286 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a95aa31-14dd-481d-b9e5-1bb244b799fc None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:50.367554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978222f0-d5aa-49da-8e1a-8a46b1b3e149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:50.368276 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978222f0-d5aa-49da-8e1a-8a46b1b3e149 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:50.368633 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978222f0-d5aa-49da-8e1a-8a46b1b3e149 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:50.368982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978222f0-d5aa-49da-8e1a-8a46b1b3e149 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:50.369773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978222f0-d5aa-49da-8e1a-8a46b1b3e149 None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:50.370298 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978222f0-d5aa-49da-8e1a-8a46b1b3e149 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:50.371968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978222f0-d5aa-49da-8e1a-8a46b1b3e149 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:50.379964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389ea8b6-5b9c-4141-a468-725a8ca5ba34 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:50.398778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 471/951] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 1 14:09:50 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:50.417674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23a97f-121c-4a62-9894-89baa1ca0620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:50.418341 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23a97f-121c-4a62-9894-89baa1ca0620 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:50.418691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23a97f-121c-4a62-9894-89baa1ca0620 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:50.418964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba23a97f-121c-4a62-9894-89baa1ca0620 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:50.419603 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23a97f-121c-4a62-9894-89baa1ca0620 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:50.421142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba23a97f-121c-4a62-9894-89baa1ca0620 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-ba23a97f-121c-4a62-9894-89baa1ca0620 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:50.432083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:50.433265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:50.434100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:50.434100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:50.434100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:50.434100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:50.434100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:50.434100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:50.434100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:50.434100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:50.434100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:50.434100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:50.434100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:50.434100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:50.434100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:09:50.434100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:50.434100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 481/952] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 1 14:09:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:50.440109 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978222f0-d5aa-49da-8e1a-8a46b1b3e149 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:50.492111 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:50.551953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978222f0-d5aa-49da-8e1a-8a46b1b3e149 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:50.592853 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35516516-34a6-4932-a955-663f6c7389aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:50.593480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35516516-34a6-4932-a955-663f6c7389aa None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:50.593757 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35516516-34a6-4932-a955-663f6c7389aa None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:50.594029 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35516516-34a6-4932-a955-663f6c7389aa None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:50.594740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35516516-34a6-4932-a955-663f6c7389aa None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:50.595045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35516516-34a6-4932-a955-663f6c7389aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:50.596427 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35516516-34a6-4932-a955-663f6c7389aa None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:50.602336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 472/953] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 1 14:09:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:50.608024 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23a97f-121c-4a62-9894-89baa1ca0620 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:50.703995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:50.721585 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba23a97f-121c-4a62-9894-89baa1ca0620 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:50.758590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4f856c-baca-40c9-bf01-6d23c71d9b94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:50.759152 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f856c-baca-40c9-bf01-6d23c71d9b94 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:50.759491 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f856c-baca-40c9-bf01-6d23c71d9b94 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:50.759761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4f856c-baca-40c9-bf01-6d23c71d9b94 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:50.760494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f856c-baca-40c9-bf01-6d23c71d9b94 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:50.760795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f856c-baca-40c9-bf01-6d23c71d9b94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:50.762157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4f856c-baca-40c9-bf01-6d23c71d9b94 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:50.767713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 482/954] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 1 14:09:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:50.773963 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35516516-34a6-4932-a955-663f6c7389aa None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:50.883521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35516516-34a6-4932-a955-663f6c7389aa None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:50.895548 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:50.922332 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b69df58-b290-4835-87f7-952497d0d5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:50.923357 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69df58-b290-4835-87f7-952497d0d5af None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:50.923877 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69df58-b290-4835-87f7-952497d0d5af None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:50.924382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b69df58-b290-4835-87f7-952497d0d5af None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:50.925384 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69df58-b290-4835-87f7-952497d0d5af None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:50.926977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b69df58-b290-4835-87f7-952497d0d5af None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:50.948278 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 473/955] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:09:50 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:09:51.112103 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fbca5-56b5-4c9d-a4ef-f101b9d8e77f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:51.113103 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fbca5-56b5-4c9d-a4ef-f101b9d8e77f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:51.113576 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36fbca5-56b5-4c9d-a4ef-f101b9d8e77f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:51.115449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 483/956] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:51.120342 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95abf3-ded4-4e42-ac93-c4c5e92538d5 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:51.120840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95abf3-ded4-4e42-ac93-c4c5e92538d5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:51.121399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef95abf3-ded4-4e42-ac93-c4c5e92538d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:51.142024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-ef95abf3-ded4-4e42-ac93-c4c5e92538d5 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:51.143605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ef95abf3-ded4-4e42-ac93-c4c5e92538d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:51.220145 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 474/957] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:51.242123 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fbca5-56b5-4c9d-a4ef-f101b9d8e77f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:51.355200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36fbca5-56b5-4c9d-a4ef-f101b9d8e77f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:51.391278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c400f-d3fb-40bc-a087-596e78a5d698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:51.392229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c400f-d3fb-40bc-a087-596e78a5d698 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:51.392723 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c400f-d3fb-40bc-a087-596e78a5d698 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:51.393211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8c400f-d3fb-40bc-a087-596e78a5d698 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:51.394613 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c400f-d3fb-40bc-a087-596e78a5d698 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:51.396173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8c400f-d3fb-40bc-a087-596e78a5d698 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-9c8c400f-d3fb-40bc-a087-596e78a5d698 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:51.405492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:51.406802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:51.407692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:51.407692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:51.407692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:51.407692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:51.407692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:51.407692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:51.407692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:51.407692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:51.407692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:51.407692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:51.407692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:51.407692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:51.407692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:09:51.407692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:51.410522 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 484/958] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:51.419889 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95abf3-ded4-4e42-ac93-c4c5e92538d5 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:51.512903 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:51.522530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef95abf3-ded4-4e42-ac93-c4c5e92538d5 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:51.563815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca0981b-d4d9-407b-94b0-9e1e18248c19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:51.564461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0981b-d4d9-407b-94b0-9e1e18248c19 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:51.564742 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0981b-d4d9-407b-94b0-9e1e18248c19 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:51.565010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca0981b-d4d9-407b-94b0-9e1e18248c19 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:51.565697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0981b-d4d9-407b-94b0-9e1e18248c19 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:51.566537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0981b-d4d9-407b-94b0-9e1e18248c19 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:51.567964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca0981b-d4d9-407b-94b0-9e1e18248c19 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:51.573551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 475/959] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 1 14:09:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:51.579409 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c400f-d3fb-40bc-a087-596e78a5d698 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:51.596195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:51.699147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8c400f-d3fb-40bc-a087-596e78a5d698 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:51.735645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f1324-f9b7-432f-aac4-ca3c76b19e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:51.736532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f1324-f9b7-432f-aac4-ca3c76b19e90 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:51.736962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f1324-f9b7-432f-aac4-ca3c76b19e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:51.737436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f1324-f9b7-432f-aac4-ca3c76b19e90 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:51.738824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f1324-f9b7-432f-aac4-ca3c76b19e90 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:51.739374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f1324-f9b7-432f-aac4-ca3c76b19e90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:51.740929 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f1324-f9b7-432f-aac4-ca3c76b19e90 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:51.746441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 485/960] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 1 14:09:51 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:51.925989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b769cd8-97b3-4439-a59b-a0f0da9a6786 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:51.926525 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b769cd8-97b3-4439-a59b-a0f0da9a6786 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:51.926525 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b769cd8-97b3-4439-a59b-a0f0da9a6786 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:51.928144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 476/961] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:51.933297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b314a3-b48b-4fe6-9119-7149141d0b74 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:51.933589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b314a3-b48b-4fe6-9119-7149141d0b74 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:51.933866 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b314a3-b48b-4fe6-9119-7149141d0b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:51.952183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c7b314a3-b48b-4fe6-9119-7149141d0b74 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:51.953289 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c7b314a3-b48b-4fe6-9119-7149141d0b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:52.023931 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 486/962] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:52.047555 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b769cd8-97b3-4439-a59b-a0f0da9a6786 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:52.154649 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b769cd8-97b3-4439-a59b-a0f0da9a6786 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:52.192439 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59d70c-1252-479b-a41c-87099d958ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:52.193360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59d70c-1252-479b-a41c-87099d958ae6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:52.193832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59d70c-1252-479b-a41c-87099d958ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:52.194297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc59d70c-1252-479b-a41c-87099d958ae6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:52.206040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc59d70c-1252-479b-a41c-87099d958ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-bc59d70c-1252-479b-a41c-87099d958ae6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:09:52.211366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:52.212776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:52.213849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:52.213849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:52.213849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:52.213849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:52.213849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:09:52.213849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:09:52.213849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:09:52.213849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:09:52.213849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:09:52.213849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:09:52.213849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:09:52.213849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:52.216401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 477/963] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Aug 1 14:09:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:52.222804 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b314a3-b48b-4fe6-9119-7149141d0b74 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:52.238544 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:52.336514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b314a3-b48b-4fe6-9119-7149141d0b74 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:52.372937 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382f052-0993-4a09-b1f4-ff872b03afff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:52.373564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382f052-0993-4a09-b1f4-ff872b03afff None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:52.373854 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382f052-0993-4a09-b1f4-ff872b03afff None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:52.374127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382f052-0993-4a09-b1f4-ff872b03afff None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:52.374883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382f052-0993-4a09-b1f4-ff872b03afff None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:52.375358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382f052-0993-4a09-b1f4-ff872b03afff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:52.376796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382f052-0993-4a09-b1f4-ff872b03afff None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:52.385999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 487/964] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Aug 1 14:09:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:52.391669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59d70c-1252-479b-a41c-87099d958ae6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:52.411986 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:52.505645 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc59d70c-1252-479b-a41c-87099d958ae6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:52.546479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46571eb0-c17c-4eaf-afdc-b078336e829f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:52.547664 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46571eb0-c17c-4eaf-afdc-b078336e829f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:52.548156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46571eb0-c17c-4eaf-afdc-b078336e829f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:52.548671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46571eb0-c17c-4eaf-afdc-b078336e829f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:52.559954 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46571eb0-c17c-4eaf-afdc-b078336e829f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:52.561748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46571eb0-c17c-4eaf-afdc-b078336e829f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:52.579382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-46571eb0-c17c-4eaf-afdc-b078336e829f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:52.579382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:52.579382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:52.579382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:52.579382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:52.579382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:52.579382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:52.579382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:52.579382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:52.579382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:52.579382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:52.579382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:52.579382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:52.579382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:52.579382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:52.580481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:52.582412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:52.582412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:52.582412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:52.582412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:52.585486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 478/965] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:52.591088 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382f052-0993-4a09-b1f4-ff872b03afff None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:52.614389 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23667472-38f2-4078-a929-e6a37e732b39 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:52.614748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23667472-38f2-4078-a929-e6a37e732b39 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:52.615017 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23667472-38f2-4078-a929-e6a37e732b39 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:52.617043 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 479/966] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:09:52.622343 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3845ff-1e82-4939-9126-ceea35889a74 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:52.622926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3845ff-1e82-4939-9126-ceea35889a74 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:52.623208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3845ff-1e82-4939-9126-ceea35889a74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:52.648647 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8c3845ff-1e82-4939-9126-ceea35889a74 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:52.649844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8c3845ff-1e82-4939-9126-ceea35889a74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:52.666500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:52.704739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382f052-0993-4a09-b1f4-ff872b03afff None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:52.731718 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:52.742107 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 480/967] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:09:52.750621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afe632-989f-4c29-bf51-f169b3710549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:52.750621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afe632-989f-4c29-bf51-f169b3710549 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:52.750621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afe632-989f-4c29-bf51-f169b3710549 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:52.750621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64afe632-989f-4c29-bf51-f169b3710549 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:52.751007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afe632-989f-4c29-bf51-f169b3710549 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:52.751007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afe632-989f-4c29-bf51-f169b3710549 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:52.751007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64afe632-989f-4c29-bf51-f169b3710549 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:52.759800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 488/968] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:52.765366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3845ff-1e82-4939-9126-ceea35889a74 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:52.767645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afe632-989f-4c29-bf51-f169b3710549 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:52.873841 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3845ff-1e82-4939-9126-ceea35889a74 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:52.899402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64afe632-989f-4c29-bf51-f169b3710549 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:52.912802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3e6c0-72c5-4d81-99c3-df7842f76e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:52.913453 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3e6c0-72c5-4d81-99c3-df7842f76e77 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:52.913732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3e6c0-72c5-4d81-99c3-df7842f76e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:52.914006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b3e6c0-72c5-4d81-99c3-df7842f76e77 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:52.923943 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3e6c0-72c5-4d81-99c3-df7842f76e77 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:52.926383 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b3e6c0-72c5-4d81-99c3-df7842f76e77 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:52.928884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:52.937982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2421176-e4bc-48c6-8e07-81b6e7dc8110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:52.938817 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2421176-e4bc-48c6-8e07-81b6e7dc8110 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:52.939203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2421176-e4bc-48c6-8e07-81b6e7dc8110 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:52.939575 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2421176-e4bc-48c6-8e07-81b6e7dc8110 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:52.940361 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2421176-e4bc-48c6-8e07-81b6e7dc8110 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-c1b3e6c0-72c5-4d81-99c3-df7842f76e77 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:52.942382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:52.943340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:52.944294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:52.944294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:52.944294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:52.944294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:52.944294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:52.944294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:52.944294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:52.944294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:52.944294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 01 14:09:52.944294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:52.944834 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2421176-e4bc-48c6-8e07-81b6e7dc8110 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:52.948537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 481/969] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 1 14:09:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:52.949373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3e6c0-72c5-4d81-99c3-df7842f76e77 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:52.960176 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.sql.core [None req-e2421176-e4bc-48c6-8e07-81b6e7dc8110 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 14:09:52.960176 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 14:09:52.960176 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [parameters: {'user_id': 'fd56b9b91514458795b579ec9e2be999', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 14:09:52.960176 dv-cinder-845990-5-smb devstack@keystone.service[80141]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80141) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 01 14:09:52.967950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e2421176-e4bc-48c6-8e07-81b6e7dc8110 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 14:09:52.967950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:52.967950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 14:09:52.967950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 14:09:52.967950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 14:09:52.967950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 14:09:52.967950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 14:09:52.967950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 14:09:52.967950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 14:09:52.967950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application conn.query(q) Aug 01 14:09:52.967950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 14:09:52.967950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 14:09:52.967950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 14:09:52.967950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result.read() Aug 01 14:09:52.967950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 14:09:52.969543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application next(self.gen) Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application yield resource Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application next(self.gen) Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.session.rollback() Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.force_reraise() Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise self.value Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application session.commit() Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 01 14:09:52.971353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._prepare_impl() Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.session.flush() Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._flush(objects) Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application compat.raise_( Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application flush_context.execute() Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rec.execute(self) Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 01 14:09:52.972494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 01 14:09:52.973588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result = self._query(query) Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application conn.query(q) Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application result.read() Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 01 14:09:52.974668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 01 14:09:52.975704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 01 14:09:52.975704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 01 14:09:52.975704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 01 14:09:52.975704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 01 14:09:52.975704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 01 14:09:52.975704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 01 14:09:52.975704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [parameters: {'user_id': 'fd56b9b91514458795b579ec9e2be999', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 01 14:09:52.975704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 01 14:09:52.975704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:52.975704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:52.975704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:52.975704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:52.975704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:52.975704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:52.975704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 01 14:09:52.976761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 01 14:09:52.977879 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 01 14:09:52.977879 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 01 14:09:52.977879 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 01 14:09:52.977879 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 01 14:09:52.977879 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 01 14:09:52.977879 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:52.977879 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 489/970] 10.222.0.70 () {60 vars in 1131 bytes} [Mon Aug 1 14:09:52 2022] POST /identity/v3/users => generated 160 bytes in 203 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:52.990771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2421176-e4bc-48c6-8e07-81b6e7dc8110 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:53.019626 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:53.082046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b3e6c0-72c5-4d81-99c3-df7842f76e77 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:53.107114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2421176-e4bc-48c6-8e07-81b6e7dc8110 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:53.131406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705c37c-998f-49cd-8ced-0f34ff3d2cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:53.132414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705c37c-998f-49cd-8ced-0f34ff3d2cb8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:53.132800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705c37c-998f-49cd-8ced-0f34ff3d2cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:53.133210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705c37c-998f-49cd-8ced-0f34ff3d2cb8 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:53.134784 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705c37c-998f-49cd-8ced-0f34ff3d2cb8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:53.136275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705c37c-998f-49cd-8ced-0f34ff3d2cb8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:53.137888 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705c37c-998f-49cd-8ced-0f34ff3d2cb8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:53.147633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e84db4-a974-4638-a100-1a56da87628d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:53.148513 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84db4-a974-4638-a100-1a56da87628d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:53.148958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84db4-a974-4638-a100-1a56da87628d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:53.149375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e84db4-a974-4638-a100-1a56da87628d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:53.157306 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e84db4-a974-4638-a100-1a56da87628d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:53.159179 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e84db4-a974-4638-a100-1a56da87628d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:53.164584 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 482/971] 10.222.0.70 () {56 vars in 1149 bytes} [Mon Aug 1 14:09:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:53.166172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705c37c-998f-49cd-8ced-0f34ff3d2cb8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-a6e84db4-a974-4638-a100-1a56da87628d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:09:53.177714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:53.178718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:53.179707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:53.179707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:53.179707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:09:53.179707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:09:53.179707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:09:53.179707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:09:53.179707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:09:53.179707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:09:53.179707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 01 14:09:53.179707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:53.179707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 490/972] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:09:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:53.191304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e84db4-a974-4638-a100-1a56da87628d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:53.246699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:53.293633 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705c37c-998f-49cd-8ced-0f34ff3d2cb8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:53.305067 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e84db4-a974-4638-a100-1a56da87628d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:53.309657 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:53.331277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fccb6-6b8e-4cfa-baa3-681a5e913dae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:53.332230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fccb6-6b8e-4cfa-baa3-681a5e913dae None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:53.332721 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fccb6-6b8e-4cfa-baa3-681a5e913dae None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:53.333226 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fccb6-6b8e-4cfa-baa3-681a5e913dae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:53.343865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f690dee5-bc03-42ab-aaaf-8cb9316e9422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:53.344488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690dee5-bc03-42ab-aaaf-8cb9316e9422 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:53.344764 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690dee5-bc03-42ab-aaaf-8cb9316e9422 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:53.345396 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f690dee5-bc03-42ab-aaaf-8cb9316e9422 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:53.346161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690dee5-bc03-42ab-aaaf-8cb9316e9422 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:53.346464 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690dee5-bc03-42ab-aaaf-8cb9316e9422 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:53.348813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f690dee5-bc03-42ab-aaaf-8cb9316e9422 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:53.386802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 491/973] 10.222.0.70 () {56 vars in 1101 bytes} [Mon Aug 1 14:09:53 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:53.388139 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65093c66-3be8-4a15-8c56-beb5c2ec2a09 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:53.388428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65093c66-3be8-4a15-8c56-beb5c2ec2a09 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:53.388701 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65093c66-3be8-4a15-8c56-beb5c2ec2a09 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:53.390624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 492/974] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:53.395756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db46360-942b-4f95-881f-1551be4eb49a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:53.396326 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db46360-942b-4f95-881f-1551be4eb49a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:53.396849 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db46360-942b-4f95-881f-1551be4eb49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:53.420156 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9db46360-942b-4f95-881f-1551be4eb49a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:53.421581 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fccb6-6b8e-4cfa-baa3-681a5e913dae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:53.422614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9db46360-942b-4f95-881f-1551be4eb49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:53.423287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792fccb6-6b8e-4cfa-baa3-681a5e913dae None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:53.518190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 493/975] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:53.541282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db46360-942b-4f95-881f-1551be4eb49a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:53.555489 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 483/976] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:09:53 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:09:53.561186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fccb6-6b8e-4cfa-baa3-681a5e913dae None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:53.577051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:53.589115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:53.676175 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db46360-942b-4f95-881f-1551be4eb49a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:53.693655 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fccb6-6b8e-4cfa-baa3-681a5e913dae None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:53.712712 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb306b72-e99c-4663-a8ba-4297b641cf03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:53.713357 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb306b72-e99c-4663-a8ba-4297b641cf03 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:53.713639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb306b72-e99c-4663-a8ba-4297b641cf03 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:53.713915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb306b72-e99c-4663-a8ba-4297b641cf03 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:53.714550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb306b72-e99c-4663-a8ba-4297b641cf03 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:53.715948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb306b72-e99c-4663-a8ba-4297b641cf03 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-bb306b72-e99c-4663-a8ba-4297b641cf03 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:53.725890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:53.726932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:53.727776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:53.727776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:53.727776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:53.727776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:53.727776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:53.727776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:53.727776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:53.727776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:53.727776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:53.727776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:53.727776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:53.727776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:53.727776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:09:53.727776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:09:53.727776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 494/977] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 1 14:09:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:53.732927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb306b72-e99c-4663-a8ba-4297b641cf03 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:53.733386 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a945e9-dc81-49d2-8ac7-8eb3b6164257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:53.734037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a945e9-dc81-49d2-8ac7-8eb3b6164257 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:53.734471 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a945e9-dc81-49d2-8ac7-8eb3b6164257 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:53.734783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a945e9-dc81-49d2-8ac7-8eb3b6164257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:53.746483 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a945e9-dc81-49d2-8ac7-8eb3b6164257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:53.749471 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a945e9-dc81-49d2-8ac7-8eb3b6164257 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:53.765306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-32a945e9-dc81-49d2-8ac7-8eb3b6164257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:53.765306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:53.765306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:53.765306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:53.765306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:53.765306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:53.765306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:53.765306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:53.765306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:53.765306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:53.765306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:53.765306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:53.765306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:09:53.765306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:09:53.765306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:53.766228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:53.767181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:09:53.767181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:09:53.767181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:09:53.767181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:53.767181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 484/978] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:09:53.772731 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a945e9-dc81-49d2-8ac7-8eb3b6164257 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:53.838644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:53.849828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb306b72-e99c-4663-a8ba-4297b641cf03 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:53.851516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:53.874528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a945e9-dc81-49d2-8ac7-8eb3b6164257 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:53.884226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f470919-25f7-44af-84a8-904d9e3c5782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:53.884846 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f470919-25f7-44af-84a8-904d9e3c5782 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:53.885127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f470919-25f7-44af-84a8-904d9e3c5782 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:53.885402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f470919-25f7-44af-84a8-904d9e3c5782 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:53.886074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f470919-25f7-44af-84a8-904d9e3c5782 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:53.886379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f470919-25f7-44af-84a8-904d9e3c5782 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:53.887789 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f470919-25f7-44af-84a8-904d9e3c5782 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:53.892483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 495/979] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 1 14:09:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:53.893620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2305a65-d20c-43eb-876c-67c5d9f11d26 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:53.894438 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2305a65-d20c-43eb-876c-67c5d9f11d26 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:53.894739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2305a65-d20c-43eb-876c-67c5d9f11d26 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:53.897052 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 496/980] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:53.898818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2305a65-d20c-43eb-876c-67c5d9f11d26 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:53.912095 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792f092d-8b11-446d-ab9b-b9ed36b50341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:53.912719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f092d-8b11-446d-ab9b-b9ed36b50341 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:53.912996 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f092d-8b11-446d-ab9b-b9ed36b50341 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:53.913266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792f092d-8b11-446d-ab9b-b9ed36b50341 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:53.913949 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f092d-8b11-446d-ab9b-b9ed36b50341 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:53.914283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f092d-8b11-446d-ab9b-b9ed36b50341 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:53.915712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792f092d-8b11-446d-ab9b-b9ed36b50341 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:53.933526 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 485/981] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:09:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:53.934890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089309bf-f947-4af7-8ad7-8902dfa21e94 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:53.935172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089309bf-f947-4af7-8ad7-8902dfa21e94 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:53.935446 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089309bf-f947-4af7-8ad7-8902dfa21e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:53.953096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-089309bf-f947-4af7-8ad7-8902dfa21e94 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:53.954276 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-089309bf-f947-4af7-8ad7-8902dfa21e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:54.010222 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2305a65-d20c-43eb-876c-67c5d9f11d26 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:54.020947 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 486/982] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:53 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:54.021969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089309bf-f947-4af7-8ad7-8902dfa21e94 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:54.050941 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba63ea3-7962-4d42-91f4-91b100d2f27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:54.051550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba63ea3-7962-4d42-91f4-91b100d2f27b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:54.051832 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba63ea3-7962-4d42-91f4-91b100d2f27b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:54.052092 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba63ea3-7962-4d42-91f4-91b100d2f27b None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:54.052755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba63ea3-7962-4d42-91f4-91b100d2f27b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:54.053051 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba63ea3-7962-4d42-91f4-91b100d2f27b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:54.054398 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba63ea3-7962-4d42-91f4-91b100d2f27b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:54.059178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 497/983] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 1 14:09:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:54.059946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba63ea3-7962-4d42-91f4-91b100d2f27b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:54.081935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:54.090222 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:54.126379 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089309bf-f947-4af7-8ad7-8902dfa21e94 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:54.160509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a2bf2-9db9-4772-a95e-2e57d262eb2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:54.161137 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a2bf2-9db9-4772-a95e-2e57d262eb2c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:54.161413 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a2bf2-9db9-4772-a95e-2e57d262eb2c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:54.161514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba63ea3-7962-4d42-91f4-91b100d2f27b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:54.161681 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a2bf2-9db9-4772-a95e-2e57d262eb2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:54.168310 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a2bf2-9db9-4772-a95e-2e57d262eb2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:54.169780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a2bf2-9db9-4772-a95e-2e57d262eb2c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:54.180980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-aa6a2bf2-9db9-4772-a95e-2e57d262eb2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:54.180980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:54.180980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:54.180980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:54.180980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:54.180980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:54.180980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:54.180980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:54.180980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:54.180980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:54.180980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:54.180980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:54.180980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:09:54.180980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:09:54.180980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:54.181978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:54.182974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:09:54.182974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:09:54.182974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:09:54.182974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:09:54.182974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:09:54.182974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:09:54.182974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:09:54.182974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:54.182974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 487/984] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:54.182974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a2bf2-9db9-4772-a95e-2e57d262eb2c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:54.198761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0aeed1-4bb5-4bd7-8714-ff495daa301e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:54.199380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0aeed1-4bb5-4bd7-8714-ff495daa301e None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:54.199661 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0aeed1-4bb5-4bd7-8714-ff495daa301e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:54.199935 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0aeed1-4bb5-4bd7-8714-ff495daa301e None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:54.200614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0aeed1-4bb5-4bd7-8714-ff495daa301e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:54.201984 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0aeed1-4bb5-4bd7-8714-ff495daa301e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:54.221620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 498/985] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 1 14:09:54 2022] POST /identity/v3/services => generated 242 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:09:54.222467 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0aeed1-4bb5-4bd7-8714-ff495daa301e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:54.301058 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a2bf2-9db9-4772-a95e-2e57d262eb2c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:54.319117 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:54.326121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:54.347908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0aeed1-4bb5-4bd7-8714-ff495daa301e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:54.351462 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fddcc-b549-48f2-a119-ac3ae7008ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:54.352315 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fddcc-b549-48f2-a119-ac3ae7008ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:54.352616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fddcc-b549-48f2-a119-ac3ae7008ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:54.352890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8fddcc-b549-48f2-a119-ac3ae7008ed7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:54.353674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fddcc-b549-48f2-a119-ac3ae7008ed7 None admin] RBAC: Adding query filter params (interface=admin, service_id=c48f58c5d23247a6a32213fe7aa5797c, region_id=RegionOne) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:54.354006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fddcc-b549-48f2-a119-ac3ae7008ed7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:54.355486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8fddcc-b549-48f2-a119-ac3ae7008ed7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:54.366072 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 488/986] 10.222.0.70 () {56 vars in 1249 bytes} [Mon Aug 1 14:09:54 2022] GET /identity/v3/endpoints?service_id=c48f58c5d23247a6a32213fe7aa5797c&interface=admin®ion_id=RegionOne => generated 193 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:54.367278 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fddcc-b549-48f2-a119-ac3ae7008ed7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:54.396082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178477e6-90bb-4608-a1fd-d2102acb159e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:54.396715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178477e6-90bb-4608-a1fd-d2102acb159e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:54.397149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178477e6-90bb-4608-a1fd-d2102acb159e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:54.397435 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178477e6-90bb-4608-a1fd-d2102acb159e None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:54.398189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178477e6-90bb-4608-a1fd-d2102acb159e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:54.398496 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178477e6-90bb-4608-a1fd-d2102acb159e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:54.399965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178477e6-90bb-4608-a1fd-d2102acb159e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:54.413995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 499/987] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:09:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:54.420116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178477e6-90bb-4608-a1fd-d2102acb159e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:54.479617 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8fddcc-b549-48f2-a119-ac3ae7008ed7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:54.515187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cedab-0d7d-409a-bd10-d55c5f3ac7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:54.516093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cedab-0d7d-409a-bd10-d55c5f3ac7e5 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:54.516365 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cedab-0d7d-409a-bd10-d55c5f3ac7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:54.516632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cedab-0d7d-409a-bd10-d55c5f3ac7e5 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:54.517272 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cedab-0d7d-409a-bd10-d55c5f3ac7e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:54.518685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cedab-0d7d-409a-bd10-d55c5f3ac7e5 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:54.525063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 489/988] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 1 14:09:54 2022] GET /identity/v3/services => generated 1727 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:09:54.528003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178477e6-90bb-4608-a1fd-d2102acb159e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:54.568337 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea17f51-d1bc-411e-a52e-f1f06789ff3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:54.568979 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea17f51-d1bc-411e-a52e-f1f06789ff3b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:54.569259 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea17f51-d1bc-411e-a52e-f1f06789ff3b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:54.569554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea17f51-d1bc-411e-a52e-f1f06789ff3b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:54.570351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea17f51-d1bc-411e-a52e-f1f06789ff3b None admin] RBAC: Adding query filter params (role.id=d1453841ab264a6b8a6be3c292a294ac, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=83ab2b0e5f244881900f6f3f7f591983) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:54.570680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea17f51-d1bc-411e-a52e-f1f06789ff3b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:54.572173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea17f51-d1bc-411e-a52e-f1f06789ff3b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:54.586884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 500/989] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:09:54 2022] GET /identity/v3/role_assignments?user.id=83ab2b0e5f244881900f6f3f7f591983&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=d1453841ab264a6b8a6be3c292a294ac => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:09:56.296677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1841f3-8268-44df-b1e8-b33f5e1c7078 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:56.297228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1841f3-8268-44df-b1e8-b33f5e1c7078 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:56.297344 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1841f3-8268-44df-b1e8-b33f5e1c7078 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:56.298632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 490/990] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:56.304216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94397962-d3a4-485d-9928-b34369889226 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:56.304679 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94397962-d3a4-485d-9928-b34369889226 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:56.304768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94397962-d3a4-485d-9928-b34369889226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:56.323008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-94397962-d3a4-485d-9928-b34369889226 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:56.324203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-94397962-d3a4-485d-9928-b34369889226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:56.327169 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:56.395228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 501/991] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:56.417756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1841f3-8268-44df-b1e8-b33f5e1c7078 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:56.463770 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:56.524750 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1841f3-8268-44df-b1e8-b33f5e1c7078 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:56.557917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f43430-a7d4-4c0f-aa2c-d4cc72f5e857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:56.558482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43430-a7d4-4c0f-aa2c-d4cc72f5e857 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:56.558782 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43430-a7d4-4c0f-aa2c-d4cc72f5e857 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:56.559053 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f43430-a7d4-4c0f-aa2c-d4cc72f5e857 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:56.559670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f43430-a7d4-4c0f-aa2c-d4cc72f5e857 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:56.561045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f43430-a7d4-4c0f-aa2c-d4cc72f5e857 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:56.566516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f98ec-797b-428c-bba0-003d31113888 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:56.566845 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f98ec-797b-428c-bba0-003d31113888 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:56.567117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3f98ec-797b-428c-bba0-003d31113888 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:56.568594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 502/992] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-53f43430-a7d4-4c0f-aa2c-d4cc72f5e857 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:56.570875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:56.571847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:56.572703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:56.572703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:56.572703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:56.572703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:56.572703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:56.572703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:56.572703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:56.572703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:56.572703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:56.572703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:56.572703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:56.572703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:56.572703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:09:56.572703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:56.572703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 491/993] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:56.575053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb3e92-973e-4395-9d2c-fb8b6f0fb020 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:56.575334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb3e92-973e-4395-9d2c-fb8b6f0fb020 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:56.575675 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bb3e92-973e-4395-9d2c-fb8b6f0fb020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:56.578620 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f43430-a7d4-4c0f-aa2c-d4cc72f5e857 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:56.597346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b0bb3e92-973e-4395-9d2c-fb8b6f0fb020 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:56.598533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b0bb3e92-973e-4395-9d2c-fb8b6f0fb020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:56.674448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 503/994] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:56.675677 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cd9b7-12af-40d3-849a-3877e75cb1ec None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:56.675962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cd9b7-12af-40d3-849a-3877e75cb1ec None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:56.676234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141cd9b7-12af-40d3-849a-3877e75cb1ec None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:56.677480 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 504/995] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:56.682627 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4ffeb-8ee1-42b7-972a-927ee2788cf9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:56.682920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4ffeb-8ee1-42b7-972a-927ee2788cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:56.683198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d4ffeb-8ee1-42b7-972a-927ee2788cf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:56.694615 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f43430-a7d4-4c0f-aa2c-d4cc72f5e857 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:56.697430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:56.702071 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-10d4ffeb-8ee1-42b7-972a-927ee2788cf9 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:56.703359 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-10d4ffeb-8ee1-42b7-972a-927ee2788cf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:56.731188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d455f-246b-4379-ba2b-12dd1c80a98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:56.731802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d455f-246b-4379-ba2b-12dd1c80a98c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:56.732081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d455f-246b-4379-ba2b-12dd1c80a98c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:56.732354 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1d455f-246b-4379-ba2b-12dd1c80a98c None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:56.733021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d455f-246b-4379-ba2b-12dd1c80a98c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:56.733323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d455f-246b-4379-ba2b-12dd1c80a98c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:56.734764 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1d455f-246b-4379-ba2b-12dd1c80a98c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:56.739985 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 492/996] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 1 14:09:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:56.740745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d455f-246b-4379-ba2b-12dd1c80a98c None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:56.767673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:56.774401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 505/997] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:56 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:56.775071 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4ffeb-8ee1-42b7-972a-927ee2788cf9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:56.849123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1d455f-246b-4379-ba2b-12dd1c80a98c None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:56.873216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d4ffeb-8ee1-42b7-972a-927ee2788cf9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:56.882699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba5091-97e0-4cf7-aadc-036dc90e3644 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:56.883341 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba5091-97e0-4cf7-aadc-036dc90e3644 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:56.883629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba5091-97e0-4cf7-aadc-036dc90e3644 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:56.883898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba5091-97e0-4cf7-aadc-036dc90e3644 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:56.884513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba5091-97e0-4cf7-aadc-036dc90e3644 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:56.885896 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba5091-97e0-4cf7-aadc-036dc90e3644 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-0eba5091-97e0-4cf7-aadc-036dc90e3644 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:56.894901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:56.895974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:56.896840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:56.896840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:56.896840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:56.896840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:56.896840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:56.896840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:56.896840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:56.896840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:56.896840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:56.896840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:56.896840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:56.896840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:56.896840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 01 14:09:56.896840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:56.896840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 493/998] 10.222.0.70 () {56 vars in 1126 bytes} [Mon Aug 1 14:09:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:56.897686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba5091-97e0-4cf7-aadc-036dc90e3644 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:56.909924 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f8d06-f84d-4d68-88cd-de80dc737254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:56.910533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f8d06-f84d-4d68-88cd-de80dc737254 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:56.910839 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f8d06-f84d-4d68-88cd-de80dc737254 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:56.911108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419f8d06-f84d-4d68-88cd-de80dc737254 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:56.911776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f8d06-f84d-4d68-88cd-de80dc737254 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:56.912073 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f8d06-f84d-4d68-88cd-de80dc737254 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:56.913453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419f8d06-f84d-4d68-88cd-de80dc737254 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:56.918184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 506/999] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 1 14:09:56 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:56.918968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f8d06-f84d-4d68-88cd-de80dc737254 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:56.932852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:56.980769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:57.006478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba5091-97e0-4cf7-aadc-036dc90e3644 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:57.021127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419f8d06-f84d-4d68-88cd-de80dc737254 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:57.039440 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71629b61-9219-4a09-8d3d-ab2060d80077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:57.040078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71629b61-9219-4a09-8d3d-ab2060d80077 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:57.040359 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71629b61-9219-4a09-8d3d-ab2060d80077 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:57.040636 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71629b61-9219-4a09-8d3d-ab2060d80077 None admin] PATH_INFO: `/v3/services/image` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:57.041264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71629b61-9219-4a09-8d3d-ab2060d80077 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:57.042708 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71629b61-9219-4a09-8d3d-ab2060d80077 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-71629b61-9219-4a09-8d3d-ab2060d80077 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:57.051970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:57.053155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:57.054015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:57.054015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:57.054015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:57.054015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:57.054015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:57.054015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:57.054015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:57.054015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:57.054015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:57.054015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:57.054015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:57.054015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:57.054015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:09:57.054015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:57.054015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 494/1000] 10.222.0.70 () {56 vars in 1105 bytes} [Mon Aug 1 14:09:56 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:57.054864 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71629b61-9219-4a09-8d3d-ab2060d80077 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:57.061006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0274b44-7262-47ee-a4ab-d3baea12c088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:57.061624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0274b44-7262-47ee-a4ab-d3baea12c088 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:57.061899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0274b44-7262-47ee-a4ab-d3baea12c088 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:57.062173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0274b44-7262-47ee-a4ab-d3baea12c088 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:57.062882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0274b44-7262-47ee-a4ab-d3baea12c088 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:57.063184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0274b44-7262-47ee-a4ab-d3baea12c088 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:57.064537 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0274b44-7262-47ee-a4ab-d3baea12c088 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:57.069913 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 507/1001] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 1 14:09:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:57.070706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0274b44-7262-47ee-a4ab-d3baea12c088 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:57.148442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:57.154734 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71629b61-9219-4a09-8d3d-ab2060d80077 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:57.172387 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0274b44-7262-47ee-a4ab-d3baea12c088 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:57.189159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32cb4a-81ed-463c-a2e3-476f6b6fc09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:57.189776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32cb4a-81ed-463c-a2e3-476f6b6fc09f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:57.190057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32cb4a-81ed-463c-a2e3-476f6b6fc09f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:57.190329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32cb4a-81ed-463c-a2e3-476f6b6fc09f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:57.191110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32cb4a-81ed-463c-a2e3-476f6b6fc09f None admin] RBAC: Adding query filter params (interface=public, service_id=b2f743187c9a44fb840dfb485587b174, region_id=RegionOne) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:57.191418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32cb4a-81ed-463c-a2e3-476f6b6fc09f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:57.192802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32cb4a-81ed-463c-a2e3-476f6b6fc09f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:57.197808 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 495/1002] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 1 14:09:57 2022] GET /identity/v3/endpoints?service_id=b2f743187c9a44fb840dfb485587b174&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:57.198606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32cb4a-81ed-463c-a2e3-476f6b6fc09f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:57.203431 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:57.211603 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a19b35-ee49-4fb9-a0f0-1ae2cf7f9214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:57.212483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a19b35-ee49-4fb9-a0f0-1ae2cf7f9214 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:57.212757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a19b35-ee49-4fb9-a0f0-1ae2cf7f9214 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:57.213025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a19b35-ee49-4fb9-a0f0-1ae2cf7f9214 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:57.213693 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a19b35-ee49-4fb9-a0f0-1ae2cf7f9214 None admin] RBAC: Adding query filter params (name=image) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:57.214019 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a19b35-ee49-4fb9-a0f0-1ae2cf7f9214 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:57.215402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a19b35-ee49-4fb9-a0f0-1ae2cf7f9214 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:57.220030 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 508/1003] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:57 2022] GET /identity/v3/services?name=image => generated 122 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:57.220787 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a19b35-ee49-4fb9-a0f0-1ae2cf7f9214 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:57.301384 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32cb4a-81ed-463c-a2e3-476f6b6fc09f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:57.322691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a19b35-ee49-4fb9-a0f0-1ae2cf7f9214 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:57.335903 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f6380-72e6-40a1-b51f-fbaf12e05e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:57.336522 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f6380-72e6-40a1-b51f-fbaf12e05e21 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:57.336799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f6380-72e6-40a1-b51f-fbaf12e05e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:57.337334 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3f6380-72e6-40a1-b51f-fbaf12e05e21 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:57.337998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f6380-72e6-40a1-b51f-fbaf12e05e21 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:57.338297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f6380-72e6-40a1-b51f-fbaf12e05e21 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:57.339700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3f6380-72e6-40a1-b51f-fbaf12e05e21 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:57.344523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 496/1004] 10.222.0.70 () {56 vars in 1122 bytes} [Mon Aug 1 14:09:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:57.345232 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f6380-72e6-40a1-b51f-fbaf12e05e21 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:57.360714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27513e5-5c18-4135-9637-47785bfbacb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:57.361329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27513e5-5c18-4135-9637-47785bfbacb2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:57.361606 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27513e5-5c18-4135-9637-47785bfbacb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:57.361874 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27513e5-5c18-4135-9637-47785bfbacb2 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:57.363106 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27513e5-5c18-4135-9637-47785bfbacb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:57.364452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27513e5-5c18-4135-9637-47785bfbacb2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:57.370546 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 509/1005] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 1 14:09:57 2022] GET /identity/v3/services => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:09:57.371301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27513e5-5c18-4135-9637-47785bfbacb2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:57.373637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:57.446089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:57.459693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3f6380-72e6-40a1-b51f-fbaf12e05e21 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:57.498941 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27513e5-5c18-4135-9637-47785bfbacb2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:57.500917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f7b9b-f736-4c80-b9a5-51121c22bec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:57.501550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f7b9b-f736-4c80-b9a5-51121c22bec8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:57.502685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f7b9b-f736-4c80-b9a5-51121c22bec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:57.502685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f7b9b-f736-4c80-b9a5-51121c22bec8 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:57.502927 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f7b9b-f736-4c80-b9a5-51121c22bec8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:57.503121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f7b9b-f736-4c80-b9a5-51121c22bec8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:57.504499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f7b9b-f736-4c80-b9a5-51121c22bec8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:57.509732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 497/1006] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:57 2022] GET /identity/v3/services?type=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:57.544201 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6199fa-3ca8-4463-b5c1-65f2d62870d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:57.544201 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6199fa-3ca8-4463-b5c1-65f2d62870d2 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:57.544508 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6199fa-3ca8-4463-b5c1-65f2d62870d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:57.544621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6199fa-3ca8-4463-b5c1-65f2d62870d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:57.545340 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6199fa-3ca8-4463-b5c1-65f2d62870d2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:57.546821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6199fa-3ca8-4463-b5c1-65f2d62870d2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:57.568584 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 510/1007] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:09:57 2022] POST /identity/v3/endpoints => generated 325 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:09:59.437701 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1874b7-9ada-4580-ae4d-6d5af4545288 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:59.438258 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1874b7-9ada-4580-ae4d-6d5af4545288 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:59.438258 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1874b7-9ada-4580-ae4d-6d5af4545288 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:59.441299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 498/1008] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:59.447420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ce0d3-ef7e-42a2-80db-6b7078c8c0fa None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:59.447833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ce0d3-ef7e-42a2-80db-6b7078c8c0fa None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:59.447964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ce0d3-ef7e-42a2-80db-6b7078c8c0fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:59.467884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-404ce0d3-ef7e-42a2-80db-6b7078c8c0fa None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:59.469583 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-404ce0d3-ef7e-42a2-80db-6b7078c8c0fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:59.548263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 511/1009] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:59.570510 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1874b7-9ada-4580-ae4d-6d5af4545288 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:59.583473 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62875d53-337a-41fd-b3bf-250a22ef52fa None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:59.583758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62875d53-337a-41fd-b3bf-250a22ef52fa None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:59.584043 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62875d53-337a-41fd-b3bf-250a22ef52fa None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:59.585430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 512/1010] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:09:59.590696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c34cc0-21d2-4d62-bd77-ad59afac0f52 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:59.590985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c34cc0-21d2-4d62-bd77-ad59afac0f52 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:59.591265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c34cc0-21d2-4d62-bd77-ad59afac0f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:59.609502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-15c34cc0-21d2-4d62-bd77-ad59afac0f52 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:59.610704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-15c34cc0-21d2-4d62-bd77-ad59afac0f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:59.647544 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:59.665295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:59.678712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1874b7-9ada-4580-ae4d-6d5af4545288 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:59.680214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 513/1011] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:09:59.681441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90ae6a-2b0a-41c6-ba9e-88054fe5b29b None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:59.681721 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90ae6a-2b0a-41c6-ba9e-88054fe5b29b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:59.681988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f90ae6a-2b0a-41c6-ba9e-88054fe5b29b None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:59.683364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 514/1012] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:09:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:09:59.688591 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffb0b5-05d0-40b5-a01b-c1db73f25d0a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:59.688817 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffb0b5-05d0-40b5-a01b-c1db73f25d0a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:59.689090 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ffb0b5-05d0-40b5-a01b-c1db73f25d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:59.710734 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d8ffb0b5-05d0-40b5-a01b-c1db73f25d0a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:09:59.712185 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d8ffb0b5-05d0-40b5-a01b-c1db73f25d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:09:59.719442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59593e3e-9796-4d11-934c-fca89895165d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:59.720121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59593e3e-9796-4d11-934c-fca89895165d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:59.720402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59593e3e-9796-4d11-934c-fca89895165d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:59.720673 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59593e3e-9796-4d11-934c-fca89895165d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:59.721294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59593e3e-9796-4d11-934c-fca89895165d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:59.722860 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59593e3e-9796-4d11-934c-fca89895165d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-59593e3e-9796-4d11-934c-fca89895165d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:09:59.732036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:09:59.733271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:09:59.734320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:09:59.734320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:09:59.734320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:09:59.734320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:09:59.734320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:09:59.734320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:09:59.734320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:09:59.734320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:09:59.734320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:09:59.734320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:09:59.734320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:09:59.734320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:09:59.734320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 01 14:09:59.734320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:09:59.734320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 499/1013] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:09:59 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:09:59.735235 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59593e3e-9796-4d11-934c-fca89895165d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:59.781985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 515/1014] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:09:59 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:09:59.782860 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffb0b5-05d0-40b5-a01b-c1db73f25d0a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:59.838523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59593e3e-9796-4d11-934c-fca89895165d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:59.873715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c97cc-176f-46fd-838f-d9db1f509b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:59.874358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c97cc-176f-46fd-838f-d9db1f509b21 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:59.874672 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c97cc-176f-46fd-838f-d9db1f509b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:59.874942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9c97cc-176f-46fd-838f-d9db1f509b21 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:59.875611 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c97cc-176f-46fd-838f-d9db1f509b21 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:59.876983 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9c97cc-176f-46fd-838f-d9db1f509b21 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:59.886695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ffb0b5-05d0-40b5-a01b-c1db73f25d0a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:09:59.888281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:59.892037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 500/1015] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 1 14:09:59 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:09:59.892832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c97cc-176f-46fd-838f-d9db1f509b21 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:09:59.909884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:09:59.935125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e358bd-1c4c-4326-ac5d-fd2beecbad02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:09:59.935753 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e358bd-1c4c-4326-ac5d-fd2beecbad02 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:09:59.936035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e358bd-1c4c-4326-ac5d-fd2beecbad02 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:09:59.936298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e358bd-1c4c-4326-ac5d-fd2beecbad02 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:09:59.936975 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e358bd-1c4c-4326-ac5d-fd2beecbad02 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:09:59.937276 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e358bd-1c4c-4326-ac5d-fd2beecbad02 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:09:59.938900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e358bd-1c4c-4326-ac5d-fd2beecbad02 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:09:59.945140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 516/1016] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 1 14:09:59 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:09:59.951479 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e358bd-1c4c-4326-ac5d-fd2beecbad02 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:00.032317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9c97cc-176f-46fd-838f-d9db1f509b21 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:00.067030 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e358bd-1c4c-4326-ac5d-fd2beecbad02 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:00.073242 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27651d94-85c1-4a68-a157-cdb088e4536a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:00.073898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27651d94-85c1-4a68-a157-cdb088e4536a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:00.074184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27651d94-85c1-4a68-a157-cdb088e4536a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:00.074458 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27651d94-85c1-4a68-a157-cdb088e4536a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:00.076403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27651d94-85c1-4a68-a157-cdb088e4536a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:00.078255 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27651d94-85c1-4a68-a157-cdb088e4536a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:00.079675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 501/1017] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:09:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:00.086182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27651d94-85c1-4a68-a157-cdb088e4536a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:00.104931 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d4100-b24d-4967-9f1d-28504ca04972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:00.105551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d4100-b24d-4967-9f1d-28504ca04972 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:00.105826 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d4100-b24d-4967-9f1d-28504ca04972 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:00.106091 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688d4100-b24d-4967-9f1d-28504ca04972 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:00.106788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d4100-b24d-4967-9f1d-28504ca04972 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:00.107089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d4100-b24d-4967-9f1d-28504ca04972 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:00.108578 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688d4100-b24d-4967-9f1d-28504ca04972 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:00.113726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 517/1018] 10.222.0.70 () {56 vars in 1112 bytes} [Mon Aug 1 14:09:59 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:00.119314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d4100-b24d-4967-9f1d-28504ca04972 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:00.149943 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:00.174200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:00.195038 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27651d94-85c1-4a68-a157-cdb088e4536a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:00.230271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a5533-70d3-407c-87fb-503374635e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:00.230918 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a5533-70d3-407c-87fb-503374635e60 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:00.231193 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a5533-70d3-407c-87fb-503374635e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:00.231460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a5533-70d3-407c-87fb-503374635e60 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:00.231893 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688d4100-b24d-4967-9f1d-28504ca04972 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:00.232132 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a5533-70d3-407c-87fb-503374635e60 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:00.233561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a5533-70d3-407c-87fb-503374635e60 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:00.262920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 502/1019] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 1 14:10:00 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:10:00.281517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbfa58-59d7-4620-a69f-20e9479f590e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:00.282159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbfa58-59d7-4620-a69f-20e9479f590e None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:00.282434 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbfa58-59d7-4620-a69f-20e9479f590e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:00.282736 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbfa58-59d7-4620-a69f-20e9479f590e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:00.283454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbfa58-59d7-4620-a69f-20e9479f590e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:00.284899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbfa58-59d7-4620-a69f-20e9479f590e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:00.307120 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 518/1020] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:10:00 2022] POST /identity/v3/endpoints => generated 334 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:10:01.938266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153238-3b05-4199-b4f4-043d7169ee82 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:01.938832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153238-3b05-4199-b4f4-043d7169ee82 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:01.938832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d153238-3b05-4199-b4f4-043d7169ee82 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:01.940754 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 503/1021] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:01.945815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29dbbe-c9ed-4707-9f94-8b83ceaa26c1 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:01.946195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29dbbe-c9ed-4707-9f94-8b83ceaa26c1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:01.946354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a29dbbe-c9ed-4707-9f94-8b83ceaa26c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:01.965425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5a29dbbe-c9ed-4707-9f94-8b83ceaa26c1 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:01.966648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5a29dbbe-c9ed-4707-9f94-8b83ceaa26c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:02.048377 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 519/1022] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:02.071243 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d153238-3b05-4199-b4f4-043d7169ee82 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:02.175544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d153238-3b05-4199-b4f4-043d7169ee82 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:02.205715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:02.212945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2677e2-2625-4061-b566-9cc044e6ffa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:02.213637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2677e2-2625-4061-b566-9cc044e6ffa1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:02.214279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2677e2-2625-4061-b566-9cc044e6ffa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:02.214942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2677e2-2625-4061-b566-9cc044e6ffa1 None admin] PATH_INFO: `/v3/services/image` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:02.215933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2677e2-2625-4061-b566-9cc044e6ffa1 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:02.217319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2677e2-2625-4061-b566-9cc044e6ffa1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-6a2677e2-2625-4061-b566-9cc044e6ffa1 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:02.226274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:02.227429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:02.228262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:02.228262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:02.228262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:02.228262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:02.228262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:02.228262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:02.228262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:02.228262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:02.228262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:02.228262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:02.228262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:10:02.228262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:10:02.228262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:10:02.228262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:02.230925 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 504/1023] 10.222.0.70 () {56 vars in 1105 bytes} [Mon Aug 1 14:10:02 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:02.233497 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29dbbe-c9ed-4707-9f94-8b83ceaa26c1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:02.244263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:02.336140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f8ce8-0eba-488a-b64b-361f0693330a None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:02.336529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f8ce8-0eba-488a-b64b-361f0693330a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:02.337150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f8ce8-0eba-488a-b64b-361f0693330a None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:02.338542 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 505/1024] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:10:02.342468 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a29dbbe-c9ed-4707-9f94-8b83ceaa26c1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:02.343516 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d9153-35de-47a6-8a42-8bfc7ffa2f81 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:02.343800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d9153-35de-47a6-8a42-8bfc7ffa2f81 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:02.344077 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7d9153-35de-47a6-8a42-8bfc7ffa2f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:02.362865 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8c7d9153-35de-47a6-8a42-8bfc7ffa2f81 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:02.364059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8c7d9153-35de-47a6-8a42-8bfc7ffa2f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:02.378644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb215e-ae0c-47af-bd87-54aa4ff2400b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:02.379270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb215e-ae0c-47af-bd87-54aa4ff2400b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:02.379550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb215e-ae0c-47af-bd87-54aa4ff2400b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:02.379824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fb215e-ae0c-47af-bd87-54aa4ff2400b None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:02.380502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb215e-ae0c-47af-bd87-54aa4ff2400b None admin] RBAC: Adding query filter params (name=image) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:02.380806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb215e-ae0c-47af-bd87-54aa4ff2400b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:02.382164 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fb215e-ae0c-47af-bd87-54aa4ff2400b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:02.391706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 520/1025] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:10:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:02.393469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb215e-ae0c-47af-bd87-54aa4ff2400b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:02.440538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 506/1026] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:10:02.442148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfc6c0-967b-407a-a61f-1587d253343f None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:02.442432 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfc6c0-967b-407a-a61f-1587d253343f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:02.442731 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfc6c0-967b-407a-a61f-1587d253343f None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:02.443956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 507/1027] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:02.449428 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65362f19-008d-43c6-a6bb-06ff834d07aa None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:02.449710 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65362f19-008d-43c6-a6bb-06ff834d07aa None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:02.449984 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65362f19-008d-43c6-a6bb-06ff834d07aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:02.466899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:02.468118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-65362f19-008d-43c6-a6bb-06ff834d07aa None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:02.469432 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-65362f19-008d-43c6-a6bb-06ff834d07aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:02.497194 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fb215e-ae0c-47af-bd87-54aa4ff2400b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:02.531753 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9729b69-91ec-4d18-8f82-75ec33f758c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:02.532367 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9729b69-91ec-4d18-8f82-75ec33f758c8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:02.532649 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9729b69-91ec-4d18-8f82-75ec33f758c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:02.532923 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9729b69-91ec-4d18-8f82-75ec33f758c8 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:02.533602 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9729b69-91ec-4d18-8f82-75ec33f758c8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:02.534441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9729b69-91ec-4d18-8f82-75ec33f758c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:02.535537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 508/1028] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:10:02.545425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9729b69-91ec-4d18-8f82-75ec33f758c8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:02.545530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65362f19-008d-43c6-a6bb-06ff834d07aa None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:02.545617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 521/1029] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:10:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:02.546370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9729b69-91ec-4d18-8f82-75ec33f758c8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:02.593705 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:02.640264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65362f19-008d-43c6-a6bb-06ff834d07aa None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:02.649827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9729b69-91ec-4d18-8f82-75ec33f758c8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:02.673932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d560162-104c-4fb6-b937-409eaeb94613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:02.675150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d560162-104c-4fb6-b937-409eaeb94613 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:02.675439 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d560162-104c-4fb6-b937-409eaeb94613 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:02.675702 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d560162-104c-4fb6-b937-409eaeb94613 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:02.676848 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d560162-104c-4fb6-b937-409eaeb94613 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:02.678290 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d560162-104c-4fb6-b937-409eaeb94613 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:02.680048 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 509/1030] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:10:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:02.680640 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d560162-104c-4fb6-b937-409eaeb94613 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:02.689502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e11b0-5d10-4c16-839e-f69f5d8465d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:02.690139 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e11b0-5d10-4c16-839e-f69f5d8465d3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:02.690465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e11b0-5d10-4c16-839e-f69f5d8465d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:02.690770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26e11b0-5d10-4c16-839e-f69f5d8465d3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:02.691529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e11b0-5d10-4c16-839e-f69f5d8465d3 None admin] RBAC: Adding query filter params (interface=public, service_id=f7a97cd2fd5f43d58151983b935cb944, region_id=RegionOne) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:02.691841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e11b0-5d10-4c16-839e-f69f5d8465d3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:02.693196 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26e11b0-5d10-4c16-839e-f69f5d8465d3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:02.695628 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:02.699261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 522/1031] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 1 14:10:02 2022] GET /identity/v3/endpoints?service_id=f7a97cd2fd5f43d58151983b935cb944&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:02.700256 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e11b0-5d10-4c16-839e-f69f5d8465d3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:02.781873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d560162-104c-4fb6-b937-409eaeb94613 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:02.800201 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26e11b0-5d10-4c16-839e-f69f5d8465d3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:02.805002 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:02.815841 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0acc72-6d40-4ea7-9e7e-ed9bc360e963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:02.816499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0acc72-6d40-4ea7-9e7e-ed9bc360e963 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:02.816835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0acc72-6d40-4ea7-9e7e-ed9bc360e963 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:02.817110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0acc72-6d40-4ea7-9e7e-ed9bc360e963 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:02.828378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0acc72-6d40-4ea7-9e7e-ed9bc360e963 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-8f0acc72-6d40-4ea7-9e7e-ed9bc360e963 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:10:02.833756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:02.835061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:02.836118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:02.836118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:02.836118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:02.836118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:02.836118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:10:02.836118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:10:02.836118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:10:02.836118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:10:02.836118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:10:02.836118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:10:02.836118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:10:02.836118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:02.836118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 510/1032] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Aug 1 14:10:02 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:02.836118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0acc72-6d40-4ea7-9e7e-ed9bc360e963 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:02.838131 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8c57f-9524-4558-b638-6e60ca0ea9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:02.838781 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8c57f-9524-4558-b638-6e60ca0ea9de None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:02.839059 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8c57f-9524-4558-b638-6e60ca0ea9de None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:02.839327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8c57f-9524-4558-b638-6e60ca0ea9de None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:02.840012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8c57f-9524-4558-b638-6e60ca0ea9de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:02.841689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8c57f-9524-4558-b638-6e60ca0ea9de None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:02.870676 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 523/1033] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:10:02 2022] POST /identity/v3/users => generated 285 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:10:02.870676 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8c57f-9524-4558-b638-6e60ca0ea9de None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:02.941203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:02.953178 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0acc72-6d40-4ea7-9e7e-ed9bc360e963 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:02.993495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8c57f-9524-4558-b638-6e60ca0ea9de None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:03.001365 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1e464-254a-4233-b649-cef1225b5995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:03.002012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1e464-254a-4233-b649-cef1225b5995 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:03.002286 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1e464-254a-4233-b649-cef1225b5995 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:03.002605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab1e464-254a-4233-b649-cef1225b5995 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:03.003489 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1e464-254a-4233-b649-cef1225b5995 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:03.004892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab1e464-254a-4233-b649-cef1225b5995 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:03.013365 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 511/1034] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 1 14:10:02 2022] GET /identity/v3/services => generated 1957 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:10:03.038770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378bc1d-91d6-47ef-a2ec-2f011b770a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:03.039425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378bc1d-91d6-47ef-a2ec-2f011b770a8f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:03.039704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378bc1d-91d6-47ef-a2ec-2f011b770a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:03.039979 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378bc1d-91d6-47ef-a2ec-2f011b770a8f None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:03.040755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378bc1d-91d6-47ef-a2ec-2f011b770a8f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:03.041068 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378bc1d-91d6-47ef-a2ec-2f011b770a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:03.042515 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378bc1d-91d6-47ef-a2ec-2f011b770a8f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:03.052553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 524/1035] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Aug 1 14:10:02 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:03.059240 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1e464-254a-4233-b649-cef1225b5995 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:03.118516 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:03.177008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab1e464-254a-4233-b649-cef1225b5995 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:03.214900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff0ea7-317b-4428-9e9a-fc95a2bfed07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:03.215545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff0ea7-317b-4428-9e9a-fc95a2bfed07 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:03.215825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff0ea7-317b-4428-9e9a-fc95a2bfed07 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:03.216096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eff0ea7-317b-4428-9e9a-fc95a2bfed07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:03.226670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff0ea7-317b-4428-9e9a-fc95a2bfed07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:03.228138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eff0ea7-317b-4428-9e9a-fc95a2bfed07 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:03.243051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-2eff0ea7-317b-4428-9e9a-fc95a2bfed07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:10:03.243051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:03.243051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:03.243051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:03.243051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:03.243051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:03.243051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:03.243051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:03.243051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:03.243051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:03.243051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:03.243051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:03.243051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:10:03.243051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:10:03.243051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:03.243956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:03.244857 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:10:03.244857 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:10:03.244857 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:10:03.244857 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:03.244857 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 512/1036] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:10:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:03.249971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378bc1d-91d6-47ef-a2ec-2f011b770a8f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:03.355155 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378bc1d-91d6-47ef-a2ec-2f011b770a8f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:03.375639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:03.400082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd71d4-4174-4fa6-9369-8d5e75d5434e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:03.400700 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd71d4-4174-4fa6-9369-8d5e75d5434e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:03.400977 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd71d4-4174-4fa6-9369-8d5e75d5434e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:03.401250 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bd71d4-4174-4fa6-9369-8d5e75d5434e None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:03.401937 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd71d4-4174-4fa6-9369-8d5e75d5434e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:03.402240 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd71d4-4174-4fa6-9369-8d5e75d5434e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:03.403703 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bd71d4-4174-4fa6-9369-8d5e75d5434e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:03.420156 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 525/1037] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:10:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:03.421594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff0ea7-317b-4428-9e9a-fc95a2bfed07 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:03.521064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:03.524569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eff0ea7-317b-4428-9e9a-fc95a2bfed07 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:03.559396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9180b8-56b1-4619-ab65-98862d2985f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:03.560034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9180b8-56b1-4619-ab65-98862d2985f2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:03.560316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9180b8-56b1-4619-ab65-98862d2985f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:03.560590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9180b8-56b1-4619-ab65-98862d2985f2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:03.568800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9180b8-56b1-4619-ab65-98862d2985f2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:03.570255 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9180b8-56b1-4619-ab65-98862d2985f2 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-8d9180b8-56b1-4619-ab65-98862d2985f2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:10:03.581356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:03.582301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:03.583284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:03.583284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:03.583284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:10:03.583284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:10:03.583284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:10:03.583284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:10:03.583284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:10:03.583284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:10:03.583284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:10:03.583284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:03.587158 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 513/1038] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 1 14:10:03 2022] GET /identity/v3/users/nova => generated 82 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:10:03.588570 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd71d4-4174-4fa6-9369-8d5e75d5434e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:03.692227 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bd71d4-4174-4fa6-9369-8d5e75d5434e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:03.726118 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09996f32-7a61-4138-bee4-a853d48c30e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:03.726769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09996f32-7a61-4138-bee4-a853d48c30e6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:03.727053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09996f32-7a61-4138-bee4-a853d48c30e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:03.727327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09996f32-7a61-4138-bee4-a853d48c30e6 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:03.728125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09996f32-7a61-4138-bee4-a853d48c30e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:03.728430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09996f32-7a61-4138-bee4-a853d48c30e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:03.729930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09996f32-7a61-4138-bee4-a853d48c30e6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:03.752428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 526/1039] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 1 14:10:03 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:03.754559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9180b8-56b1-4619-ab65-98862d2985f2 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:03.855703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9180b8-56b1-4619-ab65-98862d2985f2 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:03.897083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e7bee-7091-4917-b2ea-5905e6015dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:03.897691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e7bee-7091-4917-b2ea-5905e6015dc0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:03.897963 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e7bee-7091-4917-b2ea-5905e6015dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:03.898227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37e7bee-7091-4917-b2ea-5905e6015dc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:03.926289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:03.966914 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e7bee-7091-4917-b2ea-5905e6015dc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:03.968296 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37e7bee-7091-4917-b2ea-5905e6015dc0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:04.079160 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 514/1040] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:10:03 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 14:10:04.080452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09996f32-7a61-4138-bee4-a853d48c30e6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:04.118569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:04.189662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09996f32-7a61-4138-bee4-a853d48c30e6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:04.224382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5a473-ce66-4866-bfd6-0705d272a2be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:04.224949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5a473-ce66-4866-bfd6-0705d272a2be None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:04.225231 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5a473-ce66-4866-bfd6-0705d272a2be None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:04.225507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5a473-ce66-4866-bfd6-0705d272a2be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:04.235542 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5a473-ce66-4866-bfd6-0705d272a2be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:04.237594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5a473-ce66-4866-bfd6-0705d272a2be None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:04.252084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-46d5a473-ce66-4866-bfd6-0705d272a2be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:10:04.252084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:04.252084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:04.252084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:04.252084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:04.252084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:04.252084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:04.252084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:04.252084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:04.252084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:04.252084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:04.252084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:04.252084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:10:04.252084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:10:04.252084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:04.252990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:04.253890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:10:04.253890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:10:04.253890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:10:04.253890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:10:04.254902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 527/1041] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:10:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:04.258853 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e7bee-7091-4917-b2ea-5905e6015dc0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:04.317591 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:04.360127 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37e7bee-7091-4917-b2ea-5905e6015dc0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:04.393624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317127b6-1c33-4591-81fe-976733227555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:04.394259 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317127b6-1c33-4591-81fe-976733227555 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:04.394539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317127b6-1c33-4591-81fe-976733227555 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:04.394837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317127b6-1c33-4591-81fe-976733227555 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:04.395519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317127b6-1c33-4591-81fe-976733227555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:04.395820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317127b6-1c33-4591-81fe-976733227555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:04.397197 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317127b6-1c33-4591-81fe-976733227555 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:04.413224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 515/1042] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:10:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:04.414667 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5a473-ce66-4866-bfd6-0705d272a2be None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:04.504421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:04.517279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5a473-ce66-4866-bfd6-0705d272a2be None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:04.551808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78a52-080e-47b7-9956-b7d2b99dceb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:04.552451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78a52-080e-47b7-9956-b7d2b99dceb9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:04.552731 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78a52-080e-47b7-9956-b7d2b99dceb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:04.553003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f78a52-080e-47b7-9956-b7d2b99dceb9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:04.559690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f78a52-080e-47b7-9956-b7d2b99dceb9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:04.561133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f78a52-080e-47b7-9956-b7d2b99dceb9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:04.572688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-22f78a52-080e-47b7-9956-b7d2b99dceb9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:10:04.572688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:04.572688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:04.572688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:04.572688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:04.572688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:04.572688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:04.572688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:04.572688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:04.572688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:04.572688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:04.572688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:04.572688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:10:04.572688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:10:04.572688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:04.573633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:04.579474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:10:04.579474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:10:04.579474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:10:04.579474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:10:04.579474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:10:04.579474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:10:04.579474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:10:04.579474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:10:04.579474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 528/1043] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:10:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:04.579970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317127b6-1c33-4591-81fe-976733227555 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:04.682995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317127b6-1c33-4591-81fe-976733227555 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:04.703192 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:04.719686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c850b7-e9b1-4b84-ac8c-f13cd2e2119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:04.720317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c850b7-e9b1-4b84-ac8c-f13cd2e2119f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:04.720597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c850b7-e9b1-4b84-ac8c-f13cd2e2119f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:04.720870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c850b7-e9b1-4b84-ac8c-f13cd2e2119f None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:04.721653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c850b7-e9b1-4b84-ac8c-f13cd2e2119f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:04.721960 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c850b7-e9b1-4b84-ac8c-f13cd2e2119f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:04.723441 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c850b7-e9b1-4b84-ac8c-f13cd2e2119f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:04.740573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 516/1044] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:10:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:04.742317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78a52-080e-47b7-9956-b7d2b99dceb9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:04.848603 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f78a52-080e-47b7-9956-b7d2b99dceb9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:04.882094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139aa1d-fdfe-4d80-9a08-c481ef05d3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:04.882736 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139aa1d-fdfe-4d80-9a08-c481ef05d3eb None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:04.883022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139aa1d-fdfe-4d80-9a08-c481ef05d3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:04.883294 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139aa1d-fdfe-4d80-9a08-c481ef05d3eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:04.884070 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139aa1d-fdfe-4d80-9a08-c481ef05d3eb None admin] RBAC: Adding query filter params (role.id=d1453841ab264a6b8a6be3c292a294ac, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=e856fd5aff914cfb8b8dd86b39c89bd0) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:04.884371 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139aa1d-fdfe-4d80-9a08-c481ef05d3eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:04.885803 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139aa1d-fdfe-4d80-9a08-c481ef05d3eb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:04.898836 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 529/1045] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:10:04 2022] GET /identity/v3/role_assignments?user.id=e856fd5aff914cfb8b8dd86b39c89bd0&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=d1453841ab264a6b8a6be3c292a294ac => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:05.036490 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f33fd-4dd9-4756-bf86-96b8d6175f38 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:05.037002 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f33fd-4dd9-4756-bf86-96b8d6175f38 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:05.037093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670f33fd-4dd9-4756-bf86-96b8d6175f38 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:05.038404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 517/1046] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:05.043782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dae29-eb0b-4038-a714-8b9c8af4cdc3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:05.044072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dae29-eb0b-4038-a714-8b9c8af4cdc3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:05.044346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5dae29-eb0b-4038-a714-8b9c8af4cdc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:05.063222 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ad5dae29-eb0b-4038-a714-8b9c8af4cdc3 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:05.064418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ad5dae29-eb0b-4038-a714-8b9c8af4cdc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:05.069247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90420bdc-18fd-41af-b07e-5cfa9318c9e5 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:05.069535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90420bdc-18fd-41af-b07e-5cfa9318c9e5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:05.069809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90420bdc-18fd-41af-b07e-5cfa9318c9e5 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:05.071308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 518/1047] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:10:05.073903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:05.076964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82fd38-4299-4921-9551-cb622058cbd9 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:05.077335 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82fd38-4299-4921-9551-cb622058cbd9 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:05.078210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c82fd38-4299-4921-9551-cb622058cbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:05.101619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1c82fd38-4299-4921-9551-cb622058cbd9 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:05.102746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1c82fd38-4299-4921-9551-cb622058cbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:05.141920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 530/1048] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:05.164580 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dae29-eb0b-4038-a714-8b9c8af4cdc3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:05.181732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 519/1049] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:10:05.204346 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82fd38-4299-4921-9551-cb622058cbd9 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:05.273907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5dae29-eb0b-4038-a714-8b9c8af4cdc3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:05.309429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a3fb5-4155-4bf7-ac5c-8a22521d00b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:05.310076 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a3fb5-4155-4bf7-ac5c-8a22521d00b8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:05.310358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a3fb5-4155-4bf7-ac5c-8a22521d00b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:05.310657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16a3fb5-4155-4bf7-ac5c-8a22521d00b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:05.322314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c82fd38-4299-4921-9551-cb622058cbd9 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:05.322596 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16a3fb5-4155-4bf7-ac5c-8a22521d00b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-f16a3fb5-4155-4bf7-ac5c-8a22521d00b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:10:05.327586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:05.328756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:05.334934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:05.334934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:05.334934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:05.334934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:05.334934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:10:05.334934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:10:05.334934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:10:05.334934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:10:05.334934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:10:05.334934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:10:05.334934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:05.334934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:10:05.334934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 531/1050] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:10:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:10:05.335661 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a3fb5-4155-4bf7-ac5c-8a22521d00b8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:05.339658 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:05.339973 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:05.368177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd813cf6-434a-444f-bf33-c51b87ff6d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:05.368742 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd813cf6-434a-444f-bf33-c51b87ff6d14 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:05.369017 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd813cf6-434a-444f-bf33-c51b87ff6d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:05.369287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd813cf6-434a-444f-bf33-c51b87ff6d14 None admin] PATH_INFO: `/v3/services/image` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:05.369913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd813cf6-434a-444f-bf33-c51b87ff6d14 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:05.371313 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd813cf6-434a-444f-bf33-c51b87ff6d14 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-bd813cf6-434a-444f-bf33-c51b87ff6d14 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:05.380539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:05.381561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:05.382595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:05.382595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:05.382595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:05.382595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:05.382595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:05.382595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:05.382595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:05.382595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:05.382595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:05.382595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:05.382595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:10:05.382595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:10:05.382595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 01 14:10:05.382595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:05.382595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 520/1051] 10.222.0.70 () {56 vars in 1105 bytes} [Mon Aug 1 14:10:05 2022] GET /identity/v3/services/image => generated 86 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:10:05.388346 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd813cf6-434a-444f-bf33-c51b87ff6d14 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:05.449073 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16a3fb5-4155-4bf7-ac5c-8a22521d00b8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:05.483773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b1662-c6dc-4883-95c7-019b60e4a3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:05.484389 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b1662-c6dc-4883-95c7-019b60e4a3ae None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:05.484670 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b1662-c6dc-4883-95c7-019b60e4a3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:05.484941 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36b1662-c6dc-4883-95c7-019b60e4a3ae None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:05.485656 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b1662-c6dc-4883-95c7-019b60e4a3ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:05.485957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b1662-c6dc-4883-95c7-019b60e4a3ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:05.487907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36b1662-c6dc-4883-95c7-019b60e4a3ae None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:05.494744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd813cf6-434a-444f-bf33-c51b87ff6d14 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:05.496481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 532/1052] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:10:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:05.501751 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b1662-c6dc-4883-95c7-019b60e4a3ae None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:05.532606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdf2bd-8a9a-44aa-80a3-bf9ac65f8114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:05.533228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdf2bd-8a9a-44aa-80a3-bf9ac65f8114 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:05.533503 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdf2bd-8a9a-44aa-80a3-bf9ac65f8114 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:05.534379 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dcdf2bd-8a9a-44aa-80a3-bf9ac65f8114 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:05.535075 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdf2bd-8a9a-44aa-80a3-bf9ac65f8114 None admin] RBAC: Adding query filter params (name=image) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:05.535377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdf2bd-8a9a-44aa-80a3-bf9ac65f8114 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:05.536969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dcdf2bd-8a9a-44aa-80a3-bf9ac65f8114 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:05.546950 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 521/1053] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:10:05 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:05.547937 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdf2bd-8a9a-44aa-80a3-bf9ac65f8114 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:05.566908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:05.589370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:05.609808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36b1662-c6dc-4883-95c7-019b60e4a3ae None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:05.648229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2f48e-ba9c-44e3-9777-08f3979e4277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:05.648783 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2f48e-ba9c-44e3-9777-08f3979e4277 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:05.649060 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2f48e-ba9c-44e3-9777-08f3979e4277 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:05.649324 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad2f48e-ba9c-44e3-9777-08f3979e4277 None admin] PATH_INFO: `/v3/users/1578ad62b11a457cb77d1bfaf54836b3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:05.652401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dcdf2bd-8a9a-44aa-80a3-bf9ac65f8114 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:05.664063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2f48e-ba9c-44e3-9777-08f3979e4277 None admin] RBAC: Authorizing `identity:get_user(user_id=1578ad62b11a457cb77d1bfaf54836b3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:05.665496 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad2f48e-ba9c-44e3-9777-08f3979e4277 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:05.671893 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 533/1054] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:10:05 2022] GET /identity/v3/users/1578ad62b11a457cb77d1bfaf54836b3 => generated 285 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:05.673607 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2f48e-ba9c-44e3-9777-08f3979e4277 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:05.694059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ca511-9ec3-4a1c-8ebb-dd179c3df9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:05.694704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ca511-9ec3-4a1c-8ebb-dd179c3df9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:05.694986 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ca511-9ec3-4a1c-8ebb-dd179c3df9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:05.695258 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ca511-9ec3-4a1c-8ebb-dd179c3df9c8 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:05.695925 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ca511-9ec3-4a1c-8ebb-dd179c3df9c8 None admin] RBAC: Adding query filter params (type=image) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:05.696224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ca511-9ec3-4a1c-8ebb-dd179c3df9c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:05.697592 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171ca511-9ec3-4a1c-8ebb-dd179c3df9c8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:05.702492 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 522/1055] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:10:05 2022] GET /identity/v3/services?type=image => generated 350 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:05.708251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ca511-9ec3-4a1c-8ebb-dd179c3df9c8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:05.787776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad2f48e-ba9c-44e3-9777-08f3979e4277 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:05.812128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:05.821296 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ca511-9ec3-4a1c-8ebb-dd179c3df9c8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:05.822915 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:05.824417 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52769316-aa9e-41ed-8bff-423eaf190ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:05.825131 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52769316-aa9e-41ed-8bff-423eaf190ece None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:05.825485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52769316-aa9e-41ed-8bff-423eaf190ece None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:05.825762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52769316-aa9e-41ed-8bff-423eaf190ece None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:05.860894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edb780-67b7-481a-ae0b-6290af98696a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:05.861918 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edb780-67b7-481a-ae0b-6290af98696a None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:05.862444 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edb780-67b7-481a-ae0b-6290af98696a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:05.862752 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92edb780-67b7-481a-ae0b-6290af98696a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:05.863453 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edb780-67b7-481a-ae0b-6290af98696a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:05.864829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92edb780-67b7-481a-ae0b-6290af98696a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:05.898695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 523/1056] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:10:05 2022] POST /identity/v3/endpoints => generated 327 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:10:05.907997 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52769316-aa9e-41ed-8bff-423eaf190ece None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:05.910386 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52769316-aa9e-41ed-8bff-423eaf190ece None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:06.037555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 534/1057] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:10:05 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:10:06.039214 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edb780-67b7-481a-ae0b-6290af98696a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:06.151881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92edb780-67b7-481a-ae0b-6290af98696a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:06.184890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb2dae-3e92-407d-9100-eb4ef83d26d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:06.185529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb2dae-3e92-407d-9100-eb4ef83d26d2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:06.185807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb2dae-3e92-407d-9100-eb4ef83d26d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:06.186076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb2dae-3e92-407d-9100-eb4ef83d26d2 None admin] PATH_INFO: `/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:06.187241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb2dae-3e92-407d-9100-eb4ef83d26d2 None admin] RBAC: Authorizing `identity:get_project(project_id=43448eb74c9a4bbda3f4a27bebac4ed9)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:06.188677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb2dae-3e92-407d-9100-eb4ef83d26d2 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:06.191034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 524/1058] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:10:06 2022] GET /identity/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:06.197220 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52769316-aa9e-41ed-8bff-423eaf190ece None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:06.221738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:06.302118 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52769316-aa9e-41ed-8bff-423eaf190ece None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:06.338355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692a2f13-26b9-4006-bb0d-079601d882d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:06.339236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a2f13-26b9-4006-bb0d-079601d882d5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:06.339670 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a2f13-26b9-4006-bb0d-079601d882d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:06.340119 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692a2f13-26b9-4006-bb0d-079601d882d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:06.341057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a2f13-26b9-4006-bb0d-079601d882d5 None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=43448eb74c9a4bbda3f4a27bebac4ed9, user.id=1578ad62b11a457cb77d1bfaf54836b3) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:06.341516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a2f13-26b9-4006-bb0d-079601d882d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:06.343126 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692a2f13-26b9-4006-bb0d-079601d882d5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:06.354612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 535/1059] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:10:06 2022] GET /identity/v3/role_assignments?user.id=1578ad62b11a457cb77d1bfaf54836b3&scope.project.id=43448eb74c9a4bbda3f4a27bebac4ed9&role.id=0681632796d144f6a7ac8eca157001ec => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:06.911674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb839c8-7636-4b7d-a418-bf6e7f20b8a6 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:06.912057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb839c8-7636-4b7d-a418-bf6e7f20b8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:06.912237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb839c8-7636-4b7d-a418-bf6e7f20b8a6 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:06.913596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 525/1060] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:06.918665 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8254355-9b77-41cd-9454-cf1dffaab2cd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:06.919022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8254355-9b77-41cd-9454-cf1dffaab2cd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:06.919356 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8254355-9b77-41cd-9454-cf1dffaab2cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:06.937477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f8254355-9b77-41cd-9454-cf1dffaab2cd None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:06.938749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f8254355-9b77-41cd-9454-cf1dffaab2cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:07.012968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 536/1061] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:07.035538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb839c8-7636-4b7d-a418-bf6e7f20b8a6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:07.067898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:07.149075 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb839c8-7636-4b7d-a418-bf6e7f20b8a6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:07.181567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47d9bb-4799-4044-bcdc-d8597e7b6907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:07.182138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47d9bb-4799-4044-bcdc-d8597e7b6907 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:07.182416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47d9bb-4799-4044-bcdc-d8597e7b6907 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:07.182718 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e47d9bb-4799-4044-bcdc-d8597e7b6907 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:07.193719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e47d9bb-4799-4044-bcdc-d8597e7b6907 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-4e47d9bb-4799-4044-bcdc-d8597e7b6907 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:10:07.198590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:07.199538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:07.200396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:07.200396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:07.200396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:07.200396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:07.200396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:10:07.200396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:10:07.200396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:10:07.200396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:10:07.200396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:10:07.200396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:10:07.200396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:10:07.200396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:07.202903 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 526/1062] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Aug 1 14:10:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:07.206273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8254355-9b77-41cd-9454-cf1dffaab2cd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:07.224038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:07.305357 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8254355-9b77-41cd-9454-cf1dffaab2cd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:07.340100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313d816-1646-4741-abb0-fcd31da47922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:07.340709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313d816-1646-4741-abb0-fcd31da47922 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:07.340986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313d816-1646-4741-abb0-fcd31da47922 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:07.341257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313d816-1646-4741-abb0-fcd31da47922 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:07.341959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313d816-1646-4741-abb0-fcd31da47922 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:07.342259 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313d816-1646-4741-abb0-fcd31da47922 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:07.343657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5313d816-1646-4741-abb0-fcd31da47922 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:07.356370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 537/1063] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Aug 1 14:10:07 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:07.357808 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47d9bb-4799-4044-bcdc-d8597e7b6907 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:07.449660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:07.468894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e47d9bb-4799-4044-bcdc-d8597e7b6907 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:07.504245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181703d6-f493-442d-9d10-acf2fcd14912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:07.505004 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181703d6-f493-442d-9d10-acf2fcd14912 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:07.505277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181703d6-f493-442d-9d10-acf2fcd14912 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:07.505591 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181703d6-f493-442d-9d10-acf2fcd14912 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:07.516443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181703d6-f493-442d-9d10-acf2fcd14912 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:07.517891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-181703d6-f493-442d-9d10-acf2fcd14912 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:07.532314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-181703d6-f493-442d-9d10-acf2fcd14912 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:10:07.532314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:07.532314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:07.532314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:07.532314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:07.532314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:07.532314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:07.532314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:07.532314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:07.532314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:07.532314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:07.532314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:07.532314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:10:07.532314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:10:07.532314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:07.533208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:07.534135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:10:07.534135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:10:07.534135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:10:07.534135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:07.534135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 527/1064] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:10:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:10:07.540184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313d816-1646-4741-abb0-fcd31da47922 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:07.620657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:07.643957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313d816-1646-4741-abb0-fcd31da47922 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:07.677788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939b7c7-d91f-4448-8a0f-946933ef4d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:07.678452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939b7c7-d91f-4448-8a0f-946933ef4d07 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:07.678765 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939b7c7-d91f-4448-8a0f-946933ef4d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:07.679036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5939b7c7-d91f-4448-8a0f-946933ef4d07 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:07.679753 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939b7c7-d91f-4448-8a0f-946933ef4d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:07.680056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939b7c7-d91f-4448-8a0f-946933ef4d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:07.681397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5939b7c7-d91f-4448-8a0f-946933ef4d07 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:07.697380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 538/1065] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:10:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:07.698655 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181703d6-f493-442d-9d10-acf2fcd14912 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:07.811420 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181703d6-f493-442d-9d10-acf2fcd14912 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:07.846867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb9295-c64c-49ca-9857-455d688ef6c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:07.847511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb9295-c64c-49ca-9857-455d688ef6c9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:07.847792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb9295-c64c-49ca-9857-455d688ef6c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:07.848063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb9295-c64c-49ca-9857-455d688ef6c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:07.849999 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:07.856922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb9295-c64c-49ca-9857-455d688ef6c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:07.859060 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb9295-c64c-49ca-9857-455d688ef6c9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-28bb9295-c64c-49ca-9857-455d688ef6c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:10:07.871279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:07.872215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:07.873152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:07.873152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:07.873152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:10:07.873152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:10:07.873152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:10:07.873152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:10:07.873152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:10:07.873152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:10:07.873152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:10:07.873152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:07.874426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 528/1066] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 1 14:10:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:07.878145 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939b7c7-d91f-4448-8a0f-946933ef4d07 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:07.940572 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47d068-a11a-4972-998e-a28b063a3b80 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:07.940863 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47d068-a11a-4972-998e-a28b063a3b80 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:07.941173 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47d068-a11a-4972-998e-a28b063a3b80 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:07.942753 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 529/1067] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:07.947493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78558997-d0d5-4435-ae5d-1598c0cf5b35 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:07.947784 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78558997-d0d5-4435-ae5d-1598c0cf5b35 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:07.948063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78558997-d0d5-4435-ae5d-1598c0cf5b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:07.966359 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-78558997-d0d5-4435-ae5d-1598c0cf5b35 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:07.967577 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-78558997-d0d5-4435-ae5d-1598c0cf5b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:07.988834 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5939b7c7-d91f-4448-8a0f-946933ef4d07 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:08.024863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fdbd4-21ef-47d7-b0a2-d586a0762234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:08.025600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fdbd4-21ef-47d7-b0a2-d586a0762234 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:08.025877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fdbd4-21ef-47d7-b0a2-d586a0762234 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:08.026146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387fdbd4-21ef-47d7-b0a2-d586a0762234 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:08.027074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fdbd4-21ef-47d7-b0a2-d586a0762234 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:08.027378 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fdbd4-21ef-47d7-b0a2-d586a0762234 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:08.028801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387fdbd4-21ef-47d7-b0a2-d586a0762234 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:08.038737 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:08.044738 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 530/1068] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:10:08.054144 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 539/1069] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 1 14:10:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:08.055845 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78558997-d0d5-4435-ae5d-1598c0cf5b35 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:08.071656 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fdbd4-21ef-47d7-b0a2-d586a0762234 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:08.174408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78558997-d0d5-4435-ae5d-1598c0cf5b35 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:08.184735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387fdbd4-21ef-47d7-b0a2-d586a0762234 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:08.203227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:08.217648 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47072015-15a8-4761-9519-8e5c3fff8229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:08.218299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47072015-15a8-4761-9519-8e5c3fff8229 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:08.218607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47072015-15a8-4761-9519-8e5c3fff8229 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:08.218917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47072015-15a8-4761-9519-8e5c3fff8229 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:08.220099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5c74d6-0a21-4a0e-852c-3ac9504fd0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:08.220718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c74d6-0a21-4a0e-852c-3ac9504fd0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:08.220990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c74d6-0a21-4a0e-852c-3ac9504fd0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:08.221841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5c74d6-0a21-4a0e-852c-3ac9504fd0d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:08.230284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47072015-15a8-4761-9519-8e5c3fff8229 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:08.231642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47072015-15a8-4761-9519-8e5c3fff8229 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:08.247124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-47072015-15a8-4761-9519-8e5c3fff8229 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:10:08.247124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:08.247124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:08.247124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:08.247124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:08.247124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:08.247124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:08.247124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:08.247124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:08.247124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:08.247124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:08.247124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:08.247124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:10:08.247124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:10:08.247124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:08.248140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:08.249034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:10:08.249034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:10:08.249034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:10:08.249034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:08.249034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 531/1070] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:08.254292 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47072015-15a8-4761-9519-8e5c3fff8229 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:08.289057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:08.298158 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c74d6-0a21-4a0e-852c-3ac9504fd0d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:08.300303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b5c74d6-0a21-4a0e-852c-3ac9504fd0d7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:08.360282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47072015-15a8-4761-9519-8e5c3fff8229 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:08.394076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8cb82-20e4-4f57-aa68-22ae39791deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:08.394716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8cb82-20e4-4f57-aa68-22ae39791deb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:08.394998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8cb82-20e4-4f57-aa68-22ae39791deb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:08.395266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf8cb82-20e4-4f57-aa68-22ae39791deb None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:08.395950 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8cb82-20e4-4f57-aa68-22ae39791deb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:08.396248 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8cb82-20e4-4f57-aa68-22ae39791deb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:08.397637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf8cb82-20e4-4f57-aa68-22ae39791deb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:08.407852 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 540/1071] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:10:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 14:10:08.409442 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a6bff-5a3b-4c11-b775-d2fa8f8d670c None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:08.409565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 532/1072] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:08.409671 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a6bff-5a3b-4c11-b775-d2fa8f8d670c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:08.409945 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746a6bff-5a3b-4c11-b775-d2fa8f8d670c None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:08.411439 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 541/1073] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:08.414715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a6bff-5a3b-4c11-b775-d2fa8f8d670c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:08.414837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8cb82-20e4-4f57-aa68-22ae39791deb None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:08.449317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:08.511036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:08.514314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf8cb82-20e4-4f57-aa68-22ae39791deb None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:08.518819 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746a6bff-5a3b-4c11-b775-d2fa8f8d670c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:08.548122 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731ee87-144c-439f-ba2a-53bf3d4080c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:08.548763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731ee87-144c-439f-ba2a-53bf3d4080c0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:08.549052 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731ee87-144c-439f-ba2a-53bf3d4080c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:08.549356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1731ee87-144c-439f-ba2a-53bf3d4080c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:08.551586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe19f5d-90a5-4c09-9854-b16f73b55a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:08.552213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe19f5d-90a5-4c09-9854-b16f73b55a4e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:08.552489 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe19f5d-90a5-4c09-9854-b16f73b55a4e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:08.552758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe19f5d-90a5-4c09-9854-b16f73b55a4e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:08.559231 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe19f5d-90a5-4c09-9854-b16f73b55a4e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:08.559367 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731ee87-144c-439f-ba2a-53bf3d4080c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:08.560663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe19f5d-90a5-4c09-9854-b16f73b55a4e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:08.560759 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1731ee87-144c-439f-ba2a-53bf3d4080c0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:08.572524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-2fe19f5d-90a5-4c09-9854-b16f73b55a4e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:10:08.572524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:08.572524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:08.572524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:08.572524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:08.572524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:08.572524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:08.572524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:08.572524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:08.572524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:08.572524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:08.572524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:08.572524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:10:08.572524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:10:08.572524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:08.573562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:08.574469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:10:08.574469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:10:08.574469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:10:08.574469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:10:08.574469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:10:08.574469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:10:08.574469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:10:08.574469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:10:08.574469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 542/1074] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:10:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:08.575253 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafec2f-0da4-453e-9f15-75c4fe72f28c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:08.575253 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafec2f-0da4-453e-9f15-75c4fe72f28c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:08.575376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafec2f-0da4-453e-9f15-75c4fe72f28c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:08.575624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-1731ee87-144c-439f-ba2a-53bf3d4080c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:10:08.575624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:08.575624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:08.575624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:08.575624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:08.575624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:08.575624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:08.575624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:08.575624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:08.575624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:08.575624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:08.575624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:08.575624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:10:08.575624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:10:08.575624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:08.577083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:08.578365 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:10:08.578365 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:10:08.578365 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:10:08.578365 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:08.578365 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 533/1075] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:10:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:08.582256 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731ee87-144c-439f-ba2a-53bf3d4080c0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:08.596773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1cafec2f-0da4-453e-9f15-75c4fe72f28c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:08.597998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1cafec2f-0da4-453e-9f15-75c4fe72f28c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:08.664837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 543/1076] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:08.665594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafec2f-0da4-453e-9f15-75c4fe72f28c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:08.679504 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:08.685324 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1731ee87-144c-439f-ba2a-53bf3d4080c0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:08.720468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8be1c-c14b-49ad-a36c-9fc717523650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:08.721154 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8be1c-c14b-49ad-a36c-9fc717523650 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:08.721413 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8be1c-c14b-49ad-a36c-9fc717523650 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:08.721689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d8be1c-c14b-49ad-a36c-9fc717523650 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:08.722432 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8be1c-c14b-49ad-a36c-9fc717523650 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:08.722765 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8be1c-c14b-49ad-a36c-9fc717523650 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:08.724230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d8be1c-c14b-49ad-a36c-9fc717523650 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:08.737147 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 534/1077] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:10:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:08.738002 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8be1c-c14b-49ad-a36c-9fc717523650 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:08.752367 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:08.769244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafec2f-0da4-453e-9f15-75c4fe72f28c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:08.803175 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420532e9-190a-45f1-98bc-b22b0cc69caa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:08.803787 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420532e9-190a-45f1-98bc-b22b0cc69caa None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:08.804064 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420532e9-190a-45f1-98bc-b22b0cc69caa None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:08.804334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420532e9-190a-45f1-98bc-b22b0cc69caa None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:08.805016 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420532e9-190a-45f1-98bc-b22b0cc69caa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:08.805313 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420532e9-190a-45f1-98bc-b22b0cc69caa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:08.806707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420532e9-190a-45f1-98bc-b22b0cc69caa None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:08.818296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 544/1078] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:08.819097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420532e9-190a-45f1-98bc-b22b0cc69caa None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:08.842028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d8be1c-c14b-49ad-a36c-9fc717523650 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:08.884268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ed3da-7915-41af-a25d-e32a7ac57305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:08.884942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ed3da-7915-41af-a25d-e32a7ac57305 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:08.885221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ed3da-7915-41af-a25d-e32a7ac57305 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:08.885494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ed3da-7915-41af-a25d-e32a7ac57305 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:08.898411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5ed3da-7915-41af-a25d-e32a7ac57305 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-bc5ed3da-7915-41af-a25d-e32a7ac57305 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:10:08.903519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:08.904549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:08.905442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:08.905442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:08.905442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:08.905442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:08.905442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:10:08.905442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:10:08.905442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:10:08.905442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:10:08.905442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:10:08.905442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:10:08.905442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:08.905442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:08.905442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 535/1079] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:10:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:08.912619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ed3da-7915-41af-a25d-e32a7ac57305 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:08.925266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:08.938060 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420532e9-190a-45f1-98bc-b22b0cc69caa None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:08.977972 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4cd0c-8ced-45ac-b520-400ed36afecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:08.978698 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4cd0c-8ced-45ac-b520-400ed36afecb None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:08.978985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4cd0c-8ced-45ac-b520-400ed36afecb None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:08.979264 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b4cd0c-8ced-45ac-b520-400ed36afecb None admin] PATH_INFO: `/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/e856fd5aff914cfb8b8dd86b39c89bd0/roles/d1453841ab264a6b8a6be3c292a294ac` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:08.981500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4cd0c-8ced-45ac-b520-400ed36afecb None admin] RBAC: Authorizing `identity:create_grant(project_id=c8bcd31836684fe5b43fd604df3d3e8b, user_id=e856fd5aff914cfb8b8dd86b39c89bd0, role_id=d1453841ab264a6b8a6be3c292a294ac)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:08.982966 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b4cd0c-8ced-45ac-b520-400ed36afecb None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:09.001001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 545/1080] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:10:08 2022] PUT /identity/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/e856fd5aff914cfb8b8dd86b39c89bd0/roles/d1453841ab264a6b8a6be3c292a294ac => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:10:09.040348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ed3da-7915-41af-a25d-e32a7ac57305 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:09.087848 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2b6d6-4aa1-47d6-a8ed-d1b7005907ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:09.088491 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2b6d6-4aa1-47d6-a8ed-d1b7005907ac None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:09.088771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2b6d6-4aa1-47d6-a8ed-d1b7005907ac None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:09.089041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2b6d6-4aa1-47d6-a8ed-d1b7005907ac None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:09.089773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2b6d6-4aa1-47d6-a8ed-d1b7005907ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:09.090076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2b6d6-4aa1-47d6-a8ed-d1b7005907ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:09.091653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2b6d6-4aa1-47d6-a8ed-d1b7005907ac None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:09.102764 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 536/1081] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:10:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:09.107775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4cd0c-8ced-45ac-b520-400ed36afecb None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:09.119359 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:09.220944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b4cd0c-8ced-45ac-b520-400ed36afecb None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:09.255160 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c95ec0-059a-45f3-b058-9b30b3d2ca6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:09.255799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c95ec0-059a-45f3-b058-9b30b3d2ca6e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:09.256079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c95ec0-059a-45f3-b058-9b30b3d2ca6e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:09.256351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c95ec0-059a-45f3-b058-9b30b3d2ca6e None admin] PATH_INFO: `/v3/users/1578ad62b11a457cb77d1bfaf54836b3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:09.257517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c95ec0-059a-45f3-b058-9b30b3d2ca6e None admin] RBAC: Authorizing `identity:get_user(user_id=1578ad62b11a457cb77d1bfaf54836b3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:09.258964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c95ec0-059a-45f3-b058-9b30b3d2ca6e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:09.260575 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 546/1082] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:10:09 2022] GET /identity/v3/users/1578ad62b11a457cb77d1bfaf54836b3 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:09.266267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2b6d6-4aa1-47d6-a8ed-d1b7005907ac None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:09.334453 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:09.364931 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2b6d6-4aa1-47d6-a8ed-d1b7005907ac None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:09.397945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0499433-35e5-46d1-85bd-dcdbaa7825fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:09.398597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0499433-35e5-46d1-85bd-dcdbaa7825fb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:09.398891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0499433-35e5-46d1-85bd-dcdbaa7825fb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:09.399163 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0499433-35e5-46d1-85bd-dcdbaa7825fb None admin] PATH_INFO: `/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:09.400327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0499433-35e5-46d1-85bd-dcdbaa7825fb None admin] RBAC: Authorizing `identity:get_project(project_id=43448eb74c9a4bbda3f4a27bebac4ed9)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:09.401799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0499433-35e5-46d1-85bd-dcdbaa7825fb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:09.403752 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 537/1083] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:10:09 2022] GET /identity/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:09.410808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c95ec0-059a-45f3-b058-9b30b3d2ca6e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:09.489685 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:09.512698 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c95ec0-059a-45f3-b058-9b30b3d2ca6e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:09.545985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc69f7-baee-4152-88d3-7b4d37896509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:09.546672 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc69f7-baee-4152-88d3-7b4d37896509 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:09.546951 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc69f7-baee-4152-88d3-7b4d37896509 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:09.547223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc69f7-baee-4152-88d3-7b4d37896509 None admin] PATH_INFO: `/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9/users/1578ad62b11a457cb77d1bfaf54836b3/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:09.549146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc69f7-baee-4152-88d3-7b4d37896509 None admin] RBAC: Authorizing `identity:create_grant(project_id=43448eb74c9a4bbda3f4a27bebac4ed9, user_id=1578ad62b11a457cb77d1bfaf54836b3, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:09.550561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc69f7-baee-4152-88d3-7b4d37896509 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:09.563457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 547/1084] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:10:09 2022] PUT /identity/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9/users/1578ad62b11a457cb77d1bfaf54836b3/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:10:11.044150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b612fbe-4f5e-4993-85ab-8b3a7575a8ac None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:11.044677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b612fbe-4f5e-4993-85ab-8b3a7575a8ac None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:11.044677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b612fbe-4f5e-4993-85ab-8b3a7575a8ac None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:11.046201 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 538/1085] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:11.051147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3c200-298a-4d66-a5fe-44cafb2c21dd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:11.051551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3c200-298a-4d66-a5fe-44cafb2c21dd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:11.051706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b3c200-298a-4d66-a5fe-44cafb2c21dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:11.069402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b8b3c200-298a-4d66-a5fe-44cafb2c21dd None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:11.070608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b8b3c200-298a-4d66-a5fe-44cafb2c21dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:11.137300 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 548/1086] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:11.161301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b612fbe-4f5e-4993-85ab-8b3a7575a8ac None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:11.261890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b612fbe-4f5e-4993-85ab-8b3a7575a8ac None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:11.295555 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c40ea0-80e0-4797-adf6-9ffc51ce4abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:11.296194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c40ea0-80e0-4797-adf6-9ffc51ce4abd None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:11.296477 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c40ea0-80e0-4797-adf6-9ffc51ce4abd None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:11.296751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c40ea0-80e0-4797-adf6-9ffc51ce4abd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:11.303566 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:11.308296 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c40ea0-80e0-4797-adf6-9ffc51ce4abd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-36c40ea0-80e0-4797-adf6-9ffc51ce4abd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:10:11.313656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:11.314607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:11.315629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:11.315629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:11.315629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:11.315629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:11.315629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:10:11.315629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:10:11.315629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:10:11.315629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:10:11.315629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:10:11.315629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:10:11.315629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 01 14:10:11.315629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:11.315629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 539/1087] 10.222.0.70 () {56 vars in 1120 bytes} [Mon Aug 1 14:10:11 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:11.320856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3c200-298a-4d66-a5fe-44cafb2c21dd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:11.382196 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:11.420845 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b3c200-298a-4d66-a5fe-44cafb2c21dd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:11.454104 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2b6836-89f3-475a-9a6d-fb43acd9f6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:11.454756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6836-89f3-475a-9a6d-fb43acd9f6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:11.455037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6836-89f3-475a-9a6d-fb43acd9f6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:11.455907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2b6836-89f3-475a-9a6d-fb43acd9f6a9 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:11.456624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6836-89f3-475a-9a6d-fb43acd9f6a9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:11.456928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6836-89f3-475a-9a6d-fb43acd9f6a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:11.458286 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2b6836-89f3-475a-9a6d-fb43acd9f6a9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:11.466564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 549/1088] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Aug 1 14:10:11 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:11.472084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c40ea0-80e0-4797-adf6-9ffc51ce4abd None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:11.559361 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a68031-07a8-4aac-8120-9139db664206 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:11.559650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a68031-07a8-4aac-8120-9139db664206 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:11.559925 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a68031-07a8-4aac-8120-9139db664206 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:11.561276 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 550/1089] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:10:11.566957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffcd7d-ee4e-44d8-839a-57f10d0e1870 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:11.567243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffcd7d-ee4e-44d8-839a-57f10d0e1870 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:11.567519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffcd7d-ee4e-44d8-839a-57f10d0e1870 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:11.573903 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c40ea0-80e0-4797-adf6-9ffc51ce4abd None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:11.591093 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b9ffcd7d-ee4e-44d8-839a-57f10d0e1870 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:11.592287 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b9ffcd7d-ee4e-44d8-839a-57f10d0e1870 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:11.607643 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b051b08-c011-400d-b6bf-b0c5df3ebb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:11.608270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b051b08-c011-400d-b6bf-b0c5df3ebb06 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:11.608626 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b051b08-c011-400d-b6bf-b0c5df3ebb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:11.608896 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b051b08-c011-400d-b6bf-b0c5df3ebb06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:11.619272 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b051b08-c011-400d-b6bf-b0c5df3ebb06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:11.620767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b051b08-c011-400d-b6bf-b0c5df3ebb06 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:11.637700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-9b051b08-c011-400d-b6bf-b0c5df3ebb06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:10:11.637700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:11.637700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:11.637700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:11.637700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:11.637700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:11.637700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:11.637700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:11.637700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:11.637700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:11.637700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:11.637700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:11.637700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:10:11.637700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:10:11.637700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:11.638763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:11.639767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:10:11.639767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:10:11.639767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:10:11.639767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:11.639767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 540/1090] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:10:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:11.645737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b051b08-c011-400d-b6bf-b0c5df3ebb06 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:11.667662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 551/1091] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:10:11.690851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffcd7d-ee4e-44d8-839a-57f10d0e1870 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:11.694829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:11.745171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b051b08-c011-400d-b6bf-b0c5df3ebb06 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:11.746898 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:11.779680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672c0a2-a511-48e7-aafa-00080ca7e002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:11.780300 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672c0a2-a511-48e7-aafa-00080ca7e002 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:11.780581 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672c0a2-a511-48e7-aafa-00080ca7e002 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:11.780853 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3672c0a2-a511-48e7-aafa-00080ca7e002 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:11.781540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672c0a2-a511-48e7-aafa-00080ca7e002 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:11.781844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672c0a2-a511-48e7-aafa-00080ca7e002 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:11.783260 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3672c0a2-a511-48e7-aafa-00080ca7e002 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:11.789428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffcd7d-ee4e-44d8-839a-57f10d0e1870 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:11.794745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 541/1092] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:10:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:11.801041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672c0a2-a511-48e7-aafa-00080ca7e002 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:11.823954 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc01205-3f06-4af5-91a2-991104b1a0db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:11.824558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc01205-3f06-4af5-91a2-991104b1a0db None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:11.824840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc01205-3f06-4af5-91a2-991104b1a0db None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:11.825112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc01205-3f06-4af5-91a2-991104b1a0db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:11.835268 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc01205-3f06-4af5-91a2-991104b1a0db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-afc01205-3f06-4af5-91a2-991104b1a0db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:10:11.840643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:11.841625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:11.842461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:11.842461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:11.842461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:11.842461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:11.842461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:10:11.842461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:10:11.842461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:10:11.842461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:10:11.842461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:10:11.842461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:10:11.842461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:11.842461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:10:11.842461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 552/1093] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:10:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:10:11.848486 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc01205-3f06-4af5-91a2-991104b1a0db None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:11.905963 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3672c0a2-a511-48e7-aafa-00080ca7e002 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:11.917027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:11.941830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a10f9b-eb91-4196-ad66-782f4a3f61ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:11.942483 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a10f9b-eb91-4196-ad66-782f4a3f61ba None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:11.942772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a10f9b-eb91-4196-ad66-782f4a3f61ba None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:11.943044 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a10f9b-eb91-4196-ad66-782f4a3f61ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:11.949451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc01205-3f06-4af5-91a2-991104b1a0db None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:11.949944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a10f9b-eb91-4196-ad66-782f4a3f61ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:11.951417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a10f9b-eb91-4196-ad66-782f4a3f61ba None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d2a10f9b-eb91-4196-ad66-782f4a3f61ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:10:11.963130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:11.964245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:11.965623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:11.965623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:11.965623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:10:11.965623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:10:11.965623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:10:11.965623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:10:11.965623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:10:11.965623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:10:11.965623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 01 14:10:11.965623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:11.965623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 542/1094] 10.222.0.70 () {56 vars in 1093 bytes} [Mon Aug 1 14:10:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:10:11.969302 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:11.969888 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a10f9b-eb91-4196-ad66-782f4a3f61ba None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:11.988304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4ea52-59d9-4954-aef6-a7a8dfe1c54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:11.988917 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4ea52-59d9-4954-aef6-a7a8dfe1c54b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:11.989197 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4ea52-59d9-4954-aef6-a7a8dfe1c54b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:11.989473 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b4ea52-59d9-4954-aef6-a7a8dfe1c54b None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:11.990185 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4ea52-59d9-4954-aef6-a7a8dfe1c54b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:11.990487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4ea52-59d9-4954-aef6-a7a8dfe1c54b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:11.991878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b4ea52-59d9-4954-aef6-a7a8dfe1c54b None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:12.003029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 553/1095] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:10:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:12.008583 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4ea52-59d9-4954-aef6-a7a8dfe1c54b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:12.075956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a10f9b-eb91-4196-ad66-782f4a3f61ba None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:12.107891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b4ea52-59d9-4954-aef6-a7a8dfe1c54b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:12.109948 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a2f6d-d69d-4ba5-8442-4c8bdd84c754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:12.110565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a2f6d-d69d-4ba5-8442-4c8bdd84c754 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:12.110877 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a2f6d-d69d-4ba5-8442-4c8bdd84c754 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:12.111152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8a2f6d-d69d-4ba5-8442-4c8bdd84c754 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:12.111972 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a2f6d-d69d-4ba5-8442-4c8bdd84c754 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:12.112324 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a2f6d-d69d-4ba5-8442-4c8bdd84c754 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:12.113788 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8a2f6d-d69d-4ba5-8442-4c8bdd84c754 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:12.131405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 543/1096] 10.222.0.70 () {56 vars in 1133 bytes} [Mon Aug 1 14:10:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:12.137061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a2f6d-d69d-4ba5-8442-4c8bdd84c754 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:12.143671 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dcb7b-a68a-4315-bd85-76e952ece9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:12.144300 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dcb7b-a68a-4315-bd85-76e952ece9d2 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:12.144574 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dcb7b-a68a-4315-bd85-76e952ece9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:12.144838 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822dcb7b-a68a-4315-bd85-76e952ece9d2 None admin] PATH_INFO: `/v3/users/1578ad62b11a457cb77d1bfaf54836b3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:12.146008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dcb7b-a68a-4315-bd85-76e952ece9d2 None admin] RBAC: Authorizing `identity:get_user(user_id=1578ad62b11a457cb77d1bfaf54836b3)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:12.147456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822dcb7b-a68a-4315-bd85-76e952ece9d2 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:12.149036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 554/1097] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:10:12 2022] GET /identity/v3/users/1578ad62b11a457cb77d1bfaf54836b3 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:12.154508 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dcb7b-a68a-4315-bd85-76e952ece9d2 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:12.164791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:12.201888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:12.235698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8a2f6d-d69d-4ba5-8442-4c8bdd84c754 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:12.256272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822dcb7b-a68a-4315-bd85-76e952ece9d2 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:12.270786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669af8f-1514-48f1-acfe-ccbf24c638af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:12.271411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669af8f-1514-48f1-acfe-ccbf24c638af None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:12.271696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669af8f-1514-48f1-acfe-ccbf24c638af None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:12.271989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5669af8f-1514-48f1-acfe-ccbf24c638af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:12.289354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009d5ee-bbe0-42ae-a5e8-0b8875655a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:12.289962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009d5ee-bbe0-42ae-a5e8-0b8875655a31 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:12.290239 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009d5ee-bbe0-42ae-a5e8-0b8875655a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:12.290506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b009d5ee-bbe0-42ae-a5e8-0b8875655a31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:12.338897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669af8f-1514-48f1-acfe-ccbf24c638af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:12.340305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5669af8f-1514-48f1-acfe-ccbf24c638af None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:12.358609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009d5ee-bbe0-42ae-a5e8-0b8875655a31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:12.360053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b009d5ee-bbe0-42ae-a5e8-0b8875655a31 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:12.366696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:12.404223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:12.438447 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 544/1098] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:10:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 14:10:12.444987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669af8f-1514-48f1-acfe-ccbf24c638af None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:12.459767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 555/1099] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:10:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 01 14:10:12.465666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009d5ee-bbe0-42ae-a5e8-0b8875655a31 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:12.541565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5669af8f-1514-48f1-acfe-ccbf24c638af None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:12.560886 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b009d5ee-bbe0-42ae-a5e8-0b8875655a31 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:12.569082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:12.577518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a05f7-03f7-4919-b4d1-c309ccc70a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:12.578150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a05f7-03f7-4919-b4d1-c309ccc70a55 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:12.578435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a05f7-03f7-4919-b4d1-c309ccc70a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:12.578749 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a05f7-03f7-4919-b4d1-c309ccc70a55 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:12.589003 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a05f7-03f7-4919-b4d1-c309ccc70a55 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:12.590395 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a05f7-03f7-4919-b4d1-c309ccc70a55 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:12.595836 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e618e3-3250-4c60-ac86-9aa4d77115a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:12.596477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e618e3-3250-4c60-ac86-9aa4d77115a8 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:12.596757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e618e3-3250-4c60-ac86-9aa4d77115a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:12.597041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e618e3-3250-4c60-ac86-9aa4d77115a8 None admin] PATH_INFO: `/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:12.598177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e618e3-3250-4c60-ac86-9aa4d77115a8 None admin] RBAC: Authorizing `identity:get_project(project_id=43448eb74c9a4bbda3f4a27bebac4ed9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:12.599628 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e618e3-3250-4c60-ac86-9aa4d77115a8 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:12.601293 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 556/1100] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:10:12 2022] GET /identity/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:12.605119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-952a05f7-03f7-4919-b4d1-c309ccc70a55 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:10:12.605119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:12.605119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:12.605119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:12.605119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:12.605119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:12.605119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:12.605119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:12.605119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:12.605119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:12.605119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:12.605119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:12.605119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:10:12.605119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:10:12.605119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:12.606146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:12.607112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:10:12.607112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:10:12.607112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:10:12.607112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:12.607112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 545/1101] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:10:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:10:12.607654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e618e3-3250-4c60-ac86-9aa4d77115a8 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:12.612103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a05f7-03f7-4919-b4d1-c309ccc70a55 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:12.625173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:12.708933 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e618e3-3250-4c60-ac86-9aa4d77115a8 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:12.711226 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a05f7-03f7-4919-b4d1-c309ccc70a55 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:12.743077 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f26a0-4d22-48dd-b8d4-ae93fbd6dc2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:12.743694 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f26a0-4d22-48dd-b8d4-ae93fbd6dc2c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:12.743973 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f26a0-4d22-48dd-b8d4-ae93fbd6dc2c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:12.744246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f26a0-4d22-48dd-b8d4-ae93fbd6dc2c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:12.744536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3430b63-97f3-4c3e-a4b6-a16eb9837665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:12.745029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f26a0-4d22-48dd-b8d4-ae93fbd6dc2c None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=43448eb74c9a4bbda3f4a27bebac4ed9, user.id=1578ad62b11a457cb77d1bfaf54836b3) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:12.745130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3430b63-97f3-4c3e-a4b6-a16eb9837665 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:12.745336 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f26a0-4d22-48dd-b8d4-ae93fbd6dc2c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:12.745448 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3430b63-97f3-4c3e-a4b6-a16eb9837665 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:12.745669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3430b63-97f3-4c3e-a4b6-a16eb9837665 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:12.746349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3430b63-97f3-4c3e-a4b6-a16eb9837665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:12.746681 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3430b63-97f3-4c3e-a4b6-a16eb9837665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:12.746779 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f26a0-4d22-48dd-b8d4-ae93fbd6dc2c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:12.748048 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3430b63-97f3-4c3e-a4b6-a16eb9837665 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:12.753283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 557/1102] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:10:12 2022] GET /identity/v3/role_assignments?user.id=1578ad62b11a457cb77d1bfaf54836b3&scope.project.id=43448eb74c9a4bbda3f4a27bebac4ed9&role.id=0681632796d144f6a7ac8eca157001ec => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:12.760684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 546/1103] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:10:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:12.766379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f26a0-4d22-48dd-b8d4-ae93fbd6dc2c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:12.851314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:12.874181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f26a0-4d22-48dd-b8d4-ae93fbd6dc2c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:12.918988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a738f-d35a-400a-8759-c426fa6f7990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:12.918988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a738f-d35a-400a-8759-c426fa6f7990 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:12.918988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a738f-d35a-400a-8759-c426fa6f7990 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:12.918988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071a738f-d35a-400a-8759-c426fa6f7990 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:12.927043 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a738f-d35a-400a-8759-c426fa6f7990 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:12.928482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071a738f-d35a-400a-8759-c426fa6f7990 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:12.941136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-071a738f-d35a-400a-8759-c426fa6f7990 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:10:12.941136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:12.941136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:12.941136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:12.941136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:12.941136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:12.941136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:12.941136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:12.941136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:12.941136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:12.941136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:12.941136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:12.941136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:10:12.941136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:10:12.941136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:12.942204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:12.943609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:10:12.943609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:10:12.943609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:10:12.943609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:10:12.943609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:10:12.943609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:10:12.943609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:10:12.943609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:10:12.943609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 558/1104] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:10:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:12.948256 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3430b63-97f3-4c3e-a4b6-a16eb9837665 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:12.999624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:13.058011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3430b63-97f3-4c3e-a4b6-a16eb9837665 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:13.092411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f61d1e-185a-4373-be44-199543866e0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:13.093035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f61d1e-185a-4373-be44-199543866e0e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:13.093281 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f61d1e-185a-4373-be44-199543866e0e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:13.093555 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f61d1e-185a-4373-be44-199543866e0e None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:13.094288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f61d1e-185a-4373-be44-199543866e0e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:13.094606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f61d1e-185a-4373-be44-199543866e0e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:13.096048 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f61d1e-185a-4373-be44-199543866e0e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:13.112466 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 547/1105] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:10:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:13.113521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a738f-d35a-400a-8759-c426fa6f7990 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:13.212965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071a738f-d35a-400a-8759-c426fa6f7990 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:13.251404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be96d3a8-460c-4b4e-9a24-e0eaafc116b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:13.252184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96d3a8-460c-4b4e-9a24-e0eaafc116b4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:13.252985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96d3a8-460c-4b4e-9a24-e0eaafc116b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:13.253258 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be96d3a8-460c-4b4e-9a24-e0eaafc116b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:13.254104 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96d3a8-460c-4b4e-9a24-e0eaafc116b4 None admin] RBAC: Adding query filter params (role.id=d1453841ab264a6b8a6be3c292a294ac, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=e856fd5aff914cfb8b8dd86b39c89bd0) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:13.254345 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96d3a8-460c-4b4e-9a24-e0eaafc116b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:13.255803 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be96d3a8-460c-4b4e-9a24-e0eaafc116b4 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:13.261689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 559/1106] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:10:13 2022] GET /identity/v3/role_assignments?user.id=e856fd5aff914cfb8b8dd86b39c89bd0&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=d1453841ab264a6b8a6be3c292a294ac => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:14.785459 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80d932-bdb7-42b7-a128-b100ba44561d None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:14.785990 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80d932-bdb7-42b7-a128-b100ba44561d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:14.785990 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80d932-bdb7-42b7-a128-b100ba44561d None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:14.787383 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 548/1107] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:14.792499 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f6baa-b954-4748-83fa-f7f04fb0910b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:14.792912 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f6baa-b954-4748-83fa-f7f04fb0910b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:14.793056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800f6baa-b954-4748-83fa-f7f04fb0910b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:14.799894 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:14.812495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-800f6baa-b954-4748-83fa-f7f04fb0910b None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:14.813679 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-800f6baa-b954-4748-83fa-f7f04fb0910b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:14.879130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 560/1108] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:14.903129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80d932-bdb7-42b7-a128-b100ba44561d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:14.999353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:15.004223 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80d932-bdb7-42b7-a128-b100ba44561d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:15.037229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0def01-7432-4dbb-b867-2156ed76e46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:15.037802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0def01-7432-4dbb-b867-2156ed76e46a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:15.038083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0def01-7432-4dbb-b867-2156ed76e46a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:15.038353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0def01-7432-4dbb-b867-2156ed76e46a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:15.039528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0def01-7432-4dbb-b867-2156ed76e46a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:15.040968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0def01-7432-4dbb-b867-2156ed76e46a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:15.042544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 549/1109] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:10:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:15.048301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f6baa-b954-4748-83fa-f7f04fb0910b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:15.143801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800f6baa-b954-4748-83fa-f7f04fb0910b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:15.172331 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:15.178166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31449dc-ae06-4e61-ad5f-d74f092dc733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:15.178804 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31449dc-ae06-4e61-ad5f-d74f092dc733 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:15.179086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31449dc-ae06-4e61-ad5f-d74f092dc733 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:15.179357 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31449dc-ae06-4e61-ad5f-d74f092dc733 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:15.180023 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31449dc-ae06-4e61-ad5f-d74f092dc733 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:15.181445 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31449dc-ae06-4e61-ad5f-d74f092dc733 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:15.201854 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 561/1110] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:10:15 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:10:17.233333 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa9b3d-352f-4c1d-9267-44930ffb381c None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:17.233850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa9b3d-352f-4c1d-9267-44930ffb381c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:17.233939 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aa9b3d-352f-4c1d-9267-44930ffb381c None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:17.235249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 550/1111] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:17.240482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb014af-1d8b-49b8-88ac-4574529c1f8c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:17.240900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb014af-1d8b-49b8-88ac-4574529c1f8c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:17.241028 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb014af-1d8b-49b8-88ac-4574529c1f8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:17.258618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-cfb014af-1d8b-49b8-88ac-4574529c1f8c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:17.259746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cfb014af-1d8b-49b8-88ac-4574529c1f8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:17.323581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 562/1112] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:17.347431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa9b3d-352f-4c1d-9267-44930ffb381c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:17.446289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aa9b3d-352f-4c1d-9267-44930ffb381c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:17.481125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71475a-4a7e-468b-a812-df74de222e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:17.481755 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71475a-4a7e-468b-a812-df74de222e04 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:17.482040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71475a-4a7e-468b-a812-df74de222e04 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:17.482312 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a71475a-4a7e-468b-a812-df74de222e04 None admin] PATH_INFO: `/v3/roles/b99d323b1fad482ead67a8e8501c1c0b` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:17.483784 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71475a-4a7e-468b-a812-df74de222e04 None admin] RBAC: Authorizing `identity:get_role(role_id=b99d323b1fad482ead67a8e8501c1c0b)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:17.485170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a71475a-4a7e-468b-a812-df74de222e04 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:17.486535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 551/1113] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:10:17 2022] GET /identity/v3/roles/b99d323b1fad482ead67a8e8501c1c0b => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:17.492328 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb014af-1d8b-49b8-88ac-4574529c1f8c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:17.588124 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb014af-1d8b-49b8-88ac-4574529c1f8c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:17.604561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:17.621425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcb4c5-ef3a-48cc-8d78-14a74ba82dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:17.622044 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcb4c5-ef3a-48cc-8d78-14a74ba82dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:17.622346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcb4c5-ef3a-48cc-8d78-14a74ba82dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:17.622619 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84dcb4c5-ef3a-48cc-8d78-14a74ba82dd3 None admin] PATH_INFO: `/v3/users/8b133681d0b544258fd9e3048cf725da` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:17.636674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcb4c5-ef3a-48cc-8d78-14a74ba82dd3 None admin] RBAC: Authorizing `identity:get_user(user_id=8b133681d0b544258fd9e3048cf725da)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:17.638092 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84dcb4c5-ef3a-48cc-8d78-14a74ba82dd3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:17.639782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 563/1114] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:10:17 2022] GET /identity/v3/users/8b133681d0b544258fd9e3048cf725da => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:17.646022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71475a-4a7e-468b-a812-df74de222e04 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:17.680220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:17.743977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a71475a-4a7e-468b-a812-df74de222e04 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:17.776246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda72e-85be-4d43-9c55-063fc9be371d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:17.776852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda72e-85be-4d43-9c55-063fc9be371d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:17.777129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda72e-85be-4d43-9c55-063fc9be371d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:17.777399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbda72e-85be-4d43-9c55-063fc9be371d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:17.842229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbda72e-85be-4d43-9c55-063fc9be371d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:17.843648 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbda72e-85be-4d43-9c55-063fc9be371d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:17.876327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:17.943780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 552/1115] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:10:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:10:17.949797 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcb4c5-ef3a-48cc-8d78-14a74ba82dd3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:18.046724 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84dcb4c5-ef3a-48cc-8d78-14a74ba82dd3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:18.080177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e4af39-e54c-4892-8a56-d1fb2026ed44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:18.080798 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4af39-e54c-4892-8a56-d1fb2026ed44 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:18.081073 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4af39-e54c-4892-8a56-d1fb2026ed44 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:18.081341 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e4af39-e54c-4892-8a56-d1fb2026ed44 None admin] PATH_INFO: `/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:18.082463 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4af39-e54c-4892-8a56-d1fb2026ed44 None admin] RBAC: Authorizing `identity:get_project(project_id=43448eb74c9a4bbda3f4a27bebac4ed9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:18.083971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e4af39-e54c-4892-8a56-d1fb2026ed44 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:18.085610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 564/1116] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:10:17 2022] GET /identity/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:18.092074 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda72e-85be-4d43-9c55-063fc9be371d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:18.187784 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbda72e-85be-4d43-9c55-063fc9be371d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:18.220169 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8ca95e-b5f7-45fb-938c-1b4d7f135171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:18.221289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ca95e-b5f7-45fb-938c-1b4d7f135171 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:18.221563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ca95e-b5f7-45fb-938c-1b4d7f135171 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:18.221829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8ca95e-b5f7-45fb-938c-1b4d7f135171 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:18.222615 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ca95e-b5f7-45fb-938c-1b4d7f135171 None admin] RBAC: Adding query filter params (role.id=b99d323b1fad482ead67a8e8501c1c0b, scope.project.id=43448eb74c9a4bbda3f4a27bebac4ed9, user.id=8b133681d0b544258fd9e3048cf725da) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:18.222919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ca95e-b5f7-45fb-938c-1b4d7f135171 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:18.224339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8ca95e-b5f7-45fb-938c-1b4d7f135171 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:18.227126 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:18.230092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 553/1117] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:10:18 2022] GET /identity/v3/role_assignments?user.id=8b133681d0b544258fd9e3048cf725da&scope.project.id=43448eb74c9a4bbda3f4a27bebac4ed9&role.id=b99d323b1fad482ead67a8e8501c1c0b => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:20.214003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d37a68-d8ac-43f0-ab57-cf5e741a03b4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:20.214566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d37a68-d8ac-43f0-ab57-cf5e741a03b4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:20.214566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d37a68-d8ac-43f0-ab57-cf5e741a03b4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:20.215885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 565/1118] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:20.221486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd4bb-387e-42c8-a310-79c5dbfcc308 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:20.221879 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd4bb-387e-42c8-a310-79c5dbfcc308 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:20.222040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0fd4bb-387e-42c8-a310-79c5dbfcc308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:20.239777 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-aa0fd4bb-387e-42c8-a310-79c5dbfcc308 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:20.240967 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-aa0fd4bb-387e-42c8-a310-79c5dbfcc308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:20.307798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 554/1119] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:20.330839 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d37a68-d8ac-43f0-ab57-cf5e741a03b4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:20.376520 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:20.429626 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d37a68-d8ac-43f0-ab57-cf5e741a03b4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:20.463263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8302fe-15a4-46df-b750-21863e39b130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:20.463888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8302fe-15a4-46df-b750-21863e39b130 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:20.464170 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8302fe-15a4-46df-b750-21863e39b130 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:20.464445 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8302fe-15a4-46df-b750-21863e39b130 None admin] PATH_INFO: `/v3/roles/b99d323b1fad482ead67a8e8501c1c0b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:20.465879 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8302fe-15a4-46df-b750-21863e39b130 None admin] RBAC: Authorizing `identity:get_role(role_id=b99d323b1fad482ead67a8e8501c1c0b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:20.467278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8302fe-15a4-46df-b750-21863e39b130 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:20.468603 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 566/1120] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:10:20 2022] GET /identity/v3/roles/b99d323b1fad482ead67a8e8501c1c0b => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:20.474318 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fd4bb-387e-42c8-a310-79c5dbfcc308 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:20.570266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0fd4bb-387e-42c8-a310-79c5dbfcc308 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:20.603535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:20.609838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8bed1-6f00-499f-971a-415a988ea8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:20.610543 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8bed1-6f00-499f-971a-415a988ea8cb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:20.610929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8bed1-6f00-499f-971a-415a988ea8cb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:20.611231 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b8bed1-6f00-499f-971a-415a988ea8cb None admin] PATH_INFO: `/v3/users/8b133681d0b544258fd9e3048cf725da` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:20.612385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8bed1-6f00-499f-971a-415a988ea8cb None admin] RBAC: Authorizing `identity:get_user(user_id=8b133681d0b544258fd9e3048cf725da)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:20.613819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b8bed1-6f00-499f-971a-415a988ea8cb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:20.615436 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 555/1121] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:10:20 2022] GET /identity/v3/users/8b133681d0b544258fd9e3048cf725da => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:20.622023 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8302fe-15a4-46df-b750-21863e39b130 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:20.719848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8302fe-15a4-46df-b750-21863e39b130 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:20.732598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:20.754538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812b8b50-c0af-485d-87b4-82d0ffa8c07a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:20.755192 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b8b50-c0af-485d-87b4-82d0ffa8c07a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:20.755470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b8b50-c0af-485d-87b4-82d0ffa8c07a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:20.755742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812b8b50-c0af-485d-87b4-82d0ffa8c07a None admin] PATH_INFO: `/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:20.756881 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b8b50-c0af-485d-87b4-82d0ffa8c07a None admin] RBAC: Authorizing `identity:get_project(project_id=43448eb74c9a4bbda3f4a27bebac4ed9)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:20.758302 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812b8b50-c0af-485d-87b4-82d0ffa8c07a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:20.759992 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 567/1122] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:10:20 2022] GET /identity/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:20.765933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8bed1-6f00-499f-971a-415a988ea8cb None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:20.862297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b8bed1-6f00-499f-971a-415a988ea8cb None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:20.895060 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a974b7-b2a8-47da-9d75-a6da4956430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:20.895711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a974b7-b2a8-47da-9d75-a6da4956430f None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:20.895989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a974b7-b2a8-47da-9d75-a6da4956430f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:20.896261 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a974b7-b2a8-47da-9d75-a6da4956430f None admin] PATH_INFO: `/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9/users/8b133681d0b544258fd9e3048cf725da/roles/b99d323b1fad482ead67a8e8501c1c0b` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:20.898389 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a974b7-b2a8-47da-9d75-a6da4956430f None admin] RBAC: Authorizing `identity:create_grant(project_id=43448eb74c9a4bbda3f4a27bebac4ed9, user_id=8b133681d0b544258fd9e3048cf725da, role_id=b99d323b1fad482ead67a8e8501c1c0b)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:20.899857 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a974b7-b2a8-47da-9d75-a6da4956430f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:20.913040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 556/1123] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:10:20 2022] PUT /identity/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9/users/8b133681d0b544258fd9e3048cf725da/roles/b99d323b1fad482ead67a8e8501c1c0b => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:10:22.889689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1b37d-d459-4ece-a35a-758c58168fda None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:22.890240 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1b37d-d459-4ece-a35a-758c58168fda None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:22.890240 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d1b37d-d459-4ece-a35a-758c58168fda None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:22.891598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 568/1124] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:22.897224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363160c-d230-47ed-9b9a-493f290e1dd6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:22.897659 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363160c-d230-47ed-9b9a-493f290e1dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:22.897753 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0363160c-d230-47ed-9b9a-493f290e1dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:22.916008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0363160c-d230-47ed-9b9a-493f290e1dd6 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:22.917180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0363160c-d230-47ed-9b9a-493f290e1dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:22.969205 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:22.984892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 557/1125] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:23.009089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1b37d-d459-4ece-a35a-758c58168fda None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:23.107043 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d1b37d-d459-4ece-a35a-758c58168fda None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:23.140040 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cb4b6-ce59-40c8-a2d2-94076ebb60d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:23.140600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cb4b6-ce59-40c8-a2d2-94076ebb60d3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:23.140879 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cb4b6-ce59-40c8-a2d2-94076ebb60d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:23.141149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1cb4b6-ce59-40c8-a2d2-94076ebb60d3 None admin] PATH_INFO: `/v3/roles/b99d323b1fad482ead67a8e8501c1c0b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:23.142650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1cb4b6-ce59-40c8-a2d2-94076ebb60d3 None admin] RBAC: Authorizing `identity:get_role(role_id=b99d323b1fad482ead67a8e8501c1c0b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:23.144001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1cb4b6-ce59-40c8-a2d2-94076ebb60d3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:23.145336 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 569/1126] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:10:23 2022] GET /identity/v3/roles/b99d323b1fad482ead67a8e8501c1c0b => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:23.151077 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363160c-d230-47ed-9b9a-493f290e1dd6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:23.247069 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0363160c-d230-47ed-9b9a-493f290e1dd6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:23.285460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea07de2-267e-48a1-873a-c90da3c1d1bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:23.286105 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea07de2-267e-48a1-873a-c90da3c1d1bf None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:23.286386 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea07de2-267e-48a1-873a-c90da3c1d1bf None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:23.286685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea07de2-267e-48a1-873a-c90da3c1d1bf None admin] PATH_INFO: `/v3/users/8b133681d0b544258fd9e3048cf725da` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:23.287848 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea07de2-267e-48a1-873a-c90da3c1d1bf None admin] RBAC: Authorizing `identity:get_user(user_id=8b133681d0b544258fd9e3048cf725da)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:23.289294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea07de2-267e-48a1-873a-c90da3c1d1bf None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:23.290922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 558/1127] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:10:23 2022] GET /identity/v3/users/8b133681d0b544258fd9e3048cf725da => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:23.296759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cb4b6-ce59-40c8-a2d2-94076ebb60d3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:23.345962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:23.395741 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1cb4b6-ce59-40c8-a2d2-94076ebb60d3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:23.429115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a9d38-1daf-4abe-9547-1b8f12137882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:23.429721 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a9d38-1daf-4abe-9547-1b8f12137882 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:23.430003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a9d38-1daf-4abe-9547-1b8f12137882 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:23.430279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09a9d38-1daf-4abe-9547-1b8f12137882 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:23.495478 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a9d38-1daf-4abe-9547-1b8f12137882 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:23.496918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09a9d38-1daf-4abe-9547-1b8f12137882 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:23.543351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:23.602072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 570/1128] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:10:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:10:23.607974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea07de2-267e-48a1-873a-c90da3c1d1bf None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:23.664044 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:23.706797 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea07de2-267e-48a1-873a-c90da3c1d1bf None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:23.742230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b287916-decb-46cb-a357-5bb485eb1100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:23.742910 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b287916-decb-46cb-a357-5bb485eb1100 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:23.743186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b287916-decb-46cb-a357-5bb485eb1100 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:23.743494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b287916-decb-46cb-a357-5bb485eb1100 None admin] PATH_INFO: `/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:23.744617 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b287916-decb-46cb-a357-5bb485eb1100 None admin] RBAC: Authorizing `identity:get_project(project_id=43448eb74c9a4bbda3f4a27bebac4ed9)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:23.746049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b287916-decb-46cb-a357-5bb485eb1100 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:23.747708 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 559/1129] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:10:23 2022] GET /identity/v3/projects/43448eb74c9a4bbda3f4a27bebac4ed9 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:23.754489 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a9d38-1daf-4abe-9547-1b8f12137882 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:23.850172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09a9d38-1daf-4abe-9547-1b8f12137882 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:23.882317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b80532-0333-4f5f-881c-6e404f6af46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:23.882940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b80532-0333-4f5f-881c-6e404f6af46c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:23.883219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b80532-0333-4f5f-881c-6e404f6af46c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:23.883486 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b80532-0333-4f5f-881c-6e404f6af46c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:23.884254 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b80532-0333-4f5f-881c-6e404f6af46c None admin] RBAC: Adding query filter params (role.id=b99d323b1fad482ead67a8e8501c1c0b, scope.project.id=43448eb74c9a4bbda3f4a27bebac4ed9, user.id=8b133681d0b544258fd9e3048cf725da) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:23.884554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b80532-0333-4f5f-881c-6e404f6af46c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:23.885959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b80532-0333-4f5f-881c-6e404f6af46c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:23.891685 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 571/1130] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:10:23 2022] GET /identity/v3/role_assignments?user.id=8b133681d0b544258fd9e3048cf725da&scope.project.id=43448eb74c9a4bbda3f4a27bebac4ed9&role.id=b99d323b1fad482ead67a8e8501c1c0b => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:25.885943 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dd5af-119b-4b7d-92e9-3c56d3e5d540 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:25.886497 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dd5af-119b-4b7d-92e9-3c56d3e5d540 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:25.886497 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73dd5af-119b-4b7d-92e9-3c56d3e5d540 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:25.887969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 560/1131] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:25.893216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38d19-5192-4398-a72f-fbf0cc589811 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:25.893600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38d19-5192-4398-a72f-fbf0cc589811 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:25.893769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d38d19-5192-4398-a72f-fbf0cc589811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:25.912244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-26d38d19-5192-4398-a72f-fbf0cc589811 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:25.913420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-26d38d19-5192-4398-a72f-fbf0cc589811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:25.920653 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:25.981735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 572/1132] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:26.006183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dd5af-119b-4b7d-92e9-3c56d3e5d540 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:26.106674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73dd5af-119b-4b7d-92e9-3c56d3e5d540 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:26.129047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:26.139953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccb4f66-768a-4352-bd54-859172598afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:26.140526 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb4f66-768a-4352-bd54-859172598afe None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:26.140808 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb4f66-768a-4352-bd54-859172598afe None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:26.141082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccb4f66-768a-4352-bd54-859172598afe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:26.142785 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb4f66-768a-4352-bd54-859172598afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:26.144511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccb4f66-768a-4352-bd54-859172598afe None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:26.146078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 561/1133] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:10:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:26.152010 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d38d19-5192-4398-a72f-fbf0cc589811 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:26.248651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d38d19-5192-4398-a72f-fbf0cc589811 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:26.281832 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dcc8f6-b918-4b16-93fe-f4c422044f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:26.282426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcc8f6-b918-4b16-93fe-f4c422044f4c None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:26.283290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcc8f6-b918-4b16-93fe-f4c422044f4c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:26.283560 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dcc8f6-b918-4b16-93fe-f4c422044f4c None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:26.284235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcc8f6-b918-4b16-93fe-f4c422044f4c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:26.285658 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26dcc8f6-b918-4b16-93fe-f4c422044f4c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:26.299608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:26.312996 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 573/1134] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 1 14:10:26 2022] POST /identity/v3/projects => generated 311 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:10:28.335694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954c63b-d28a-4550-bc0a-739e3b100e0d None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:28.336488 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954c63b-d28a-4550-bc0a-739e3b100e0d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:28.336605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0954c63b-d28a-4550-bc0a-739e3b100e0d None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:28.337851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 562/1135] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:28.343121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466694b-f84b-4fe1-a053-ab431ce05052 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:28.343539 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466694b-f84b-4fe1-a053-ab431ce05052 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:28.343674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c466694b-f84b-4fe1-a053-ab431ce05052 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:28.362228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c466694b-f84b-4fe1-a053-ab431ce05052 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:28.363441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c466694b-f84b-4fe1-a053-ab431ce05052 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:28.427278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 574/1136] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:10:28.452022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954c63b-d28a-4550-bc0a-739e3b100e0d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:28.550738 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0954c63b-d28a-4550-bc0a-739e3b100e0d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:28.584197 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d5c0b9-f2d6-457a-adf5-b6f1b8863eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:28.584819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c0b9-f2d6-457a-adf5-b6f1b8863eeb None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:28.585097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c0b9-f2d6-457a-adf5-b6f1b8863eeb None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:28.585369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d5c0b9-f2d6-457a-adf5-b6f1b8863eeb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:28.586830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5c0b9-f2d6-457a-adf5-b6f1b8863eeb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:28.588216 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d5c0b9-f2d6-457a-adf5-b6f1b8863eeb None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:28.589771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 563/1137] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:10:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:28.596063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466694b-f84b-4fe1-a053-ab431ce05052 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:28.697650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c466694b-f84b-4fe1-a053-ab431ce05052 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:28.721257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:28.732269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d85516-5622-4bf8-8914-9f9c1c8c94df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:28.732878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d85516-5622-4bf8-8914-9f9c1c8c94df None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:28.733157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d85516-5622-4bf8-8914-9f9c1c8c94df None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:28.733432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d85516-5622-4bf8-8914-9f9c1c8c94df None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:28.734095 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d85516-5622-4bf8-8914-9f9c1c8c94df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:28.735580 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d85516-5622-4bf8-8914-9f9c1c8c94df None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:28.755975 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 575/1138] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:10:28 2022] POST /identity/v3/users => generated 286 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:10:30.790019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c63523-e03a-4486-91f4-421d70aceb00 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:30.790600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c63523-e03a-4486-91f4-421d70aceb00 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:30.790600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c63523-e03a-4486-91f4-421d70aceb00 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:30.791923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 564/1139] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:30.797040 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b232a-50f1-46fa-b66d-bf1a3fbd9620 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:30.797440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b232a-50f1-46fa-b66d-bf1a3fbd9620 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:30.797601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b232a-50f1-46fa-b66d-bf1a3fbd9620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:30.817125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6a9b232a-50f1-46fa-b66d-bf1a3fbd9620 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:30.818312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6a9b232a-50f1-46fa-b66d-bf1a3fbd9620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:30.883512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 576/1140] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:30.905775 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c63523-e03a-4486-91f4-421d70aceb00 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:30.965546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:31.006533 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c63523-e03a-4486-91f4-421d70aceb00 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:31.039369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47ee02-7c7e-43a2-879c-f5067d36a2d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:31.039991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47ee02-7c7e-43a2-879c-f5067d36a2d7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:31.040317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47ee02-7c7e-43a2-879c-f5067d36a2d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:31.040538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d47ee02-7c7e-43a2-879c-f5067d36a2d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:31.051844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d47ee02-7c7e-43a2-879c-f5067d36a2d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-9d47ee02-7c7e-43a2-879c-f5067d36a2d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:10:31.056693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:31.057970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:31.059301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:31.059301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:31.059301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:31.059301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:31.059301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:10:31.059301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:10:31.059301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:10:31.059301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:10:31.059301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:10:31.059301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:10:31.059301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:31.059301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:31.059301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 565/1141] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:10:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:31.063955 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b232a-50f1-46fa-b66d-bf1a3fbd9620 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:31.160672 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b232a-50f1-46fa-b66d-bf1a3fbd9620 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:31.170914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:31.194935 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914cf11-ea90-4789-a9b0-7479bd6b7392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:31.195539 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914cf11-ea90-4789-a9b0-7479bd6b7392 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:31.195817 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914cf11-ea90-4789-a9b0-7479bd6b7392 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:31.196087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7914cf11-ea90-4789-a9b0-7479bd6b7392 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:31.196791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914cf11-ea90-4789-a9b0-7479bd6b7392 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:31.197090 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914cf11-ea90-4789-a9b0-7479bd6b7392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:31.198442 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7914cf11-ea90-4789-a9b0-7479bd6b7392 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:31.206280 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 577/1142] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:10:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:31.212405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47ee02-7c7e-43a2-879c-f5067d36a2d7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:31.312079 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d47ee02-7c7e-43a2-879c-f5067d36a2d7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:31.332006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:31.346785 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030b55c-6e51-4539-88c5-c62dec097862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:31.347414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030b55c-6e51-4539-88c5-c62dec097862 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:31.347694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030b55c-6e51-4539-88c5-c62dec097862 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:31.347966 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6030b55c-6e51-4539-88c5-c62dec097862 None admin] PATH_INFO: `/v3/users/b9cc3b0699994ea4930533f413f67d16` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:31.360730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030b55c-6e51-4539-88c5-c62dec097862 None admin] RBAC: Authorizing `identity:get_user(user_id=b9cc3b0699994ea4930533f413f67d16)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:31.362179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6030b55c-6e51-4539-88c5-c62dec097862 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:31.363809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 566/1143] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:10:31 2022] GET /identity/v3/users/b9cc3b0699994ea4930533f413f67d16 => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:31.369695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914cf11-ea90-4789-a9b0-7479bd6b7392 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:31.466660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7914cf11-ea90-4789-a9b0-7479bd6b7392 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:31.499291 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f484c-685f-4a67-9425-db2badca5ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:31.499891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f484c-685f-4a67-9425-db2badca5ec3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:31.500171 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f484c-685f-4a67-9425-db2badca5ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:31.500444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f484c-685f-4a67-9425-db2badca5ec3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:31.540242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:31.565822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f484c-685f-4a67-9425-db2badca5ec3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:31.567228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5f484c-685f-4a67-9425-db2badca5ec3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:31.664473 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 578/1144] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:10:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:10:31.670554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030b55c-6e51-4539-88c5-c62dec097862 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:31.767388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6030b55c-6e51-4539-88c5-c62dec097862 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:31.799554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140102d5-28a6-44ff-a875-c2e9c6d19026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:31.800174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140102d5-28a6-44ff-a875-c2e9c6d19026 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:31.800458 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140102d5-28a6-44ff-a875-c2e9c6d19026 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:31.800728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140102d5-28a6-44ff-a875-c2e9c6d19026 None admin] PATH_INFO: `/v3/projects/f7c840d7e9e54e75b961f3ed664e6eac` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:31.801866 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140102d5-28a6-44ff-a875-c2e9c6d19026 None admin] RBAC: Authorizing `identity:get_project(project_id=f7c840d7e9e54e75b961f3ed664e6eac)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:31.803317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140102d5-28a6-44ff-a875-c2e9c6d19026 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:31.804944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 567/1145] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:10:31 2022] GET /identity/v3/projects/f7c840d7e9e54e75b961f3ed664e6eac => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:31.811193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f484c-685f-4a67-9425-db2badca5ec3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:31.878663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:31.907540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f484c-685f-4a67-9425-db2badca5ec3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:31.940389 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33026d94-aea8-43c9-adb3-44b160bf39ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:31.940996 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33026d94-aea8-43c9-adb3-44b160bf39ef None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:31.941278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33026d94-aea8-43c9-adb3-44b160bf39ef None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:31.941552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33026d94-aea8-43c9-adb3-44b160bf39ef None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:31.942333 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33026d94-aea8-43c9-adb3-44b160bf39ef None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=f7c840d7e9e54e75b961f3ed664e6eac, user.id=b9cc3b0699994ea4930533f413f67d16) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:31.942667 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33026d94-aea8-43c9-adb3-44b160bf39ef None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:31.944088 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33026d94-aea8-43c9-adb3-44b160bf39ef None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:31.949361 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 579/1146] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:10:31 2022] GET /identity/v3/role_assignments?user.id=b9cc3b0699994ea4930533f413f67d16&scope.project.id=f7c840d7e9e54e75b961f3ed664e6eac&role.id=0681632796d144f6a7ac8eca157001ec => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:10:33.903223 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230661d9-69fb-4eb3-9659-a9b2f55d19e6 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:33.903775 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230661d9-69fb-4eb3-9659-a9b2f55d19e6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:33.903775 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230661d9-69fb-4eb3-9659-a9b2f55d19e6 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:33.905118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 568/1147] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:33.910374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0b78b-91e5-429a-bf9b-98c5317ddde9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:33.910795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0b78b-91e5-429a-bf9b-98c5317ddde9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:33.910962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0b78b-91e5-429a-bf9b-98c5317ddde9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:33.928652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1ca0b78b-91e5-429a-bf9b-98c5317ddde9 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:33.929812 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1ca0b78b-91e5-429a-bf9b-98c5317ddde9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:33.997654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 580/1148] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:34.020728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230661d9-69fb-4eb3-9659-a9b2f55d19e6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:34.067584 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:34.123043 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230661d9-69fb-4eb3-9659-a9b2f55d19e6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:34.156746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505777e-93c1-411a-8672-ceb6cc18e368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:34.157343 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505777e-93c1-411a-8672-ceb6cc18e368 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:34.157631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505777e-93c1-411a-8672-ceb6cc18e368 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:34.157908 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4505777e-93c1-411a-8672-ceb6cc18e368 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:34.167794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4505777e-93c1-411a-8672-ceb6cc18e368 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-4505777e-93c1-411a-8672-ceb6cc18e368 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:10:34.172684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:34.173758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:34.174964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:34.174964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:34.174964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:34.174964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:34.174964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:10:34.174964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:10:34.174964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:10:34.174964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:10:34.174964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:10:34.174964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:10:34.174964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:34.174964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:34.174964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 569/1149] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:10:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:34.179949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0b78b-91e5-429a-bf9b-98c5317ddde9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:34.244947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:34.279259 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0b78b-91e5-429a-bf9b-98c5317ddde9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:34.311948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eb352-0f32-4d2e-ab10-ebe91722dc3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:34.312546 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eb352-0f32-4d2e-ab10-ebe91722dc3c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:34.312825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eb352-0f32-4d2e-ab10-ebe91722dc3c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:34.313098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027eb352-0f32-4d2e-ab10-ebe91722dc3c None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:34.314396 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eb352-0f32-4d2e-ab10-ebe91722dc3c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:34.314729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eb352-0f32-4d2e-ab10-ebe91722dc3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:34.316083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027eb352-0f32-4d2e-ab10-ebe91722dc3c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:34.323843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 581/1150] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:10:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:34.329612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505777e-93c1-411a-8672-ceb6cc18e368 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:34.434674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4505777e-93c1-411a-8672-ceb6cc18e368 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:34.442171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:34.469028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e160988-3a62-42f9-b2f0-57254893c273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:34.469684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160988-3a62-42f9-b2f0-57254893c273 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:34.469966 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160988-3a62-42f9-b2f0-57254893c273 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:34.470239 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e160988-3a62-42f9-b2f0-57254893c273 None admin] PATH_INFO: `/v3/users/b9cc3b0699994ea4930533f413f67d16` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:34.471426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e160988-3a62-42f9-b2f0-57254893c273 None admin] RBAC: Authorizing `identity:get_user(user_id=b9cc3b0699994ea4930533f413f67d16)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:34.472867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e160988-3a62-42f9-b2f0-57254893c273 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:34.474447 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 570/1151] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:10:34 2022] GET /identity/v3/users/b9cc3b0699994ea4930533f413f67d16 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:34.480374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eb352-0f32-4d2e-ab10-ebe91722dc3c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:34.577546 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027eb352-0f32-4d2e-ab10-ebe91722dc3c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:34.603258 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:34.611892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabfaa38-3bb6-4cbe-8e37-28c274b2720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:34.612513 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfaa38-3bb6-4cbe-8e37-28c274b2720d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:34.612792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfaa38-3bb6-4cbe-8e37-28c274b2720d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:34.613062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabfaa38-3bb6-4cbe-8e37-28c274b2720d None admin] PATH_INFO: `/v3/projects/f7c840d7e9e54e75b961f3ed664e6eac` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:34.614193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfaa38-3bb6-4cbe-8e37-28c274b2720d None admin] RBAC: Authorizing `identity:get_project(project_id=f7c840d7e9e54e75b961f3ed664e6eac)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:34.615642 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabfaa38-3bb6-4cbe-8e37-28c274b2720d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:34.617285 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 582/1152] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:10:34 2022] GET /identity/v3/projects/f7c840d7e9e54e75b961f3ed664e6eac => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:34.623309 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e160988-3a62-42f9-b2f0-57254893c273 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:34.720893 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e160988-3a62-42f9-b2f0-57254893c273 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:34.754797 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07143d0-9853-4da5-836f-3a2582811e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:34.755454 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07143d0-9853-4da5-836f-3a2582811e30 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:34.755732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07143d0-9853-4da5-836f-3a2582811e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:34.756002 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07143d0-9853-4da5-836f-3a2582811e30 None admin] PATH_INFO: `/v3/projects/f7c840d7e9e54e75b961f3ed664e6eac/users/b9cc3b0699994ea4930533f413f67d16/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:34.757905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07143d0-9853-4da5-836f-3a2582811e30 None admin] RBAC: Authorizing `identity:create_grant(project_id=f7c840d7e9e54e75b961f3ed664e6eac, user_id=b9cc3b0699994ea4930533f413f67d16, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:34.759376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07143d0-9853-4da5-836f-3a2582811e30 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:34.772682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 571/1153] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:10:34 2022] PUT /identity/v3/projects/f7c840d7e9e54e75b961f3ed664e6eac/users/b9cc3b0699994ea4930533f413f67d16/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:10:36.727242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069112e-eb48-454c-918e-b54b5a4c4702 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:36.727790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069112e-eb48-454c-918e-b54b5a4c4702 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:36.727790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8069112e-eb48-454c-918e-b54b5a4c4702 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:36.729128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 583/1154] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:36.734347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69461166-4486-4bcd-8e5d-d841f11f732a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:36.734876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69461166-4486-4bcd-8e5d-d841f11f732a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:36.734971 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69461166-4486-4bcd-8e5d-d841f11f732a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:36.754268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-69461166-4486-4bcd-8e5d-d841f11f732a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:36.755494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-69461166-4486-4bcd-8e5d-d841f11f732a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:36.781041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:36.821367 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 572/1155] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:36.844421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069112e-eb48-454c-918e-b54b5a4c4702 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:36.944214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8069112e-eb48-454c-918e-b54b5a4c4702 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:36.976981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdae206-736b-4b73-9187-03b5e2d78880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:36.977672 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdae206-736b-4b73-9187-03b5e2d78880 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:36.977888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdae206-736b-4b73-9187-03b5e2d78880 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:36.978159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdae206-736b-4b73-9187-03b5e2d78880 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:36.989205 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdae206-736b-4b73-9187-03b5e2d78880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-bcdae206-736b-4b73-9187-03b5e2d78880 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:10:36.994084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:36.995087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:36.995944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:36.995944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:36.995944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:36.995944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:36.995944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:10:36.995944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:10:36.995944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:10:36.995944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:10:36.995944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:10:36.995944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:10:36.995944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:36.995944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:10:36.995944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 584/1156] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:10:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:37.001261 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69461166-4486-4bcd-8e5d-d841f11f732a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:37.098361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69461166-4486-4bcd-8e5d-d841f11f732a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:37.131882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c62d41-ec33-4e78-af0e-559dba7dc187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:37.132485 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c62d41-ec33-4e78-af0e-559dba7dc187 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:37.132769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c62d41-ec33-4e78-af0e-559dba7dc187 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:37.133039 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c62d41-ec33-4e78-af0e-559dba7dc187 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:37.133751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c62d41-ec33-4e78-af0e-559dba7dc187 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:37.134056 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c62d41-ec33-4e78-af0e-559dba7dc187 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:37.135477 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c62d41-ec33-4e78-af0e-559dba7dc187 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:37.143413 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 573/1157] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:10:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:37.149144 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdae206-736b-4b73-9187-03b5e2d78880 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:37.204190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:37.247366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdae206-736b-4b73-9187-03b5e2d78880 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:37.279670 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b343ba-fdc1-4980-95a6-16f25b7be619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:37.280295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b343ba-fdc1-4980-95a6-16f25b7be619 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:37.280574 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b343ba-fdc1-4980-95a6-16f25b7be619 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:37.280846 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b343ba-fdc1-4980-95a6-16f25b7be619 None admin] PATH_INFO: `/v3/users/b9cc3b0699994ea4930533f413f67d16` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:37.282038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b343ba-fdc1-4980-95a6-16f25b7be619 None admin] RBAC: Authorizing `identity:get_user(user_id=b9cc3b0699994ea4930533f413f67d16)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:37.283982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b343ba-fdc1-4980-95a6-16f25b7be619 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:37.285563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 585/1158] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:10:37 2022] GET /identity/v3/users/b9cc3b0699994ea4930533f413f67d16 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:37.291272 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c62d41-ec33-4e78-af0e-559dba7dc187 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:37.317970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:37.393791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c62d41-ec33-4e78-af0e-559dba7dc187 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:37.426290 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1166e6-1b23-46b0-bd50-0705c3e34bad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:37.426929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1166e6-1b23-46b0-bd50-0705c3e34bad None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:37.427210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1166e6-1b23-46b0-bd50-0705c3e34bad None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:37.427483 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1166e6-1b23-46b0-bd50-0705c3e34bad None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:37.491772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1166e6-1b23-46b0-bd50-0705c3e34bad None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:37.493218 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1166e6-1b23-46b0-bd50-0705c3e34bad None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:37.518375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:37.589495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 574/1159] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:10:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:10:37.595949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b343ba-fdc1-4980-95a6-16f25b7be619 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:37.693745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b343ba-fdc1-4980-95a6-16f25b7be619 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:37.716565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:37.727115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefbd0c9-403d-46e1-8bba-813fe6f647b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:37.727746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbd0c9-403d-46e1-8bba-813fe6f647b5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:37.728275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbd0c9-403d-46e1-8bba-813fe6f647b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:37.728275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefbd0c9-403d-46e1-8bba-813fe6f647b5 None admin] PATH_INFO: `/v3/projects/f7c840d7e9e54e75b961f3ed664e6eac` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:37.729422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbd0c9-403d-46e1-8bba-813fe6f647b5 None admin] RBAC: Authorizing `identity:get_project(project_id=f7c840d7e9e54e75b961f3ed664e6eac)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:37.730870 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefbd0c9-403d-46e1-8bba-813fe6f647b5 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:37.732533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 586/1160] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:10:37 2022] GET /identity/v3/projects/f7c840d7e9e54e75b961f3ed664e6eac => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:37.738878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1166e6-1b23-46b0-bd50-0705c3e34bad None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:37.836796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1166e6-1b23-46b0-bd50-0705c3e34bad None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:37.861503 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:37.870438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765bb332-f45f-49d0-87e4-436ce1bb07c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:37.871079 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bb332-f45f-49d0-87e4-436ce1bb07c9 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:37.871360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bb332-f45f-49d0-87e4-436ce1bb07c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:37.871634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765bb332-f45f-49d0-87e4-436ce1bb07c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:37.872414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bb332-f45f-49d0-87e4-436ce1bb07c9 None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=f7c840d7e9e54e75b961f3ed664e6eac, user.id=b9cc3b0699994ea4930533f413f67d16) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:37.872724 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bb332-f45f-49d0-87e4-436ce1bb07c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:37.874163 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765bb332-f45f-49d0-87e4-436ce1bb07c9 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:37.880362 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 575/1161] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:10:37 2022] GET /identity/v3/role_assignments?user.id=b9cc3b0699994ea4930533f413f67d16&scope.project.id=f7c840d7e9e54e75b961f3ed664e6eac&role.id=0681632796d144f6a7ac8eca157001ec => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:39.923388 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380884c-b19b-43c4-bb9c-986934c04a76 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:39.923911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380884c-b19b-43c4-bb9c-986934c04a76 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:39.924032 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380884c-b19b-43c4-bb9c-986934c04a76 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:39.925279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 587/1162] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:39.930421 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b684eb-bc4a-4d0f-9791-55b8ea2dd8a6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:39.930813 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b684eb-bc4a-4d0f-9791-55b8ea2dd8a6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:39.931001 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b684eb-bc4a-4d0f-9791-55b8ea2dd8a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:39.948678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d5b684eb-bc4a-4d0f-9791-55b8ea2dd8a6 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:39.949853 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d5b684eb-bc4a-4d0f-9791-55b8ea2dd8a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:40.016613 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 576/1163] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:40.038724 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380884c-b19b-43c4-bb9c-986934c04a76 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:40.138215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380884c-b19b-43c4-bb9c-986934c04a76 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:40.175733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ddffd-e299-4519-93c9-a3a4ff280e9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:40.176275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ddffd-e299-4519-93c9-a3a4ff280e9d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:40.176553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ddffd-e299-4519-93c9-a3a4ff280e9d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:40.176820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0ddffd-e299-4519-93c9-a3a4ff280e9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:40.232910 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:40.243071 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ddffd-e299-4519-93c9-a3a4ff280e9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:40.244514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0ddffd-e299-4519-93c9-a3a4ff280e9d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:40.338905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 588/1164] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:10:40 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:10:40.345514 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b684eb-bc4a-4d0f-9791-55b8ea2dd8a6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:40.447516 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b684eb-bc4a-4d0f-9791-55b8ea2dd8a6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:40.467062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:40.480847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fbc870a-f654-4c06-b72f-b3d642fee4db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:40.481485 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc870a-f654-4c06-b72f-b3d642fee4db None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:40.481767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc870a-f654-4c06-b72f-b3d642fee4db None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:40.482041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fbc870a-f654-4c06-b72f-b3d642fee4db None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:40.489142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc870a-f654-4c06-b72f-b3d642fee4db None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:40.494221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fbc870a-f654-4c06-b72f-b3d642fee4db None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-0fbc870a-f654-4c06-b72f-b3d642fee4db None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:40.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:40.507373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:40.508493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:40.508493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:40.508493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:40.508493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:40.508493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:40.508493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:40.508493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:40.508493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:40.508493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:40.508493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:40.508493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 01 14:10:40.508493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:10:40.508493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 01 14:10:40.508493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:40.508493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 577/1165] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 1 14:10:40 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:40.513404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ddffd-e299-4519-93c9-a3a4ff280e9d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:40.601316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:40.610701 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0ddffd-e299-4519-93c9-a3a4ff280e9d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:40.643121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7891e624-c266-4fdc-a093-a28ac6089e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:40.643729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891e624-c266-4fdc-a093-a28ac6089e2d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:40.644008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891e624-c266-4fdc-a093-a28ac6089e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:40.644279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7891e624-c266-4fdc-a093-a28ac6089e2d None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:40.644956 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891e624-c266-4fdc-a093-a28ac6089e2d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:40.645257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891e624-c266-4fdc-a093-a28ac6089e2d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:40.646635 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7891e624-c266-4fdc-a093-a28ac6089e2d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:40.653525 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 589/1166] 10.222.0.70 () {56 vars in 1115 bytes} [Mon Aug 1 14:10:40 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:42.651009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69453c-0b97-457b-aef2-fedc1e9a4f7b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:42.651595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69453c-0b97-457b-aef2-fedc1e9a4f7b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:42.651595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69453c-0b97-457b-aef2-fedc1e9a4f7b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:42.652870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 578/1167] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:42.658835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59ffa8-717c-413c-9c62-82d80ca64463 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:42.659243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59ffa8-717c-413c-9c62-82d80ca64463 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:42.659426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c59ffa8-717c-413c-9c62-82d80ca64463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:42.677006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8c59ffa8-717c-413c-9c62-82d80ca64463 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:42.678175 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8c59ffa8-717c-413c-9c62-82d80ca64463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:42.743446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 590/1168] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:42.767113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69453c-0b97-457b-aef2-fedc1e9a4f7b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:42.866474 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69453c-0b97-457b-aef2-fedc1e9a4f7b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:42.899891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04e0b94-3eec-4258-ba43-241a6d4ef7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:42.900498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e0b94-3eec-4258-ba43-241a6d4ef7a8 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:42.900779 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e0b94-3eec-4258-ba43-241a6d4ef7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:42.901103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04e0b94-3eec-4258-ba43-241a6d4ef7a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:42.901744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e0b94-3eec-4258-ba43-241a6d4ef7a8 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:42.903156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04e0b94-3eec-4258-ba43-241a6d4ef7a8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:42.918281 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 579/1169] 10.222.0.70 () {60 vars in 1138 bytes} [Mon Aug 1 14:10:42 2022] POST /identity/v3/domains => generated 267 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:10:44.942926 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90496019-7512-4cb8-978a-3869df7e2fa2 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:44.943450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90496019-7512-4cb8-978a-3869df7e2fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:44.943450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90496019-7512-4cb8-978a-3869df7e2fa2 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:44.944805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 591/1170] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:44.949840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3863fb-4c70-46b2-95a5-77044b172756 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:44.950259 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3863fb-4c70-46b2-95a5-77044b172756 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:44.950375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3863fb-4c70-46b2-95a5-77044b172756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:44.968346 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-db3863fb-4c70-46b2-95a5-77044b172756 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:44.969521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-db3863fb-4c70-46b2-95a5-77044b172756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:45.004292 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:45.037218 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 580/1171] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:45.060538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90496019-7512-4cb8-978a-3869df7e2fa2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:45.144113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:45.160668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90496019-7512-4cb8-978a-3869df7e2fa2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:45.193752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433e4e62-5d1f-4be1-bdfa-7d6628c97467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:45.194317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e4e62-5d1f-4be1-bdfa-7d6628c97467 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:45.194619 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e4e62-5d1f-4be1-bdfa-7d6628c97467 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:45.194898 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433e4e62-5d1f-4be1-bdfa-7d6628c97467 None admin] PATH_INFO: `/v3/domains/2f918b6b59b648e78e944ff81d0c5dba` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:45.205012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e4e62-5d1f-4be1-bdfa-7d6628c97467 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2f918b6b59b648e78e944ff81d0c5dba)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:45.206448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433e4e62-5d1f-4be1-bdfa-7d6628c97467 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:45.208083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 592/1172] 10.222.0.70 () {56 vars in 1183 bytes} [Mon Aug 1 14:10:45 2022] GET /identity/v3/domains/2f918b6b59b648e78e944ff81d0c5dba => generated 267 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:45.214115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3863fb-4c70-46b2-95a5-77044b172756 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:45.310359 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3863fb-4c70-46b2-95a5-77044b172756 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:45.342424 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f76ae1-d33e-47c1-a845-f65b4138f7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:45.343047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f76ae1-d33e-47c1-a845-f65b4138f7d6 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:45.343323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f76ae1-d33e-47c1-a845-f65b4138f7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:45.343591 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f76ae1-d33e-47c1-a845-f65b4138f7d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:45.344783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f76ae1-d33e-47c1-a845-f65b4138f7d6 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:45.346215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f76ae1-d33e-47c1-a845-f65b4138f7d6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:45.372542 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 581/1173] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 1 14:10:45 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:10:47.379422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a941b7-0f46-4a0e-bc8d-cfef72eb8737 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:47.379944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a941b7-0f46-4a0e-bc8d-cfef72eb8737 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:47.380035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a941b7-0f46-4a0e-bc8d-cfef72eb8737 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:47.381323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 593/1174] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:47.386593 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2227540-db95-4bbb-bff2-a822821f1cf2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:47.386995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2227540-db95-4bbb-bff2-a822821f1cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:47.387167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2227540-db95-4bbb-bff2-a822821f1cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:47.405416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c2227540-db95-4bbb-bff2-a822821f1cf2 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:47.406666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c2227540-db95-4bbb-bff2-a822821f1cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:47.422723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:47.472911 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 582/1175] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:47.496440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a941b7-0f46-4a0e-bc8d-cfef72eb8737 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:47.597130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a941b7-0f46-4a0e-bc8d-cfef72eb8737 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:47.629323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e402b44a-14f1-4a6a-a57b-15ad247402c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:47.629997 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402b44a-14f1-4a6a-a57b-15ad247402c0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:47.630221 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402b44a-14f1-4a6a-a57b-15ad247402c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:47.630492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e402b44a-14f1-4a6a-a57b-15ad247402c0 None admin] PATH_INFO: `/v3/domains/2f918b6b59b648e78e944ff81d0c5dba` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:47.631656 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402b44a-14f1-4a6a-a57b-15ad247402c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2f918b6b59b648e78e944ff81d0c5dba)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:47.633070 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e402b44a-14f1-4a6a-a57b-15ad247402c0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:47.634661 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 594/1176] 10.222.0.70 () {56 vars in 1183 bytes} [Mon Aug 1 14:10:47 2022] GET /identity/v3/domains/2f918b6b59b648e78e944ff81d0c5dba => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:47.640301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2227540-db95-4bbb-bff2-a822821f1cf2 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:47.738200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2227540-db95-4bbb-bff2-a822821f1cf2 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:47.770964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2c5f2e-f8af-43d3-a7cc-07c3eb8b1210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:47.771570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c5f2e-f8af-43d3-a7cc-07c3eb8b1210 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:47.771848 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c5f2e-f8af-43d3-a7cc-07c3eb8b1210 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:47.772117 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2c5f2e-f8af-43d3-a7cc-07c3eb8b1210 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:47.772790 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c5f2e-f8af-43d3-a7cc-07c3eb8b1210 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:47.774221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2c5f2e-f8af-43d3-a7cc-07c3eb8b1210 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:47.794909 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 583/1177] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:10:47 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:10:49.822261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f43dde-730f-441e-a7b0-34938a1dba00 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:49.822930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f43dde-730f-441e-a7b0-34938a1dba00 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:49.822930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f43dde-730f-441e-a7b0-34938a1dba00 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:49.824179 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 595/1178] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:49.833717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3c97e-1c41-4639-8855-47c7795d4ac4 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:49.835579 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3c97e-1c41-4639-8855-47c7795d4ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:49.835579 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c3c97e-1c41-4639-8855-47c7795d4ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:49.853607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a0c3c97e-1c41-4639-8855-47c7795d4ac4 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:49.854844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a0c3c97e-1c41-4639-8855-47c7795d4ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:49.856874 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:49.928270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 584/1179] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:49.951641 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f43dde-730f-441e-a7b0-34938a1dba00 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:49.968546 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:50.053776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f43dde-730f-441e-a7b0-34938a1dba00 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:50.086437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355ca56-86f8-4286-9d82-5e41b2e14bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:50.087033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355ca56-86f8-4286-9d82-5e41b2e14bc5 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:50.087309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355ca56-86f8-4286-9d82-5e41b2e14bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:50.087574 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355ca56-86f8-4286-9d82-5e41b2e14bc5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:50.097905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355ca56-86f8-4286-9d82-5e41b2e14bc5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-c355ca56-86f8-4286-9d82-5e41b2e14bc5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:10:50.102699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:50.103861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:50.104983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:50.104983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:50.104983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:50.104983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:50.104983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:10:50.104983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:10:50.104983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:10:50.104983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:10:50.104983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:10:50.104983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:10:50.104983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:50.104983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:10:50.104983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 596/1180] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:10:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:50.110509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3c97e-1c41-4639-8855-47c7795d4ac4 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:50.205414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c3c97e-1c41-4639-8855-47c7795d4ac4 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:50.238243 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8f479-362f-482e-b755-9e9a66c3898f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:50.238878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f479-362f-482e-b755-9e9a66c3898f None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:50.239159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f479-362f-482e-b755-9e9a66c3898f None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:50.239433 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d8f479-362f-482e-b755-9e9a66c3898f None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:50.240142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f479-362f-482e-b755-9e9a66c3898f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:50.240443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f479-362f-482e-b755-9e9a66c3898f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:50.241813 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d8f479-362f-482e-b755-9e9a66c3898f None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:50.246654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:50.251606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 585/1181] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:10:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:50.256395 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355ca56-86f8-4286-9d82-5e41b2e14bc5 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:50.330559 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:50.355423 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355ca56-86f8-4286-9d82-5e41b2e14bc5 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:50.387400 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2d651-91a6-410a-8869-a36955584b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:50.388090 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2d651-91a6-410a-8869-a36955584b05 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:50.388367 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2d651-91a6-410a-8869-a36955584b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:50.388638 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2d651-91a6-410a-8869-a36955584b05 None admin] PATH_INFO: `/v3/users/1f203c9b6ff84e23821f42381070ff95` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:50.401209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2d651-91a6-410a-8869-a36955584b05 None admin] RBAC: Authorizing `identity:get_user(user_id=1f203c9b6ff84e23821f42381070ff95)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:50.402658 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e2d651-91a6-410a-8869-a36955584b05 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:50.404328 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 597/1182] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:10:50 2022] GET /identity/v3/users/1f203c9b6ff84e23821f42381070ff95 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:50.410797 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8f479-362f-482e-b755-9e9a66c3898f None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:50.507535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d8f479-362f-482e-b755-9e9a66c3898f None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:50.540046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce08e2-ee56-4bb6-ac1b-27e15cf6a54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:50.540643 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce08e2-ee56-4bb6-ac1b-27e15cf6a54d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:50.540923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce08e2-ee56-4bb6-ac1b-27e15cf6a54d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:50.541195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce08e2-ee56-4bb6-ac1b-27e15cf6a54d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:50.604259 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:50.606563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce08e2-ee56-4bb6-ac1b-27e15cf6a54d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:50.608358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce08e2-ee56-4bb6-ac1b-27e15cf6a54d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:50.705002 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 586/1183] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:10:50 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:10:50.711213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2d651-91a6-410a-8869-a36955584b05 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:50.808774 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2d651-91a6-410a-8869-a36955584b05 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:50.837961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:50.843304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b784e-91e8-4934-8d44-8ceb01c03e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:50.843933 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b784e-91e8-4934-8d44-8ceb01c03e59 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:50.844215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b784e-91e8-4934-8d44-8ceb01c03e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:50.844491 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b784e-91e8-4934-8d44-8ceb01c03e59 None admin] PATH_INFO: `/v3/projects/9c232f13eb8d422a9c1428aec500897c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:50.845644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b784e-91e8-4934-8d44-8ceb01c03e59 None admin] RBAC: Authorizing `identity:get_project(project_id=9c232f13eb8d422a9c1428aec500897c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:50.847110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b784e-91e8-4934-8d44-8ceb01c03e59 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:50.848763 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 598/1184] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:10:50 2022] GET /identity/v3/projects/9c232f13eb8d422a9c1428aec500897c => generated 361 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:50.854868 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce08e2-ee56-4bb6-ac1b-27e15cf6a54d None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:50.954131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:50.956960 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce08e2-ee56-4bb6-ac1b-27e15cf6a54d None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:50.991904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5aee8b-ddaf-4bbd-8848-5f5f2cc5000d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:50.992512 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5aee8b-ddaf-4bbd-8848-5f5f2cc5000d None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:50.992795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5aee8b-ddaf-4bbd-8848-5f5f2cc5000d None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:50.993065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5aee8b-ddaf-4bbd-8848-5f5f2cc5000d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:50.993842 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5aee8b-ddaf-4bbd-8848-5f5f2cc5000d None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=9c232f13eb8d422a9c1428aec500897c, user.id=1f203c9b6ff84e23821f42381070ff95) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:50.994149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5aee8b-ddaf-4bbd-8848-5f5f2cc5000d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:50.995637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5aee8b-ddaf-4bbd-8848-5f5f2cc5000d None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:51.001600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 587/1185] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:10:50 2022] GET /identity/v3/role_assignments?user.id=1f203c9b6ff84e23821f42381070ff95&scope.project.id=9c232f13eb8d422a9c1428aec500897c&role.id=0681632796d144f6a7ac8eca157001ec => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:52.975539 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d35990-b243-4778-bfd8-52b075eccbff None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:52.976110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d35990-b243-4778-bfd8-52b075eccbff None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:52.976110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d35990-b243-4778-bfd8-52b075eccbff None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:52.977473 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 599/1186] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:52.982834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b448d-eae6-4fad-ba23-522f215762e7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:52.983256 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b448d-eae6-4fad-ba23-522f215762e7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:52.983384 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1b448d-eae6-4fad-ba23-522f215762e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:53.001760 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4f1b448d-eae6-4fad-ba23-522f215762e7 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:53.002971 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4f1b448d-eae6-4fad-ba23-522f215762e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:53.069119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 588/1187] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:10:53.091523 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d35990-b243-4778-bfd8-52b075eccbff None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:53.189572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d35990-b243-4778-bfd8-52b075eccbff None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:53.224187 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8318a-7d99-45e8-8ea5-3d4b0272b0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:53.224807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8318a-7d99-45e8-8ea5-3d4b0272b0e4 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:53.225083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8318a-7d99-45e8-8ea5-3d4b0272b0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:53.225349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec8318a-7d99-45e8-8ea5-3d4b0272b0e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:53.235217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec8318a-7d99-45e8-8ea5-3d4b0272b0e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-bec8318a-7d99-45e8-8ea5-3d4b0272b0e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:10:53.239940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:53.241042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:53.242082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:53.242082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:53.242082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:53.242082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:53.242082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:10:53.242082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:10:53.242082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:10:53.242082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:10:53.242082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:10:53.242082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:10:53.242082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:53.242082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:10:53.242082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 600/1188] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:10:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:53.247101 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b448d-eae6-4fad-ba23-522f215762e7 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:53.336232 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:53.342801 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1b448d-eae6-4fad-ba23-522f215762e7 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:53.375919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e056b6b-07a5-42d1-84ef-bb5f3b9230bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:53.376521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e056b6b-07a5-42d1-84ef-bb5f3b9230bc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:53.376797 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e056b6b-07a5-42d1-84ef-bb5f3b9230bc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:53.377064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e056b6b-07a5-42d1-84ef-bb5f3b9230bc None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:53.377757 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e056b6b-07a5-42d1-84ef-bb5f3b9230bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:53.378051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e056b6b-07a5-42d1-84ef-bb5f3b9230bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:53.379454 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e056b6b-07a5-42d1-84ef-bb5f3b9230bc None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:53.387167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 589/1189] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:10:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:53.393690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8318a-7d99-45e8-8ea5-3d4b0272b0e4 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:53.452421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:53.492694 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec8318a-7d99-45e8-8ea5-3d4b0272b0e4 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:53.525858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e152662-90a0-46ab-a9f4-40ef4b182cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:53.526485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e152662-90a0-46ab-a9f4-40ef4b182cce None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:53.526796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e152662-90a0-46ab-a9f4-40ef4b182cce None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:53.527072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e152662-90a0-46ab-a9f4-40ef4b182cce None admin] PATH_INFO: `/v3/users/1f203c9b6ff84e23821f42381070ff95` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:53.528230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e152662-90a0-46ab-a9f4-40ef4b182cce None admin] RBAC: Authorizing `identity:get_user(user_id=1f203c9b6ff84e23821f42381070ff95)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:53.529650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e152662-90a0-46ab-a9f4-40ef4b182cce None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:53.531298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 601/1190] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:10:53 2022] GET /identity/v3/users/1f203c9b6ff84e23821f42381070ff95 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:53.537179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e056b6b-07a5-42d1-84ef-bb5f3b9230bc None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:53.634781 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e056b6b-07a5-42d1-84ef-bb5f3b9230bc None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:53.667531 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19ff6f6-80a3-422b-b445-07e64d78fe2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:53.668160 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ff6f6-80a3-422b-b445-07e64d78fe2c None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:53.668443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ff6f6-80a3-422b-b445-07e64d78fe2c None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:53.668719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19ff6f6-80a3-422b-b445-07e64d78fe2c None admin] PATH_INFO: `/v3/projects/9c232f13eb8d422a9c1428aec500897c` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:53.669862 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ff6f6-80a3-422b-b445-07e64d78fe2c None admin] RBAC: Authorizing `identity:get_project(project_id=9c232f13eb8d422a9c1428aec500897c)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:53.671337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19ff6f6-80a3-422b-b445-07e64d78fe2c None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:53.672968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 590/1191] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:10:53 2022] GET /identity/v3/projects/9c232f13eb8d422a9c1428aec500897c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:53.678903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e152662-90a0-46ab-a9f4-40ef4b182cce None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:53.777411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e152662-90a0-46ab-a9f4-40ef4b182cce None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:53.803142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:53.811026 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fdcf896-8901-4d55-855f-0848d48ed725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:53.811686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcf896-8901-4d55-855f-0848d48ed725 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:53.811964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcf896-8901-4d55-855f-0848d48ed725 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:53.812234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fdcf896-8901-4d55-855f-0848d48ed725 None admin] PATH_INFO: `/v3/projects/9c232f13eb8d422a9c1428aec500897c/users/1f203c9b6ff84e23821f42381070ff95/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:53.814826 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdcf896-8901-4d55-855f-0848d48ed725 None admin] RBAC: Authorizing `identity:create_grant(project_id=9c232f13eb8d422a9c1428aec500897c, user_id=1f203c9b6ff84e23821f42381070ff95, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:53.816244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fdcf896-8901-4d55-855f-0848d48ed725 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:53.828405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 602/1192] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:10:53 2022] PUT /identity/v3/projects/9c232f13eb8d422a9c1428aec500897c/users/1f203c9b6ff84e23821f42381070ff95/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:10:55.817555 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e40e7-7408-4b33-8902-756d32941f53 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:55.818092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e40e7-7408-4b33-8902-756d32941f53 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:55.818092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e40e7-7408-4b33-8902-756d32941f53 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:55.819625 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 591/1193] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:10:55.824693 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136fb66-3e96-49e2-b229-66021d105503 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:55.825133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136fb66-3e96-49e2-b229-66021d105503 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:55.825241 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a136fb66-3e96-49e2-b229-66021d105503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:55.843875 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a136fb66-3e96-49e2-b229-66021d105503 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:10:55.845064 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a136fb66-3e96-49e2-b229-66021d105503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:10:55.912485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 603/1194] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:10:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:10:55.935638 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e40e7-7408-4b33-8902-756d32941f53 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:55.961952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:56.039717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e40e7-7408-4b33-8902-756d32941f53 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:56.072768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd24fb9-e28d-4174-9627-cc0f07a51f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:56.073337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd24fb9-e28d-4174-9627-cc0f07a51f5b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:56.073618 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd24fb9-e28d-4174-9627-cc0f07a51f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:56.073992 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd24fb9-e28d-4174-9627-cc0f07a51f5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:56.084920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd24fb9-e28d-4174-9627-cc0f07a51f5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-ecd24fb9-e28d-4174-9627-cc0f07a51f5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:10:56.090098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:10:56.091166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:10:56.092217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:10:56.092217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:10:56.092217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:10:56.092217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:10:56.092217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:10:56.092217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:10:56.092217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:10:56.092217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:10:56.092217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:10:56.092217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:10:56.092217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:10:56.092217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:10:56.092217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 592/1195] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:10:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:10:56.097958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136fb66-3e96-49e2-b229-66021d105503 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:56.201428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a136fb66-3e96-49e2-b229-66021d105503 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:56.219466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:56.241241 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff8db0-b623-49bf-85f8-a26929a62e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:56.242298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff8db0-b623-49bf-85f8-a26929a62e42 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:56.242763 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff8db0-b623-49bf-85f8-a26929a62e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:56.243045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ff8db0-b623-49bf-85f8-a26929a62e42 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:56.243760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff8db0-b623-49bf-85f8-a26929a62e42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:56.244067 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff8db0-b623-49bf-85f8-a26929a62e42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:56.245438 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ff8db0-b623-49bf-85f8-a26929a62e42 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:56.254705 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 604/1196] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:10:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:56.260812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd24fb9-e28d-4174-9627-cc0f07a51f5b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:56.348654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:56.365720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd24fb9-e28d-4174-9627-cc0f07a51f5b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:56.399065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd400b-0616-46b9-b4de-75e4f95de7a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:56.399694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd400b-0616-46b9-b4de-75e4f95de7a7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:56.399973 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd400b-0616-46b9-b4de-75e4f95de7a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:56.400258 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fd400b-0616-46b9-b4de-75e4f95de7a7 None admin] PATH_INFO: `/v3/users/1f203c9b6ff84e23821f42381070ff95` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:56.401398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd400b-0616-46b9-b4de-75e4f95de7a7 None admin] RBAC: Authorizing `identity:get_user(user_id=1f203c9b6ff84e23821f42381070ff95)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:56.402868 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fd400b-0616-46b9-b4de-75e4f95de7a7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:56.404570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 593/1197] 10.222.0.70 () {56 vars in 1177 bytes} [Mon Aug 1 14:10:56 2022] GET /identity/v3/users/1f203c9b6ff84e23821f42381070ff95 => generated 311 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:56.410441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff8db0-b623-49bf-85f8-a26929a62e42 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:56.507614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ff8db0-b623-49bf-85f8-a26929a62e42 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:56.540143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d89de-a9e7-41df-bb68-5467b0400e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:56.540745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d89de-a9e7-41df-bb68-5467b0400e8a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:56.541020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d89de-a9e7-41df-bb68-5467b0400e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:56.541288 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5d89de-a9e7-41df-bb68-5467b0400e8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:56.589068 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:56.608652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d89de-a9e7-41df-bb68-5467b0400e8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:56.610071 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5d89de-a9e7-41df-bb68-5467b0400e8a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:56.710799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 605/1198] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:10:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:10:56.716848 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd400b-0616-46b9-b4de-75e4f95de7a7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:56.817170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fd400b-0616-46b9-b4de-75e4f95de7a7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:56.849539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98f1627-258d-4c38-b446-47045157dea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:56.850170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f1627-258d-4c38-b446-47045157dea1 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:56.850448 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f1627-258d-4c38-b446-47045157dea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:56.850747 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98f1627-258d-4c38-b446-47045157dea1 None admin] PATH_INFO: `/v3/projects/9c232f13eb8d422a9c1428aec500897c` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:56.851885 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f1627-258d-4c38-b446-47045157dea1 None admin] RBAC: Authorizing `identity:get_project(project_id=9c232f13eb8d422a9c1428aec500897c)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:56.853320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98f1627-258d-4c38-b446-47045157dea1 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:56.854977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 594/1199] 10.222.0.70 () {56 vars in 1186 bytes} [Mon Aug 1 14:10:56 2022] GET /identity/v3/projects/9c232f13eb8d422a9c1428aec500897c => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:10:56.861825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d89de-a9e7-41df-bb68-5467b0400e8a None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:10:56.939034 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:10:56.957388 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5d89de-a9e7-41df-bb68-5467b0400e8a None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:10:57.001847 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffce77b-89fa-48d4-8b93-3b6c4185a092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:10:57.002464 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffce77b-89fa-48d4-8b93-3b6c4185a092 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:10:57.002759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffce77b-89fa-48d4-8b93-3b6c4185a092 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:10:57.003024 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffce77b-89fa-48d4-8b93-3b6c4185a092 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:10:57.003800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffce77b-89fa-48d4-8b93-3b6c4185a092 None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=9c232f13eb8d422a9c1428aec500897c, user.id=1f203c9b6ff84e23821f42381070ff95) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:10:57.004357 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffce77b-89fa-48d4-8b93-3b6c4185a092 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:10:57.005771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffce77b-89fa-48d4-8b93-3b6c4185a092 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:10:57.011772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 606/1200] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:10:56 2022] GET /identity/v3/role_assignments?user.id=1f203c9b6ff84e23821f42381070ff95&scope.project.id=9c232f13eb8d422a9c1428aec500897c&role.id=0681632796d144f6a7ac8eca157001ec => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:11:06.845449 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:07.009074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=28 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:52.303372 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f41aa-0a9e-45fc-993a-5148b89409e8 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:52.303983 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f41aa-0a9e-45fc-993a-5148b89409e8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:52.303983 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f41aa-0a9e-45fc-993a-5148b89409e8 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:52.305398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 595/1201] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:11:52.311636 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef976c-15a5-42d9-b05f-3b22209552ab None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:52.312125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef976c-15a5-42d9-b05f-3b22209552ab None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:52.312213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ef976c-15a5-42d9-b05f-3b22209552ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:52.334388 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-25ef976c-15a5-42d9-b05f-3b22209552ab None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:11:52.335905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-25ef976c-15a5-42d9-b05f-3b22209552ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:52.422228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 607/1202] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:11:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 01 14:11:52.446288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f41aa-0a9e-45fc-993a-5148b89409e8 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:52.581515 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f41aa-0a9e-45fc-993a-5148b89409e8 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:52.626458 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d395891-f0da-4c7c-b071-4576166eb8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:52.627147 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395891-f0da-4c7c-b071-4576166eb8b8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:52.627797 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395891-f0da-4c7c-b071-4576166eb8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:52.628105 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d395891-f0da-4c7c-b071-4576166eb8b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:52.643406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d395891-f0da-4c7c-b071-4576166eb8b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:52.645061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d395891-f0da-4c7c-b071-4576166eb8b8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:52.664148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-7d395891-f0da-4c7c-b071-4576166eb8b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:11:52.664148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:11:52.664148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:11:52.664148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:11:52.664148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:11:52.664148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:11:52.664148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:11:52.664148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:11:52.664148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:11:52.664148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:11:52.664148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:11:52.664148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:11:52.664148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:11:52.664148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:11:52.664148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:11:52.665228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:11:52.666196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:11:52.666196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:11:52.666196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:11:52.666196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:11:52.674633 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 596/1203] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:11:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:11:52.674814 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef976c-15a5-42d9-b05f-3b22209552ab None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:52.813110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ef976c-15a5-42d9-b05f-3b22209552ab None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:52.858773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:52.870094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d7f1cf-841c-4818-84fd-9d55a194ce43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:52.870870 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7f1cf-841c-4818-84fd-9d55a194ce43 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:52.871229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7f1cf-841c-4818-84fd-9d55a194ce43 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:52.872072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d7f1cf-841c-4818-84fd-9d55a194ce43 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:52.872874 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7f1cf-841c-4818-84fd-9d55a194ce43 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:11:52.873477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7f1cf-841c-4818-84fd-9d55a194ce43 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:52.875014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d7f1cf-841c-4818-84fd-9d55a194ce43 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:52.889237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 608/1204] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:11:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:11:52.895691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d395891-f0da-4c7c-b071-4576166eb8b8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:52.973649 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:53.043006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d395891-f0da-4c7c-b071-4576166eb8b8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:53.088835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd332aa9-ab02-448e-97e5-df54a3eec114 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:53.089821 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd332aa9-ab02-448e-97e5-df54a3eec114 None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:53.090144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd332aa9-ab02-448e-97e5-df54a3eec114 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:53.090397 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd332aa9-ab02-448e-97e5-df54a3eec114 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:53.091179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd332aa9-ab02-448e-97e5-df54a3eec114 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:53.092740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd332aa9-ab02-448e-97e5-df54a3eec114 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:53.127144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 597/1205] 10.222.0.70 () {60 vars in 1132 bytes} [Mon Aug 1 14:11:52 2022] POST /identity/v3/users => generated 251 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:11:55.348639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc9fcf-208e-4b2a-b632-12c963ead9cb None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:55.348639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc9fcf-208e-4b2a-b632-12c963ead9cb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:55.350124 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abc9fcf-208e-4b2a-b632-12c963ead9cb None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:55.351315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 609/1206] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:11:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:11:55.357328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40d900-8648-4b5f-a3de-02114cbfe630 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:55.357886 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40d900-8648-4b5f-a3de-02114cbfe630 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:55.357996 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d40d900-8648-4b5f-a3de-02114cbfe630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:55.378421 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7d40d900-8648-4b5f-a3de-02114cbfe630 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:11:55.379707 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7d40d900-8648-4b5f-a3de-02114cbfe630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:11:55.461587 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 598/1207] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:11:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:11:55.488198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc9fcf-208e-4b2a-b632-12c963ead9cb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:55.616051 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abc9fcf-208e-4b2a-b632-12c963ead9cb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:55.658519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa77f7-d1d7-489e-93a6-7ff097e52230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:55.659185 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa77f7-d1d7-489e-93a6-7ff097e52230 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:55.659461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa77f7-d1d7-489e-93a6-7ff097e52230 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:55.659738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49aa77f7-d1d7-489e-93a6-7ff097e52230 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:55.673454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49aa77f7-d1d7-489e-93a6-7ff097e52230 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-49aa77f7-d1d7-489e-93a6-7ff097e52230 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:11:55.678908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:11:55.680097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:11:55.681279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:11:55.681279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:11:55.681279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:11:55.681279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:11:55.681279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:11:55.681279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:11:55.681279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:11:55.681279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:11:55.681279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:11:55.681279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:11:55.681279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:11:55.681279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:11:55.685713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 610/1208] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:11:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:11:55.687246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40d900-8648-4b5f-a3de-02114cbfe630 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:55.738530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:55.826607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d40d900-8648-4b5f-a3de-02114cbfe630 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:55.867414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274cb41-ed70-4b7f-9a08-d5ede65ed949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:55.867966 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274cb41-ed70-4b7f-9a08-d5ede65ed949 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:55.868248 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274cb41-ed70-4b7f-9a08-d5ede65ed949 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:55.868523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0274cb41-ed70-4b7f-9a08-d5ede65ed949 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:55.869240 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274cb41-ed70-4b7f-9a08-d5ede65ed949 None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:11:55.869629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274cb41-ed70-4b7f-9a08-d5ede65ed949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:55.871039 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0274cb41-ed70-4b7f-9a08-d5ede65ed949 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:55.880021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 599/1209] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:11:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:11:55.886219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa77f7-d1d7-489e-93a6-7ff097e52230 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:55.952883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:56.013412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49aa77f7-d1d7-489e-93a6-7ff097e52230 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:56.054271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a91a8a-7fd8-47ec-8b7c-c591c7a4f86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:56.055083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a91a8a-7fd8-47ec-8b7c-c591c7a4f86f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:56.055364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a91a8a-7fd8-47ec-8b7c-c591c7a4f86f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:56.055703 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a91a8a-7fd8-47ec-8b7c-c591c7a4f86f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:56.068224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a91a8a-7fd8-47ec-8b7c-c591c7a4f86f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:56.070035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a91a8a-7fd8-47ec-8b7c-c591c7a4f86f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:56.086801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-51a91a8a-7fd8-47ec-8b7c-c591c7a4f86f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:11:56.086801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:11:56.086801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:11:56.086801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:11:56.086801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:11:56.086801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:11:56.086801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:11:56.086801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:11:56.086801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:11:56.086801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:11:56.086801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:11:56.086801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:11:56.086801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:11:56.086801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:11:56.086801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:11:56.088360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:11:56.089461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:11:56.089461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:11:56.089461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:11:56.089461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:11:56.094977 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 611/1210] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:11:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:11:56.095115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274cb41-ed70-4b7f-9a08-d5ede65ed949 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:56.221538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:56.224556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0274cb41-ed70-4b7f-9a08-d5ede65ed949 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:56.267499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd4a4a-cb0b-4ce7-97ae-f5697a72c779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:56.268205 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd4a4a-cb0b-4ce7-97ae-f5697a72c779 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:56.268492 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd4a4a-cb0b-4ce7-97ae-f5697a72c779 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:56.268771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbdd4a4a-cb0b-4ce7-97ae-f5697a72c779 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:56.269551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd4a4a-cb0b-4ce7-97ae-f5697a72c779 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:11:56.269863 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd4a4a-cb0b-4ce7-97ae-f5697a72c779 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:56.271373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbdd4a4a-cb0b-4ce7-97ae-f5697a72c779 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:56.284912 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 600/1211] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:11:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:11:56.291618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a91a8a-7fd8-47ec-8b7c-c591c7a4f86f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:56.413540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a91a8a-7fd8-47ec-8b7c-c591c7a4f86f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:56.416748 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:56.455471 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aab60e-1ac0-442e-84e3-baf6bf337f75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:56.456113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aab60e-1ac0-442e-84e3-baf6bf337f75 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:56.456420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aab60e-1ac0-442e-84e3-baf6bf337f75 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:56.456717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02aab60e-1ac0-442e-84e3-baf6bf337f75 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:56.465917 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aab60e-1ac0-442e-84e3-baf6bf337f75 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:56.467677 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02aab60e-1ac0-442e-84e3-baf6bf337f75 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-02aab60e-1ac0-442e-84e3-baf6bf337f75 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:11:56.481645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:11:56.483022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:11:56.489099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:11:56.489099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:11:56.489099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:11:56.489099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:11:56.489099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:11:56.489099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:11:56.489099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:11:56.489099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:11:56.489099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:11:56.489099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:11:56.489099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 612/1212] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:11:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:11:56.491569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd4a4a-cb0b-4ce7-97ae-f5697a72c779 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:56.620463 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbdd4a4a-cb0b-4ce7-97ae-f5697a72c779 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:56.674567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf11045-f70e-497e-999d-bcb2c2cdc5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:56.675238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf11045-f70e-497e-999d-bcb2c2cdc5da None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:56.675518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf11045-f70e-497e-999d-bcb2c2cdc5da None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:56.675820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf11045-f70e-497e-999d-bcb2c2cdc5da None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:56.676562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf11045-f70e-497e-999d-bcb2c2cdc5da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:11:56.676874 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf11045-f70e-497e-999d-bcb2c2cdc5da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:56.678325 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf11045-f70e-497e-999d-bcb2c2cdc5da None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:56.697853 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 601/1213] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Aug 1 14:11:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:11:56.706495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aab60e-1ac0-442e-84e3-baf6bf337f75 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:56.819754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02aab60e-1ac0-442e-84e3-baf6bf337f75 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:56.857475 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f786d2c-9d56-46fb-a175-c0f20f96d29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:56.858092 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f786d2c-9d56-46fb-a175-c0f20f96d29d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:56.858429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f786d2c-9d56-46fb-a175-c0f20f96d29d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:56.858696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f786d2c-9d56-46fb-a175-c0f20f96d29d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:56.897021 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:56.946639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f786d2c-9d56-46fb-a175-c0f20f96d29d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:56.948131 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f786d2c-9d56-46fb-a175-c0f20f96d29d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:57.085329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 613/1214] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:11:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:11:57.087694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf11045-f70e-497e-999d-bcb2c2cdc5da None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:57.114182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:57.208066 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf11045-f70e-497e-999d-bcb2c2cdc5da None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:57.248822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd18be-1908-455b-a3bb-40839b4935e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:57.249557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd18be-1908-455b-a3bb-40839b4935e7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:57.249843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd18be-1908-455b-a3bb-40839b4935e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:57.250120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29dd18be-1908-455b-a3bb-40839b4935e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:57.262519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd18be-1908-455b-a3bb-40839b4935e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:57.264107 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29dd18be-1908-455b-a3bb-40839b4935e7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:57.280882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-29dd18be-1908-455b-a3bb-40839b4935e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:11:57.280882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:11:57.280882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:11:57.280882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:11:57.280882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:11:57.280882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:11:57.280882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:11:57.280882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:11:57.280882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:11:57.280882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:11:57.280882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:11:57.280882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:11:57.280882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:11:57.280882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:11:57.280882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:11:57.281933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:11:57.283336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:11:57.283336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:11:57.283336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:11:57.283336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:11:57.283336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 602/1215] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:11:57.289772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f786d2c-9d56-46fb-a175-c0f20f96d29d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:57.362102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:57.406874 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f786d2c-9d56-46fb-a175-c0f20f96d29d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:57.451560 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663478ac-54a4-492a-9e29-4bcf37361af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:57.452396 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663478ac-54a4-492a-9e29-4bcf37361af9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:57.452508 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663478ac-54a4-492a-9e29-4bcf37361af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:57.452775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663478ac-54a4-492a-9e29-4bcf37361af9 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:57.453583 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663478ac-54a4-492a-9e29-4bcf37361af9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:11:57.453921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663478ac-54a4-492a-9e29-4bcf37361af9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:57.455475 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663478ac-54a4-492a-9e29-4bcf37361af9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:57.469244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 614/1216] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:11:57.474934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd18be-1908-455b-a3bb-40839b4935e7 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:57.553458 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:57.586565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29dd18be-1908-455b-a3bb-40839b4935e7 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:57.627854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b12f72-7b62-4bd0-85bf-22802b379343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:57.628650 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b12f72-7b62-4bd0-85bf-22802b379343 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:57.629078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b12f72-7b62-4bd0-85bf-22802b379343 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:57.629443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b12f72-7b62-4bd0-85bf-22802b379343 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:57.639994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b12f72-7b62-4bd0-85bf-22802b379343 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:57.641761 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b12f72-7b62-4bd0-85bf-22802b379343 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:57.657545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-81b12f72-7b62-4bd0-85bf-22802b379343 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:11:57.657545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:11:57.657545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:11:57.657545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:11:57.657545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:11:57.657545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:11:57.657545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:11:57.657545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:11:57.657545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:11:57.657545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:11:57.657545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:11:57.657545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:11:57.657545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:11:57.657545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:11:57.657545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:11:57.658867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:11:57.659994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:11:57.659994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:11:57.659994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:11:57.659994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:11:57.659994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:11:57.659994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:11:57.659994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:11:57.659994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:11:57.661372 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 603/1217] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:11:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:11:57.667619 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663478ac-54a4-492a-9e29-4bcf37361af9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:57.780323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663478ac-54a4-492a-9e29-4bcf37361af9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:57.805672 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:57.820653 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cf038b-cdd8-4a1c-89de-0229f9e92b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:57.821332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf038b-cdd8-4a1c-89de-0229f9e92b74 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:57.821617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf038b-cdd8-4a1c-89de-0229f9e92b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:57.822068 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cf038b-cdd8-4a1c-89de-0229f9e92b74 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:57.827898 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf038b-cdd8-4a1c-89de-0229f9e92b74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:11:57.828233 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf038b-cdd8-4a1c-89de-0229f9e92b74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:57.829796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cf038b-cdd8-4a1c-89de-0229f9e92b74 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:57.847668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 615/1218] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:11:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:11:57.853694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b12f72-7b62-4bd0-85bf-22802b379343 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:11:57.967466 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b12f72-7b62-4bd0-85bf-22802b379343 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:11:58.005032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:11:58.013182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e40ea0-1e13-4660-9700-255ec687e35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:11:58.013880 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e40ea0-1e13-4660-9700-255ec687e35b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:11:58.014230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e40ea0-1e13-4660-9700-255ec687e35b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:11:58.014590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e40ea0-1e13-4660-9700-255ec687e35b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:11:58.015496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e40ea0-1e13-4660-9700-255ec687e35b None admin] RBAC: Adding query filter params (role.id=7db30e557e5b4d789838af5eb5985bf5, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=e210ee6c390849e7a630a677ec52e966) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:11:58.015877 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e40ea0-1e13-4660-9700-255ec687e35b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:11:58.017453 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e40ea0-1e13-4660-9700-255ec687e35b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:11:58.025680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 604/1219] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:11:57 2022] GET /identity/v3/role_assignments?user.id=e210ee6c390849e7a630a677ec52e966&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=7db30e557e5b4d789838af5eb5985bf5 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:12:00.169453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9abf3-83fa-4a83-8600-6eb016a760d4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:00.169978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9abf3-83fa-4a83-8600-6eb016a760d4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:00.169978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf9abf3-83fa-4a83-8600-6eb016a760d4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:00.171510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 616/1220] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:00.176721 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215a7eb-f48b-4541-a996-320fbc1f3e8f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:00.177151 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215a7eb-f48b-4541-a996-320fbc1f3e8f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:00.177305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4215a7eb-f48b-4541-a996-320fbc1f3e8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:00.195675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4215a7eb-f48b-4541-a996-320fbc1f3e8f None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:00.196861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4215a7eb-f48b-4541-a996-320fbc1f3e8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:00.268269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 605/1221] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:12:00.290153 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9abf3-83fa-4a83-8600-6eb016a760d4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:00.403209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf9abf3-83fa-4a83-8600-6eb016a760d4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:00.438501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04a393-d978-4b63-997f-6f00f3322e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:00.439248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04a393-d978-4b63-997f-6f00f3322e49 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:00.439644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04a393-d978-4b63-997f-6f00f3322e49 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:00.439862 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c04a393-d978-4b63-997f-6f00f3322e49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:00.450522 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c04a393-d978-4b63-997f-6f00f3322e49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-2c04a393-d978-4b63-997f-6f00f3322e49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:12:00.455901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:00.456946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:00.457800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:00.457800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:00.457800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:00.457800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:00.457800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:12:00.457800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:12:00.457800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:12:00.457800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:12:00.457800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:12:00.457800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:12:00.457800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:12:00.457800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:00.457800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 617/1222] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:12:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:00.463467 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215a7eb-f48b-4541-a996-320fbc1f3e8f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:00.587596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4215a7eb-f48b-4541-a996-320fbc1f3e8f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:00.616115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:00.629405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9828002-87c6-495a-b444-feaa4b6bece8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:00.630028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9828002-87c6-495a-b444-feaa4b6bece8 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:00.630313 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9828002-87c6-495a-b444-feaa4b6bece8 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:00.630822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9828002-87c6-495a-b444-feaa4b6bece8 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:00.631823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9828002-87c6-495a-b444-feaa4b6bece8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:00.632192 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9828002-87c6-495a-b444-feaa4b6bece8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:00.633633 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9828002-87c6-495a-b444-feaa4b6bece8 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:00.643712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 606/1223] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:12:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:00.649563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04a393-d978-4b63-997f-6f00f3322e49 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:00.703288 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:00.766060 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c04a393-d978-4b63-997f-6f00f3322e49 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:00.807797 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d79de5-3378-4378-b98f-afe66159ab37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:00.808494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d79de5-3378-4378-b98f-afe66159ab37 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:00.808773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d79de5-3378-4378-b98f-afe66159ab37 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:00.809045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d79de5-3378-4378-b98f-afe66159ab37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:00.819005 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d79de5-3378-4378-b98f-afe66159ab37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:00.820433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d79de5-3378-4378-b98f-afe66159ab37 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:00.835717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-34d79de5-3378-4378-b98f-afe66159ab37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:00.835717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:00.835717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:00.835717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:00.835717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:00.835717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:00.835717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:00.835717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:00.835717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:00.835717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:00.835717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:00.835717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:00.835717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:12:00.835717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:12:00.835717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:00.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:00.838183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:12:00.838183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:12:00.838183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:00.838183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:00.838183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 618/1224] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:12:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:00.843133 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9828002-87c6-495a-b444-feaa4b6bece8 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:00.963874 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9828002-87c6-495a-b444-feaa4b6bece8 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:01.007464 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9d949-b0f4-4d81-9baa-ab21d2d1b691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:01.008097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9d949-b0f4-4d81-9baa-ab21d2d1b691 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:01.008511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9d949-b0f4-4d81-9baa-ab21d2d1b691 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:01.008819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da9d949-b0f4-4d81-9baa-ab21d2d1b691 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:01.009516 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9d949-b0f4-4d81-9baa-ab21d2d1b691 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:01.009946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9d949-b0f4-4d81-9baa-ab21d2d1b691 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:01.011380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da9d949-b0f4-4d81-9baa-ab21d2d1b691 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:01.024667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 607/1225] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:12:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:12:01.029949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d79de5-3378-4378-b98f-afe66159ab37 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:01.127744 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:01.136548 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d79de5-3378-4378-b98f-afe66159ab37 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:01.175526 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddcf15-cc1c-4c65-bd2c-13e4ca92f20f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:01.176166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddcf15-cc1c-4c65-bd2c-13e4ca92f20f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:01.176436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddcf15-cc1c-4c65-bd2c-13e4ca92f20f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:01.176740 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ddcf15-cc1c-4c65-bd2c-13e4ca92f20f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:01.186246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddcf15-cc1c-4c65-bd2c-13e4ca92f20f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:01.188033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ddcf15-cc1c-4c65-bd2c-13e4ca92f20f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-46ddcf15-cc1c-4c65-bd2c-13e4ca92f20f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:12:01.204536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:01.205755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:01.206767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:01.206767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:01.206767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:12:01.206767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:12:01.206767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:12:01.206767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:12:01.206767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:12:01.206767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:12:01.206767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:12:01.206767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:01.206767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 619/1226] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:12:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:12:01.213012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9d949-b0f4-4d81-9baa-ab21d2d1b691 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:01.271080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:01.328726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da9d949-b0f4-4d81-9baa-ab21d2d1b691 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:01.365540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2657c-6963-4b70-90b6-893339cc2947 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:01.366196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2657c-6963-4b70-90b6-893339cc2947 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:01.366482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2657c-6963-4b70-90b6-893339cc2947 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:01.366786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a2657c-6963-4b70-90b6-893339cc2947 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:01.367720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2657c-6963-4b70-90b6-893339cc2947 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:01.368067 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2657c-6963-4b70-90b6-893339cc2947 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:01.369831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a2657c-6963-4b70-90b6-893339cc2947 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:01.394699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 608/1227] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Aug 1 14:12:01 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:01.395754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddcf15-cc1c-4c65-bd2c-13e4ca92f20f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:01.506634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ddcf15-cc1c-4c65-bd2c-13e4ca92f20f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:01.540906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d2daf-8d34-4a6c-89c7-bbcef5d75506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:01.541469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d2daf-8d34-4a6c-89c7-bbcef5d75506 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:01.541762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d2daf-8d34-4a6c-89c7-bbcef5d75506 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:01.541989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d2daf-8d34-4a6c-89c7-bbcef5d75506 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:01.553094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d2daf-8d34-4a6c-89c7-bbcef5d75506 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:01.554727 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d2daf-8d34-4a6c-89c7-bbcef5d75506 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:01.571637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-792d2daf-8d34-4a6c-89c7-bbcef5d75506 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:01.571637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:01.571637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:01.571637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:01.571637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:01.571637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:01.571637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:01.571637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:01.571637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:01.571637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:01.571637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:01.571637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:01.571637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:12:01.571637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:12:01.571637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:01.572916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:01.574107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:12:01.574107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:12:01.574107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:01.574107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:01.574107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 620/1228] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:12:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:12:01.579012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2657c-6963-4b70-90b6-893339cc2947 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:01.696474 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a2657c-6963-4b70-90b6-893339cc2947 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:01.698794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:01.740151 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a1b4d-9166-4f60-9f2f-93a708186745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:01.740771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a1b4d-9166-4f60-9f2f-93a708186745 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:01.741075 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a1b4d-9166-4f60-9f2f-93a708186745 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:01.741463 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1a1b4d-9166-4f60-9f2f-93a708186745 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:01.742106 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a1b4d-9166-4f60-9f2f-93a708186745 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:01.742418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a1b4d-9166-4f60-9f2f-93a708186745 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:01.743944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1a1b4d-9166-4f60-9f2f-93a708186745 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:01.756244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 609/1229] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:01.761957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d2daf-8d34-4a6c-89c7-bbcef5d75506 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:01.773283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:01.874919 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d2daf-8d34-4a6c-89c7-bbcef5d75506 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:01.913599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39b70f-f11a-4fa9-a0c3-24bdfb96d323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:01.914358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39b70f-f11a-4fa9-a0c3-24bdfb96d323 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:01.914671 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39b70f-f11a-4fa9-a0c3-24bdfb96d323 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:01.914949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e39b70f-f11a-4fa9-a0c3-24bdfb96d323 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:01.921931 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39b70f-f11a-4fa9-a0c3-24bdfb96d323 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:01.923445 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e39b70f-f11a-4fa9-a0c3-24bdfb96d323 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:01.935807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-8e39b70f-f11a-4fa9-a0c3-24bdfb96d323 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:12:01.935807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:01.935807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:01.935807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:01.935807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:01.935807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:01.935807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:01.935807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:01.935807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:01.935807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:01.935807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:01.935807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:01.935807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:12:01.935807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:12:01.935807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:01.936953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:01.938214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:12:01.938214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:12:01.938214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:12:01.938214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:12:01.938214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:12:01.938214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:12:01.938214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:12:01.938214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:01.938214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 621/1230] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:12:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:01.943333 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a1b4d-9166-4f60-9f2f-93a708186745 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:02.063022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1a1b4d-9166-4f60-9f2f-93a708186745 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:02.103453 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f523e1-3d5e-437e-a45e-09aabd458686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:02.104070 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f523e1-3d5e-437e-a45e-09aabd458686 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:02.104378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f523e1-3d5e-437e-a45e-09aabd458686 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:02.104627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f523e1-3d5e-437e-a45e-09aabd458686 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:02.105359 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f523e1-3d5e-437e-a45e-09aabd458686 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:02.105668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f523e1-3d5e-437e-a45e-09aabd458686 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:02.107162 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f523e1-3d5e-437e-a45e-09aabd458686 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:02.119669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 610/1231] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:12:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:02.125861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39b70f-f11a-4fa9-a0c3-24bdfb96d323 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:02.197063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:02.238935 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e39b70f-f11a-4fa9-a0c3-24bdfb96d323 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:02.276591 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07019ee-f123-4e04-81b4-933ed0574397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:02.278029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07019ee-f123-4e04-81b4-933ed0574397 None admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:02.278502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07019ee-f123-4e04-81b4-933ed0574397 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:02.279007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07019ee-f123-4e04-81b4-933ed0574397 None admin] PATH_INFO: `/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/e210ee6c390849e7a630a677ec52e966/roles/7db30e557e5b4d789838af5eb5985bf5` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:02.295331 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07019ee-f123-4e04-81b4-933ed0574397 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8bcd31836684fe5b43fd604df3d3e8b, user_id=e210ee6c390849e7a630a677ec52e966, role_id=7db30e557e5b4d789838af5eb5985bf5)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:02.297263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07019ee-f123-4e04-81b4-933ed0574397 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:02.311311 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 622/1232] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:12:02 2022] PUT /identity/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/e210ee6c390849e7a630a677ec52e966/roles/7db30e557e5b4d789838af5eb5985bf5 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:12:04.346394 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4f605-3879-4bae-a046-df2bd69bf1e4 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:04.346952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4f605-3879-4bae-a046-df2bd69bf1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:04.346952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4f605-3879-4bae-a046-df2bd69bf1e4 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:04.348304 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 611/1233] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:04.353664 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b130ab-760e-4497-99d5-3b023a276037 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:04.354114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b130ab-760e-4497-99d5-3b023a276037 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:04.354338 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b130ab-760e-4497-99d5-3b023a276037 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:04.375140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-72b130ab-760e-4497-99d5-3b023a276037 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:04.376472 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-72b130ab-760e-4497-99d5-3b023a276037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:04.455151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 623/1234] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:12:04.478122 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4f605-3879-4bae-a046-df2bd69bf1e4 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:04.506121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:04.591630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4f605-3879-4bae-a046-df2bd69bf1e4 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:04.628340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc267b-9e09-4e2c-8763-4b49ba436f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:04.628907 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc267b-9e09-4e2c-8763-4b49ba436f94 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:04.629190 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc267b-9e09-4e2c-8763-4b49ba436f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:04.629456 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bc267b-9e09-4e2c-8763-4b49ba436f94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:04.641125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bc267b-9e09-4e2c-8763-4b49ba436f94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-d9bc267b-9e09-4e2c-8763-4b49ba436f94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:12:04.646049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:04.647155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:04.648006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:04.648006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:04.648006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:04.648006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:04.648006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:12:04.648006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:12:04.648006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:12:04.648006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:12:04.648006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:12:04.648006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:12:04.648006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 01 14:12:04.648006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:12:04.648006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 612/1235] 10.222.0.70 () {56 vars in 1102 bytes} [Mon Aug 1 14:12:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:04.654507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b130ab-760e-4497-99d5-3b023a276037 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:04.708033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:04.765993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b130ab-760e-4497-99d5-3b023a276037 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:04.803489 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dab13-a361-4d8e-855c-54bfcdcf8c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:04.804117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dab13-a361-4d8e-855c-54bfcdcf8c12 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:04.804400 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dab13-a361-4d8e-855c-54bfcdcf8c12 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:04.804675 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088dab13-a361-4d8e-855c-54bfcdcf8c12 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:04.805386 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dab13-a361-4d8e-855c-54bfcdcf8c12 None admin] RBAC: Adding query filter params (name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:04.805690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dab13-a361-4d8e-855c-54bfcdcf8c12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:04.807093 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088dab13-a361-4d8e-855c-54bfcdcf8c12 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:04.815202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 624/1236] 10.222.0.70 () {56 vars in 1103 bytes} [Mon Aug 1 14:12:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:04.821060 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc267b-9e09-4e2c-8763-4b49ba436f94 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:04.919405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:04.935577 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bc267b-9e09-4e2c-8763-4b49ba436f94 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:04.984563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846c74b-7138-4864-920f-0db98ada478b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:04.985320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846c74b-7138-4864-920f-0db98ada478b None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:04.985620 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846c74b-7138-4864-920f-0db98ada478b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:04.985938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a846c74b-7138-4864-920f-0db98ada478b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:04.998257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846c74b-7138-4864-920f-0db98ada478b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:05.000247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a846c74b-7138-4864-920f-0db98ada478b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:05.021403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-a846c74b-7138-4864-920f-0db98ada478b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:05.021403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:05.021403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:05.021403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:05.021403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:05.021403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:05.021403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:05.021403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:05.021403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:05.021403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:05.021403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:05.021403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:05.021403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:12:05.021403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:12:05.021403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:05.022562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:05.023554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:12:05.023554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:12:05.023554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:05.023554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:12:05.023554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 613/1237] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:12:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:05.030327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dab13-a361-4d8e-855c-54bfcdcf8c12 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:05.140179 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088dab13-a361-4d8e-855c-54bfcdcf8c12 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:05.149800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:05.181625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dc341-b027-4c66-98bd-2086abde9e01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:05.182166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dc341-b027-4c66-98bd-2086abde9e01 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:05.182444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dc341-b027-4c66-98bd-2086abde9e01 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:05.182737 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dc341-b027-4c66-98bd-2086abde9e01 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:05.183452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dc341-b027-4c66-98bd-2086abde9e01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:05.183753 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dc341-b027-4c66-98bd-2086abde9e01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:05.185186 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dc341-b027-4c66-98bd-2086abde9e01 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:05.198195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 625/1238] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:12:05.205265 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846c74b-7138-4864-920f-0db98ada478b None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:05.316987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a846c74b-7138-4864-920f-0db98ada478b None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:05.354489 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bef6f-dd03-4f38-a54b-ef29bd0c26e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:05.355207 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bef6f-dd03-4f38-a54b-ef29bd0c26e0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:05.355489 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bef6f-dd03-4f38-a54b-ef29bd0c26e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:05.355803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520bef6f-dd03-4f38-a54b-ef29bd0c26e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:05.358639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:05.364778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bef6f-dd03-4f38-a54b-ef29bd0c26e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:05.366461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520bef6f-dd03-4f38-a54b-ef29bd0c26e0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-520bef6f-dd03-4f38-a54b-ef29bd0c26e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:12:05.380799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:05.381961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:05.383230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:05.383230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:05.383230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:12:05.383230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:12:05.383230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:12:05.383230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:12:05.383230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:12:05.383230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:12:05.383230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:12:05.383230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:12:05.383230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 614/1239] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:12:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:12:05.388622 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dc341-b027-4c66-98bd-2086abde9e01 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:05.495376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dc341-b027-4c66-98bd-2086abde9e01 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:05.531841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58506fd-a98c-4faa-b286-c84b4c89112e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:05.532556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58506fd-a98c-4faa-b286-c84b4c89112e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:05.532841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58506fd-a98c-4faa-b286-c84b4c89112e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:05.533131 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58506fd-a98c-4faa-b286-c84b4c89112e None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:05.534002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58506fd-a98c-4faa-b286-c84b4c89112e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:05.534329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58506fd-a98c-4faa-b286-c84b4c89112e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:05.535928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58506fd-a98c-4faa-b286-c84b4c89112e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:05.555055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 626/1240] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Aug 1 14:12:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:05.561323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bef6f-dd03-4f38-a54b-ef29bd0c26e0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:05.685020 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520bef6f-dd03-4f38-a54b-ef29bd0c26e0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:05.733162 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf93ad-b4bb-41d3-b6b4-2ce9bb6495bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:05.734167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf93ad-b4bb-41d3-b6b4-2ce9bb6495bc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:05.734695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf93ad-b4bb-41d3-b6b4-2ce9bb6495bc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:05.735146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf93ad-b4bb-41d3-b6b4-2ce9bb6495bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:05.815767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:05.823282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf93ad-b4bb-41d3-b6b4-2ce9bb6495bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:05.825059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf93ad-b4bb-41d3-b6b4-2ce9bb6495bc None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:05.938379 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 615/1241] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:12:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:05.946636 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58506fd-a98c-4faa-b286-c84b4c89112e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:05.979417 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:06.065690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58506fd-a98c-4faa-b286-c84b4c89112e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:06.103823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d1935-036f-4887-a567-084d9d7dd29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:06.104392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d1935-036f-4887-a567-084d9d7dd29f None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:06.104736 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d1935-036f-4887-a567-084d9d7dd29f None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:06.105616 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16d1935-036f-4887-a567-084d9d7dd29f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:06.117923 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d1935-036f-4887-a567-084d9d7dd29f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:06.119855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16d1935-036f-4887-a567-084d9d7dd29f None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:06.135899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-b16d1935-036f-4887-a567-084d9d7dd29f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:06.135899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:06.135899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:06.135899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:06.135899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:06.135899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:06.135899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:06.135899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:06.135899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:06.135899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:06.135899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:06.135899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:06.135899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:12:06.135899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:12:06.135899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:06.137037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:06.145187 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:12:06.145187 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:12:06.145187 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:06.145187 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:06.145187 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 627/1242] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:12:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:06.145814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf93ad-b4bb-41d3-b6b4-2ce9bb6495bc None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:06.269528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:06.276501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf93ad-b4bb-41d3-b6b4-2ce9bb6495bc None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:06.314021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078da9c-d74c-40ed-9a87-358049298bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:06.314865 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078da9c-d74c-40ed-9a87-358049298bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:06.315200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078da9c-d74c-40ed-9a87-358049298bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:06.315549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7078da9c-d74c-40ed-9a87-358049298bd3 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:06.316338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078da9c-d74c-40ed-9a87-358049298bd3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:06.316691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078da9c-d74c-40ed-9a87-358049298bd3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:06.318269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7078da9c-d74c-40ed-9a87-358049298bd3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:06.332979 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 616/1243] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:12:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:06.340180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d1935-036f-4887-a567-084d9d7dd29f None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:06.428817 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:06.455651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16d1935-036f-4887-a567-084d9d7dd29f None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:06.493766 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f09966-abde-482e-8559-39fd884cfa7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:06.494405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f09966-abde-482e-8559-39fd884cfa7d None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:06.494713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f09966-abde-482e-8559-39fd884cfa7d None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:06.494986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f09966-abde-482e-8559-39fd884cfa7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:06.501771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f09966-abde-482e-8559-39fd884cfa7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:06.503245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f09966-abde-482e-8559-39fd884cfa7d None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:06.514967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-15f09966-abde-482e-8559-39fd884cfa7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:12:06.514967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:06.514967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:06.514967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:06.514967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:06.514967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:06.514967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:06.514967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:06.514967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:06.514967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:06.514967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:06.514967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:06.514967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:12:06.514967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:12:06.514967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:06.516260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:06.517379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:12:06.517379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:12:06.517379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:12:06.517379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:12:06.517379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:12:06.517379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:12:06.517379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:12:06.517379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:06.517379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 628/1244] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:12:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:06.522969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078da9c-d74c-40ed-9a87-358049298bd3 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:06.645590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7078da9c-d74c-40ed-9a87-358049298bd3 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:06.692896 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e25a2-862b-4b79-8495-7a2fae5371c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:06.693599 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e25a2-862b-4b79-8495-7a2fae5371c6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:06.693967 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e25a2-862b-4b79-8495-7a2fae5371c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:06.694404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e25a2-862b-4b79-8495-7a2fae5371c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:06.695442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e25a2-862b-4b79-8495-7a2fae5371c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:06.695947 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e25a2-862b-4b79-8495-7a2fae5371c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:06.697865 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e25a2-862b-4b79-8495-7a2fae5371c6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:06.716355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 617/1245] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:12:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:06.722791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f09966-abde-482e-8559-39fd884cfa7d None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:06.845972 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f09966-abde-482e-8559-39fd884cfa7d None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:06.886235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cca517-e215-4639-a369-9332bcc2504a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:06.887532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cca517-e215-4639-a369-9332bcc2504a None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:06.887939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cca517-e215-4639-a369-9332bcc2504a None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:06.888219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cca517-e215-4639-a369-9332bcc2504a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:06.889261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cca517-e215-4639-a369-9332bcc2504a None admin] RBAC: Adding query filter params (role.id=7db30e557e5b4d789838af5eb5985bf5, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=e210ee6c390849e7a630a677ec52e966) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:06.889614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cca517-e215-4639-a369-9332bcc2504a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:06.891353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cca517-e215-4639-a369-9332bcc2504a None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:06.898466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 629/1246] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:12:06 2022] GET /identity/v3/role_assignments?user.id=e210ee6c390849e7a630a677ec52e966&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=7db30e557e5b4d789838af5eb5985bf5 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:09.127277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1fab9-8054-4553-9713-ab212ddd8711 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:09.127801 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1fab9-8054-4553-9713-ab212ddd8711 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:09.127801 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f1fab9-8054-4553-9713-ab212ddd8711 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:09.129148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 618/1247] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:12:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:09.134283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e357a5-56a5-4860-b796-8b183cbfbbdc None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:09.134922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e357a5-56a5-4860-b796-8b183cbfbbdc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:09.134922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e357a5-56a5-4860-b796-8b183cbfbbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:09.141680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:09.154738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e0e357a5-56a5-4860-b796-8b183cbfbbdc None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:09.155942 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e0e357a5-56a5-4860-b796-8b183cbfbbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:09.226726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 630/1248] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:12:09.250355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1fab9-8054-4553-9713-ab212ddd8711 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:09.271669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:09.367639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f1fab9-8054-4553-9713-ab212ddd8711 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:09.409221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757725bb-b6cd-4d0f-a544-4be7e804cd64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:09.409870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757725bb-b6cd-4d0f-a544-4be7e804cd64 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:09.410131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757725bb-b6cd-4d0f-a544-4be7e804cd64 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:09.410399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757725bb-b6cd-4d0f-a544-4be7e804cd64 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:09.422892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757725bb-b6cd-4d0f-a544-4be7e804cd64 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-757725bb-b6cd-4d0f-a544-4be7e804cd64 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:12:09.429246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:09.430345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:09.436746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:09.436746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:09.436746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:09.436746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:09.436746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:12:09.436746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:12:09.436746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:12:09.436746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:12:09.436746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:12:09.436746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:12:09.436746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:12:09.436746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:12:09.436746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 619/1249] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:12:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 01 14:12:09.437455 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e357a5-56a5-4860-b796-8b183cbfbbdc None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:09.555725 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e357a5-56a5-4860-b796-8b183cbfbbdc None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:09.591368 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:09.597693 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abb4d0-9440-4df0-aa57-abc24379b0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:09.598738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abb4d0-9440-4df0-aa57-abc24379b0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:09.599202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abb4d0-9440-4df0-aa57-abc24379b0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:09.599557 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7abb4d0-9440-4df0-aa57-abc24379b0c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:09.600669 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abb4d0-9440-4df0-aa57-abc24379b0c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:09.601129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abb4d0-9440-4df0-aa57-abc24379b0c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:09.602687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7abb4d0-9440-4df0-aa57-abc24379b0c9 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:09.613837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 631/1250] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:12:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:12:09.620159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757725bb-b6cd-4d0f-a544-4be7e804cd64 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:09.728795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:09.756976 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757725bb-b6cd-4d0f-a544-4be7e804cd64 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:09.797501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b6457-5bf1-4d04-b52f-cc832458555a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:09.798380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b6457-5bf1-4d04-b52f-cc832458555a None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:09.798707 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b6457-5bf1-4d04-b52f-cc832458555a None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:09.799090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b6457-5bf1-4d04-b52f-cc832458555a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:09.811238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b6457-5bf1-4d04-b52f-cc832458555a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:09.812654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b6457-5bf1-4d04-b52f-cc832458555a None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:09.830189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-889b6457-5bf1-4d04-b52f-cc832458555a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:09.830189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:09.830189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:09.830189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:09.830189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:09.830189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:09.830189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:09.830189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:09.830189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:09.830189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:09.830189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:09.830189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:09.830189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:12:09.830189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:12:09.830189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:09.831855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:09.832799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:12:09.832799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:12:09.832799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:09.832799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:12:09.832799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 620/1251] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:12:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:09.838480 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abb4d0-9440-4df0-aa57-abc24379b0c9 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:09.945936 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7abb4d0-9440-4df0-aa57-abc24379b0c9 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:09.986909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045e2e1-f7c1-45c8-a8f2-e892795cff0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:09.987756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045e2e1-f7c1-45c8-a8f2-e892795cff0c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:09.988254 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045e2e1-f7c1-45c8-a8f2-e892795cff0c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:09.988608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7045e2e1-f7c1-45c8-a8f2-e892795cff0c None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:09.989313 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045e2e1-f7c1-45c8-a8f2-e892795cff0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:09.989618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045e2e1-f7c1-45c8-a8f2-e892795cff0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:09.991130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7045e2e1-f7c1-45c8-a8f2-e892795cff0c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:10.004140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 632/1252] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:12:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:12:10.009827 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b6457-5bf1-4d04-b52f-cc832458555a None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:10.123900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b6457-5bf1-4d04-b52f-cc832458555a None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:10.153519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:10.162810 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e27e9a-2068-4881-92fe-16e9444bfe4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:10.163459 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e27e9a-2068-4881-92fe-16e9444bfe4e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:10.163755 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e27e9a-2068-4881-92fe-16e9444bfe4e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:10.164018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e27e9a-2068-4881-92fe-16e9444bfe4e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:10.172743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e27e9a-2068-4881-92fe-16e9444bfe4e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:10.174209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e27e9a-2068-4881-92fe-16e9444bfe4e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-b4e27e9a-2068-4881-92fe-16e9444bfe4e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:12:10.185995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:10.187081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:10.188164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:10.188164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:10.188164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:12:10.188164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:12:10.188164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:12:10.188164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:12:10.188164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:12:10.188164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:12:10.188164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:12:10.188164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:12:10.188164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 621/1253] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:12:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:10.193466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045e2e1-f7c1-45c8-a8f2-e892795cff0c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:10.256294 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:10.307936 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7045e2e1-f7c1-45c8-a8f2-e892795cff0c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:10.349901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22a9f8-d6dd-4237-9d50-887c0a387081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:10.350657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22a9f8-d6dd-4237-9d50-887c0a387081 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:10.350943 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22a9f8-d6dd-4237-9d50-887c0a387081 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:10.351232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce22a9f8-d6dd-4237-9d50-887c0a387081 None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:10.352050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22a9f8-d6dd-4237-9d50-887c0a387081 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:10.352492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22a9f8-d6dd-4237-9d50-887c0a387081 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:10.353989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce22a9f8-d6dd-4237-9d50-887c0a387081 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:10.372934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 633/1254] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Aug 1 14:12:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:10.379507 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e27e9a-2068-4881-92fe-16e9444bfe4e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:10.504709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e27e9a-2068-4881-92fe-16e9444bfe4e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:10.544222 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ed97c-758f-42e8-a693-374ec0fd84fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:10.544891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ed97c-758f-42e8-a693-374ec0fd84fc None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:10.545165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ed97c-758f-42e8-a693-374ec0fd84fc None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:10.545477 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4ed97c-758f-42e8-a693-374ec0fd84fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:10.610966 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:10.625107 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ed97c-758f-42e8-a693-374ec0fd84fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:10.626633 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4ed97c-758f-42e8-a693-374ec0fd84fc None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:10.736117 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 622/1255] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:12:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:10.742387 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22a9f8-d6dd-4237-9d50-887c0a387081 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:10.857560 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce22a9f8-d6dd-4237-9d50-887c0a387081 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:10.874063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:10.903391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b5f23-3e67-42f0-be32-90410238c75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:10.904029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b5f23-3e67-42f0-be32-90410238c75c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:10.904302 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b5f23-3e67-42f0-be32-90410238c75c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:10.904565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b5f23-3e67-42f0-be32-90410238c75c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:10.914443 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b5f23-3e67-42f0-be32-90410238c75c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:10.915929 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b5f23-3e67-42f0-be32-90410238c75c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:10.931827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-de6b5f23-3e67-42f0-be32-90410238c75c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:10.931827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:10.931827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:10.931827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:10.931827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:10.931827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:10.931827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:10.931827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:10.931827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:10.931827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:10.931827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:10.931827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:10.931827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:12:10.931827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:12:10.931827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:10.932796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:10.933816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:12:10.933816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:12:10.933816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:10.933816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:10.935093 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 634/1256] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:12:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:10.940981 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ed97c-758f-42e8-a693-374ec0fd84fc None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:11.040309 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:11.055133 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4ed97c-758f-42e8-a693-374ec0fd84fc None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:11.098478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635713bb-1c2e-4302-80fe-b5176dcad164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:11.099114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635713bb-1c2e-4302-80fe-b5176dcad164 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:11.099461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635713bb-1c2e-4302-80fe-b5176dcad164 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:11.099734 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635713bb-1c2e-4302-80fe-b5176dcad164 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:11.100540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635713bb-1c2e-4302-80fe-b5176dcad164 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:11.100927 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635713bb-1c2e-4302-80fe-b5176dcad164 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:11.102452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635713bb-1c2e-4302-80fe-b5176dcad164 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:11.115443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 623/1257] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:12:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:11.121956 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b5f23-3e67-42f0-be32-90410238c75c None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:11.237168 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b5f23-3e67-42f0-be32-90410238c75c None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:11.277903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba2ae3-de57-4845-acc5-bbb211dd458e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:11.278502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba2ae3-de57-4845-acc5-bbb211dd458e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:11.278840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba2ae3-de57-4845-acc5-bbb211dd458e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:11.279091 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ba2ae3-de57-4845-acc5-bbb211dd458e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:11.287420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba2ae3-de57-4845-acc5-bbb211dd458e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:11.289006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ba2ae3-de57-4845-acc5-bbb211dd458e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:11.304674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e4ba2ae3-de57-4845-acc5-bbb211dd458e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:12:11.304674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:11.304674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:11.304674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:11.304674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:11.304674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:11.304674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:11.304674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:11.304674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:11.304674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:11.304674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:11.304674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:11.304674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:12:11.304674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:12:11.304674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:11.307180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:11.308709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:12:11.308709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:12:11.308709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:12:11.308709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:12:11.308709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:12:11.308709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:12:11.308709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:12:11.308709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:11.308709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 635/1258] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:12:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:11.313089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635713bb-1c2e-4302-80fe-b5176dcad164 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:11.430098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635713bb-1c2e-4302-80fe-b5176dcad164 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:11.464857 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d8f2f2-5dd9-4252-ad8f-320f048405f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:11.465652 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8f2f2-5dd9-4252-ad8f-320f048405f7 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:11.465999 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8f2f2-5dd9-4252-ad8f-320f048405f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:11.466399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d8f2f2-5dd9-4252-ad8f-320f048405f7 None admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:11.467347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8f2f2-5dd9-4252-ad8f-320f048405f7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:11.467725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8f2f2-5dd9-4252-ad8f-320f048405f7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:11.469216 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d8f2f2-5dd9-4252-ad8f-320f048405f7 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:11.482466 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 624/1259] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:12:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:11.488853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba2ae3-de57-4845-acc5-bbb211dd458e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:11.515910 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:11.602501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ba2ae3-de57-4845-acc5-bbb211dd458e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:11.642639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b925052a-e1de-443a-90ad-5511996ed944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:11.643340 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925052a-e1de-443a-90ad-5511996ed944 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:11.643710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925052a-e1de-443a-90ad-5511996ed944 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:11.643930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b925052a-e1de-443a-90ad-5511996ed944 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:11.644711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925052a-e1de-443a-90ad-5511996ed944 None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=e210ee6c390849e7a630a677ec52e966) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:11.645132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925052a-e1de-443a-90ad-5511996ed944 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:11.646553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b925052a-e1de-443a-90ad-5511996ed944 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:11.654451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 636/1260] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:12:11 2022] GET /identity/v3/role_assignments?user.id=e210ee6c390849e7a630a677ec52e966&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=0681632796d144f6a7ac8eca157001ec => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:13.735115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ea89-5339-4515-9093-19f1f075c3b2 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:13.735649 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ea89-5339-4515-9093-19f1f075c3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:13.735649 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f3ea89-5339-4515-9093-19f1f075c3b2 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:13.736991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 625/1261] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:13.742211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8419a-ff57-49b2-9c37-ff8f4917c5f8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:13.742657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8419a-ff57-49b2-9c37-ff8f4917c5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:13.742799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8419a-ff57-49b2-9c37-ff8f4917c5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:13.761929 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-09f8419a-ff57-49b2-9c37-ff8f4917c5f8 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:13.763266 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-09f8419a-ff57-49b2-9c37-ff8f4917c5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:13.827841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 637/1262] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:12:13.849608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3ea89-5339-4515-9093-19f1f075c3b2 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:13.861275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:13.950341 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f3ea89-5339-4515-9093-19f1f075c3b2 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:13.983516 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad97431-0161-42f8-8b3d-85f5f2f5c728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:13.984153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad97431-0161-42f8-8b3d-85f5f2f5c728 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:13.984430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad97431-0161-42f8-8b3d-85f5f2f5c728 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:13.984698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad97431-0161-42f8-8b3d-85f5f2f5c728 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:13.994994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad97431-0161-42f8-8b3d-85f5f2f5c728 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-0ad97431-0161-42f8-8b3d-85f5f2f5c728 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:12:14.000370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:14.001496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:14.002544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:14.002544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:14.002544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:14.002544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:14.002544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:12:14.002544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:12:14.002544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:12:14.002544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:12:14.002544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:12:14.002544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:12:14.002544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:12:14.002544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:12:14.002544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 626/1263] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:12:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:14.009479 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8419a-ff57-49b2-9c37-ff8f4917c5f8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:14.028159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:14.107408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8419a-ff57-49b2-9c37-ff8f4917c5f8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:14.140257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49a7e3-a22a-42d6-ad7c-ae94dea10292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:14.140858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49a7e3-a22a-42d6-ad7c-ae94dea10292 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:14.141136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49a7e3-a22a-42d6-ad7c-ae94dea10292 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:14.141406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f49a7e3-a22a-42d6-ad7c-ae94dea10292 None admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:14.142108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49a7e3-a22a-42d6-ad7c-ae94dea10292 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:14.142408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49a7e3-a22a-42d6-ad7c-ae94dea10292 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:14.143792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f49a7e3-a22a-42d6-ad7c-ae94dea10292 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:14.151734 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 638/1264] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:12:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:14.157358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad97431-0161-42f8-8b3d-85f5f2f5c728 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:14.222972 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:14.255825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad97431-0161-42f8-8b3d-85f5f2f5c728 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:14.287699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a22fe-ccc9-4627-808f-b13f057ac6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:14.288316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a22fe-ccc9-4627-808f-b13f057ac6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:14.288591 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a22fe-ccc9-4627-808f-b13f057ac6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:14.288855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a22fe-ccc9-4627-808f-b13f057ac6b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:14.298945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a22fe-ccc9-4627-808f-b13f057ac6b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:14.300390 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a22fe-ccc9-4627-808f-b13f057ac6b0 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:14.314946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-c63a22fe-ccc9-4627-808f-b13f057ac6b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:14.314946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:14.314946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:14.314946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:14.314946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:14.314946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:14.314946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:14.314946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:14.314946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:14.314946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:14.314946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:14.314946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:14.314946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:12:14.314946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:12:14.314946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:14.315987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:14.317032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:12:14.317032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:12:14.317032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:14.317032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:12:14.317032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 627/1265] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:14.321798 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49a7e3-a22a-42d6-ad7c-ae94dea10292 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:14.402754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:14.421933 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f49a7e3-a22a-42d6-ad7c-ae94dea10292 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:14.454122 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407df4a0-da67-41a1-999e-0b4cc8d3afb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:14.454760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407df4a0-da67-41a1-999e-0b4cc8d3afb3 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:14.455044 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407df4a0-da67-41a1-999e-0b4cc8d3afb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:14.455317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407df4a0-da67-41a1-999e-0b4cc8d3afb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:14.456001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407df4a0-da67-41a1-999e-0b4cc8d3afb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:14.456303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407df4a0-da67-41a1-999e-0b4cc8d3afb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:14.457661 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407df4a0-da67-41a1-999e-0b4cc8d3afb3 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:14.469819 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 639/1266] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:14.475469 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a22fe-ccc9-4627-808f-b13f057ac6b0 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:14.573614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a22fe-ccc9-4627-808f-b13f057ac6b0 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:14.593498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:14.608247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cdc8b-5dcf-4780-b074-39e4eb0d7229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:14.608869 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cdc8b-5dcf-4780-b074-39e4eb0d7229 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:14.609146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cdc8b-5dcf-4780-b074-39e4eb0d7229 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:14.609414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5cdc8b-5dcf-4780-b074-39e4eb0d7229 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:14.616741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cdc8b-5dcf-4780-b074-39e4eb0d7229 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:14.618196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5cdc8b-5dcf-4780-b074-39e4eb0d7229 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-db5cdc8b-5dcf-4780-b074-39e4eb0d7229 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:12:14.629237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:14.630328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:14.631661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:14.631661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:14.631661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:12:14.631661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:12:14.631661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:12:14.631661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:12:14.631661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:12:14.631661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:12:14.631661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:12:14.631661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:12:14.631661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 628/1267] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:12:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:14.636636 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407df4a0-da67-41a1-999e-0b4cc8d3afb3 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:14.748520 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407df4a0-da67-41a1-999e-0b4cc8d3afb3 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:14.781757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8e6fc-e1e0-4bd0-ac5e-ef2be8e9de8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:14.782359 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8e6fc-e1e0-4bd0-ac5e-ef2be8e9de8e None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:14.782659 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8e6fc-e1e0-4bd0-ac5e-ef2be8e9de8e None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:14.782928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd8e6fc-e1e0-4bd0-ac5e-ef2be8e9de8e None admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:14.783704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8e6fc-e1e0-4bd0-ac5e-ef2be8e9de8e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:14.784008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8e6fc-e1e0-4bd0-ac5e-ef2be8e9de8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:14.785419 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bd8e6fc-e1e0-4bd0-ac5e-ef2be8e9de8e None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:14.793697 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:14.801980 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 640/1268] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Aug 1 14:12:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:14.807677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cdc8b-5dcf-4780-b074-39e4eb0d7229 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:14.906288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5cdc8b-5dcf-4780-b074-39e4eb0d7229 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:14.938111 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa6933-2138-440a-a46d-2caf94ac1207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:14.938766 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa6933-2138-440a-a46d-2caf94ac1207 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:14.939048 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa6933-2138-440a-a46d-2caf94ac1207 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:14.939321 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aa6933-2138-440a-a46d-2caf94ac1207 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:14.950016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa6933-2138-440a-a46d-2caf94ac1207 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:14.951501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aa6933-2138-440a-a46d-2caf94ac1207 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:14.966176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-95aa6933-2138-440a-a46d-2caf94ac1207 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:14.966176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:14.966176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:14.966176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:14.966176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:14.966176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:14.966176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:14.966176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:14.966176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:14.966176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:14.966176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:14.966176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:14.966176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:12:14.966176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:12:14.966176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:14.967247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:14.968513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:12:14.968513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:12:14.968513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:14.968513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:12:14.968513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 629/1269] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:12:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:14.972945 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8e6fc-e1e0-4bd0-ac5e-ef2be8e9de8e None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:15.081411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd8e6fc-e1e0-4bd0-ac5e-ef2be8e9de8e None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:15.118699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4db85e-d4ff-4190-b62b-e2023a280961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:15.119307 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4db85e-d4ff-4190-b62b-e2023a280961 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:15.119587 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4db85e-d4ff-4190-b62b-e2023a280961 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:15.119860 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4db85e-d4ff-4190-b62b-e2023a280961 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:15.121389 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4db85e-d4ff-4190-b62b-e2023a280961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:15.121921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4db85e-d4ff-4190-b62b-e2023a280961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:15.123994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4db85e-d4ff-4190-b62b-e2023a280961 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:15.136942 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 641/1270] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:12:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:15.142650 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa6933-2138-440a-a46d-2caf94ac1207 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:15.173456 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:15.240521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aa6933-2138-440a-a46d-2caf94ac1207 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:15.273364 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a8ab2-ac5d-49eb-9164-9f0e112dd169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:15.273994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a8ab2-ac5d-49eb-9164-9f0e112dd169 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:15.274276 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a8ab2-ac5d-49eb-9164-9f0e112dd169 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:15.274549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8a8ab2-ac5d-49eb-9164-9f0e112dd169 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:15.281093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a8ab2-ac5d-49eb-9164-9f0e112dd169 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:15.282546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8a8ab2-ac5d-49eb-9164-9f0e112dd169 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:15.293678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-0c8a8ab2-ac5d-49eb-9164-9f0e112dd169 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:12:15.293678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:15.293678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:15.293678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:15.293678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:15.293678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:15.293678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:15.293678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:15.293678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:15.293678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:15.293678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:15.293678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:15.293678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:12:15.293678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:12:15.293678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:15.294712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:15.295835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:12:15.295835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:12:15.295835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:12:15.295835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:12:15.295835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:12:15.295835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:12:15.295835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:12:15.295835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:12:15.295835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 630/1271] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:12:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:15.300583 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4db85e-d4ff-4190-b62b-e2023a280961 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:15.359559 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:15.402034 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4db85e-d4ff-4190-b62b-e2023a280961 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:15.434657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7c0bc2-4f95-44f9-abef-758a65d05981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:15.435215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c0bc2-4f95-44f9-abef-758a65d05981 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:15.435497 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c0bc2-4f95-44f9-abef-758a65d05981 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:15.435774 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7c0bc2-4f95-44f9-abef-758a65d05981 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:15.436514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c0bc2-4f95-44f9-abef-758a65d05981 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:15.436821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c0bc2-4f95-44f9-abef-758a65d05981 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:15.438237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7c0bc2-4f95-44f9-abef-758a65d05981 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:15.450364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 642/1272] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:12:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:15.456339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a8ab2-ac5d-49eb-9164-9f0e112dd169 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:15.545550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:15.554545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8a8ab2-ac5d-49eb-9164-9f0e112dd169 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:15.587968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa4140b-1e9f-4d90-b234-5985c8e994a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:15.588616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4140b-1e9f-4d90-b234-5985c8e994a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:15.589450 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4140b-1e9f-4d90-b234-5985c8e994a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:15.589728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa4140b-1e9f-4d90-b234-5985c8e994a3 None admin] PATH_INFO: `/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/e210ee6c390849e7a630a677ec52e966/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:15.591654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4140b-1e9f-4d90-b234-5985c8e994a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=c8bcd31836684fe5b43fd604df3d3e8b, user_id=e210ee6c390849e7a630a677ec52e966, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:15.593088 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa4140b-1e9f-4d90-b234-5985c8e994a3 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:15.606170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 631/1273] 10.222.0.70 () {58 vars in 1439 bytes} [Mon Aug 1 14:12:15 2022] PUT /identity/v3/projects/c8bcd31836684fe5b43fd604df3d3e8b/users/e210ee6c390849e7a630a677ec52e966/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:12:17.608949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0ab26-1185-4e84-9592-d672785e7921 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:17.609477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0ab26-1185-4e84-9592-d672785e7921 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:17.609477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a0ab26-1185-4e84-9592-d672785e7921 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:17.610867 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 643/1274] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:17.615889 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5424a-ee11-4a2e-b836-c5f4d9c1d5bc None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:17.616272 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5424a-ee11-4a2e-b836-c5f4d9c1d5bc None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:17.616437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee5424a-ee11-4a2e-b836-c5f4d9c1d5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:17.634822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9ee5424a-ee11-4a2e-b836-c5f4d9c1d5bc None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:17.636684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9ee5424a-ee11-4a2e-b836-c5f4d9c1d5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:17.716120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 632/1275] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:12:17.747293 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0ab26-1185-4e84-9592-d672785e7921 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:17.846699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a0ab26-1185-4e84-9592-d672785e7921 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:17.864364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:17.880683 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6ea58-4909-4a60-a7b3-d3b7dfb0282b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:17.881310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6ea58-4909-4a60-a7b3-d3b7dfb0282b None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:17.881590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6ea58-4909-4a60-a7b3-d3b7dfb0282b None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:17.881863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb6ea58-4909-4a60-a7b3-d3b7dfb0282b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:17.892357 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb6ea58-4909-4a60-a7b3-d3b7dfb0282b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-acb6ea58-4909-4a60-a7b3-d3b7dfb0282b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 01 14:12:17.898242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:17.899379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:17.900449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:17.900449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:17.900449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:17.900449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:17.900449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 01 14:12:17.900449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 01 14:12:17.900449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 01 14:12:17.900449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 01 14:12:17.900449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 01 14:12:17.900449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 01 14:12:17.900449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 01 14:12:17.900449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:17.900449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 644/1276] 10.222.0.70 () {56 vars in 1096 bytes} [Mon Aug 1 14:12:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:17.905965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5424a-ee11-4a2e-b836-c5f4d9c1d5bc None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:17.986923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:18.006235 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee5424a-ee11-4a2e-b836-c5f4d9c1d5bc None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:18.040338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e652e5c-80ea-49bf-acd1-cc362c209572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:18.040950 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e652e5c-80ea-49bf-acd1-cc362c209572 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:18.041229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e652e5c-80ea-49bf-acd1-cc362c209572 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:18.041500 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e652e5c-80ea-49bf-acd1-cc362c209572 None admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:18.042233 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e652e5c-80ea-49bf-acd1-cc362c209572 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:18.042606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e652e5c-80ea-49bf-acd1-cc362c209572 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:18.044006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e652e5c-80ea-49bf-acd1-cc362c209572 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:18.052104 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 633/1277] 10.222.0.70 () {56 vars in 1099 bytes} [Mon Aug 1 14:12:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:18.057788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6ea58-4909-4a60-a7b3-d3b7dfb0282b None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:18.156000 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb6ea58-4909-4a60-a7b3-d3b7dfb0282b None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:18.188319 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1daad-4eb5-45e0-b4e3-80cb338b0978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:18.188936 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1daad-4eb5-45e0-b4e3-80cb338b0978 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:18.189215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1daad-4eb5-45e0-b4e3-80cb338b0978 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:18.189488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f1daad-4eb5-45e0-b4e3-80cb338b0978 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:18.200423 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1daad-4eb5-45e0-b4e3-80cb338b0978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:18.201856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f1daad-4eb5-45e0-b4e3-80cb338b0978 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:18.215900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-e6f1daad-4eb5-45e0-b4e3-80cb338b0978 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:18.215900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:18.215900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:18.215900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:18.215900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:18.215900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:18.215900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:18.215900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:18.215900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:18.215900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:18.215900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:18.215900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:18.215900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:12:18.215900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:12:18.215900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:18.216768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:18.217720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:12:18.217720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:12:18.217720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:18.217720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:18.217720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 645/1278] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:12:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:18.222685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e652e5c-80ea-49bf-acd1-cc362c209572 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:18.319075 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e652e5c-80ea-49bf-acd1-cc362c209572 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:18.351510 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fda676-69ca-4bee-94f2-9575e81486b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:18.352103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fda676-69ca-4bee-94f2-9575e81486b6 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:18.352376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fda676-69ca-4bee-94f2-9575e81486b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:18.352641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fda676-69ca-4bee-94f2-9575e81486b6 None admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:18.353311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fda676-69ca-4bee-94f2-9575e81486b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:18.353605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fda676-69ca-4bee-94f2-9575e81486b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:18.355032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15fda676-69ca-4bee-94f2-9575e81486b6 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:18.366258 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 634/1279] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:12:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:18.372256 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1daad-4eb5-45e0-b4e3-80cb338b0978 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:18.402835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:18.471842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f1daad-4eb5-45e0-b4e3-80cb338b0978 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:18.504938 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdfbca-4572-44de-993b-1809ec656eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:18.505564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdfbca-4572-44de-993b-1809ec656eff None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:18.505847 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdfbca-4572-44de-993b-1809ec656eff None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:18.506121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bdfbca-4572-44de-993b-1809ec656eff None admin] PATH_INFO: `/v3/users/placement` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:18.513299 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdfbca-4572-44de-993b-1809ec656eff None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:18.514761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bdfbca-4572-44de-993b-1809ec656eff None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-91bdfbca-4572-44de-993b-1809ec656eff None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 01 14:12:18.525673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:18.526822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:18.527844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:18.527844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:18.527844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 01 14:12:18.527844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 01 14:12:18.527844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 01 14:12:18.527844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 01 14:12:18.527844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 01 14:12:18.527844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 01 14:12:18.527844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 01 14:12:18.527844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:18.527844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 646/1280] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:12:18 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:18.532587 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fda676-69ca-4bee-94f2-9575e81486b6 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:18.536336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:18.630468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15fda676-69ca-4bee-94f2-9575e81486b6 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:18.669273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80c6c7-1655-4052-8de5-906df274be42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:18.669883 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80c6c7-1655-4052-8de5-906df274be42 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:18.670182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80c6c7-1655-4052-8de5-906df274be42 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:18.670452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80c6c7-1655-4052-8de5-906df274be42 None admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:18.671298 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80c6c7-1655-4052-8de5-906df274be42 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:18.671603 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80c6c7-1655-4052-8de5-906df274be42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:18.673056 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80c6c7-1655-4052-8de5-906df274be42 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:18.690297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 635/1281] 10.222.0.70 () {56 vars in 1143 bytes} [Mon Aug 1 14:12:18 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:18.696064 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdfbca-4572-44de-993b-1809ec656eff None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:18.793502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:18.803359 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bdfbca-4572-44de-993b-1809ec656eff None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:18.836422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f6b76-ca7e-489e-9f69-8c1cf1cb2824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:18.837027 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f6b76-ca7e-489e-9f69-8c1cf1cb2824 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:18.837309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f6b76-ca7e-489e-9f69-8c1cf1cb2824 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:18.837580 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042f6b76-ca7e-489e-9f69-8c1cf1cb2824 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:18.902955 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f6b76-ca7e-489e-9f69-8c1cf1cb2824 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:18.904396 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042f6b76-ca7e-489e-9f69-8c1cf1cb2824 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:18.990415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:19.001135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 647/1282] 10.222.0.70 () {58 vars in 1282 bytes} [Mon Aug 1 14:12:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 01 14:12:19.006972 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80c6c7-1655-4052-8de5-906df274be42 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:19.067595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:19.106530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80c6c7-1655-4052-8de5-906df274be42 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:19.138726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a0f97-a138-410e-9b2a-c3b79ecc7725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:19.139353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a0f97-a138-410e-9b2a-c3b79ecc7725 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:19.139632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a0f97-a138-410e-9b2a-c3b79ecc7725 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:19.139902 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9a0f97-a138-410e-9b2a-c3b79ecc7725 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:19.149550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a0f97-a138-410e-9b2a-c3b79ecc7725 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:19.151027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9a0f97-a138-410e-9b2a-c3b79ecc7725 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:19.170987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-4f9a0f97-a138-410e-9b2a-c3b79ecc7725 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:19.170987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:19.170987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:19.170987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:19.170987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:19.170987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:19.170987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:19.170987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:19.170987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:19.170987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:19.170987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:19.170987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:19.170987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 01 14:12:19.170987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 01 14:12:19.170987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:19.172097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:19.173253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 01 14:12:19.173253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 01 14:12:19.173253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 01 14:12:19.173253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:12:19.173253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 636/1283] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:12:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:19.177958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f6b76-ca7e-489e-9f69-8c1cf1cb2824 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:19.274745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042f6b76-ca7e-489e-9f69-8c1cf1cb2824 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:19.307300 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2701726-3b37-454b-b06b-349ea2b0c451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:19.308435 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2701726-3b37-454b-b06b-349ea2b0c451 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:19.308711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2701726-3b37-454b-b06b-349ea2b0c451 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:19.308983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2701726-3b37-454b-b06b-349ea2b0c451 None admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:19.309659 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2701726-3b37-454b-b06b-349ea2b0c451 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:19.309959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2701726-3b37-454b-b06b-349ea2b0c451 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:19.311340 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2701726-3b37-454b-b06b-349ea2b0c451 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:19.322224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 648/1284] 10.222.0.70 () {56 vars in 1109 bytes} [Mon Aug 1 14:12:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:19.327821 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a0f97-a138-410e-9b2a-c3b79ecc7725 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:19.425609 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9a0f97-a138-410e-9b2a-c3b79ecc7725 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:19.439234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:19.458868 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb414a26-c73e-4b80-80c3-b909494f295e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:19.459491 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb414a26-c73e-4b80-80c3-b909494f295e None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:19.459768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb414a26-c73e-4b80-80c3-b909494f295e None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:19.460037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb414a26-c73e-4b80-80c3-b909494f295e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:19.466450 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb414a26-c73e-4b80-80c3-b909494f295e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:19.467924 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb414a26-c73e-4b80-80c3-b909494f295e None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:19.478942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application [None req-cb414a26-c73e-4b80-80c3-b909494f295e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:12:19.478942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:19.478942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:19.478942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:19.478942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:19.478942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:19.478942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:19.478942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:19.478942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:19.478942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:19.478942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:19.478942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:19.478942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 01 14:12:19.478942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 01 14:12:19.478942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:19.480502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:19.481627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 01 14:12:19.481627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 01 14:12:19.481627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 01 14:12:19.481627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 01 14:12:19.481627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 01 14:12:19.481627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 01 14:12:19.481627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 01 14:12:19.481627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: ERROR keystone.server.flask.application Aug 01 14:12:19.481627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 637/1285] 10.222.0.70 () {56 vars in 1111 bytes} [Mon Aug 1 14:12:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:19.488116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2701726-3b37-454b-b06b-349ea2b0c451 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:19.536592 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:19.586297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2701726-3b37-454b-b06b-349ea2b0c451 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:19.619479 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4daeffe1-55c8-4174-b7b5-666d574804e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:19.620119 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeffe1-55c8-4174-b7b5-666d574804e7 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:19.620396 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeffe1-55c8-4174-b7b5-666d574804e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:19.620666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4daeffe1-55c8-4174-b7b5-666d574804e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:19.621402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daeffe1-55c8-4174-b7b5-666d574804e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:19.621703 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daeffe1-55c8-4174-b7b5-666d574804e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:19.623161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4daeffe1-55c8-4174-b7b5-666d574804e7 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:19.634975 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 649/1286] 10.222.0.70 () {56 vars in 1148 bytes} [Mon Aug 1 14:12:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:19.641579 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb414a26-c73e-4b80-80c3-b909494f295e None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:19.741121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb414a26-c73e-4b80-80c3-b909494f295e None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:19.773071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffca66c-85a5-4367-b643-d0a25908d448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:19.773667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffca66c-85a5-4367-b643-d0a25908d448 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:19.773941 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffca66c-85a5-4367-b643-d0a25908d448 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:19.774212 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffca66c-85a5-4367-b643-d0a25908d448 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:19.775006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffca66c-85a5-4367-b643-d0a25908d448 None admin] RBAC: Adding query filter params (role.id=0681632796d144f6a7ac8eca157001ec, scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b, user.id=e210ee6c390849e7a630a677ec52e966) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:19.775306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffca66c-85a5-4367-b643-d0a25908d448 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:19.777269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffca66c-85a5-4367-b643-d0a25908d448 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:19.782971 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 638/1287] 10.222.0.70 () {56 vars in 1374 bytes} [Mon Aug 1 14:12:19 2022] GET /identity/v3/role_assignments?user.id=e210ee6c390849e7a630a677ec52e966&scope.project.id=c8bcd31836684fe5b43fd604df3d3e8b&role.id=0681632796d144f6a7ac8eca157001ec => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:21.785443 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a424cc-370c-4309-bd43-3e742dbc6d7c None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:21.786102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a424cc-370c-4309-bd43-3e742dbc6d7c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:21.786102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a424cc-370c-4309-bd43-3e742dbc6d7c None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:21.787362 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 650/1288] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:21.792388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fb8d0-09a0-4530-9245-7b84112e612c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:21.792781 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fb8d0-09a0-4530-9245-7b84112e612c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:21.792929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297fb8d0-09a0-4530-9245-7b84112e612c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:21.810495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-297fb8d0-09a0-4530-9245-7b84112e612c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:21.811678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-297fb8d0-09a0-4530-9245-7b84112e612c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:21.840960 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:21.876689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 639/1289] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:12:21.899313 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a424cc-370c-4309-bd43-3e742dbc6d7c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:22.001862 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a424cc-370c-4309-bd43-3e742dbc6d7c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:22.013124 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:22.036199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1ef94-f995-4334-99ea-4afbd36002d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:22.036773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1ef94-f995-4334-99ea-4afbd36002d0 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:22.037052 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1ef94-f995-4334-99ea-4afbd36002d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:22.037325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f1ef94-f995-4334-99ea-4afbd36002d0 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:22.037945 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1ef94-f995-4334-99ea-4afbd36002d0 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:22.039332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f1ef94-f995-4334-99ea-4afbd36002d0 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-37f1ef94-f995-4334-99ea-4afbd36002d0 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:22.048014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:22.049248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:22.050426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:22.050426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:22.050426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:22.050426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:22.050426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:22.050426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:22.050426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:22.050426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:22.050426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:22.050426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:22.050426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:12:22.050426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:12:22.050426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:12:22.050426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:22.050426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 651/1290] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 1 14:12:21 2022] GET /identity/v3/services/placement => generated 90 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:22.055151 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fb8d0-09a0-4530-9245-7b84112e612c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:22.151505 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297fb8d0-09a0-4530-9245-7b84112e612c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:22.184230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1156bf4-5220-4a0e-b5df-649ca592fdfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:22.184834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1156bf4-5220-4a0e-b5df-649ca592fdfe None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:22.185111 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1156bf4-5220-4a0e-b5df-649ca592fdfe None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:22.185381 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1156bf4-5220-4a0e-b5df-649ca592fdfe None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:22.186039 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1156bf4-5220-4a0e-b5df-649ca592fdfe None admin] RBAC: Adding query filter params (name=placement) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:22.186336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1156bf4-5220-4a0e-b5df-649ca592fdfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:22.187744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1156bf4-5220-4a0e-b5df-649ca592fdfe None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:22.192412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 640/1291] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Aug 1 14:12:22 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:22.198873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1ef94-f995-4334-99ea-4afbd36002d0 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:22.296759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f1ef94-f995-4334-99ea-4afbd36002d0 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:22.330095 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba49ea9-699c-4385-8baa-8adf283b2c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:22.330726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba49ea9-699c-4385-8baa-8adf283b2c71 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:22.331010 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba49ea9-699c-4385-8baa-8adf283b2c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:22.331284 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba49ea9-699c-4385-8baa-8adf283b2c71 None admin] PATH_INFO: `/v3/services` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:22.331947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba49ea9-699c-4385-8baa-8adf283b2c71 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:22.332250 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba49ea9-699c-4385-8baa-8adf283b2c71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:22.333865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba49ea9-699c-4385-8baa-8adf283b2c71 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:22.338199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 652/1292] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Aug 1 14:12:22 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:24.346178 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277d0db-679f-4383-b139-31c0027b6e8c None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:24.346752 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277d0db-679f-4383-b139-31c0027b6e8c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:24.346752 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8277d0db-679f-4383-b139-31c0027b6e8c None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:24.348083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 641/1293] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:24.352995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b607d0e-c248-4568-9494-37b56c48608e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:24.353432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b607d0e-c248-4568-9494-37b56c48608e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:24.353542 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b607d0e-c248-4568-9494-37b56c48608e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:24.372000 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8b607d0e-c248-4568-9494-37b56c48608e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:24.373180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8b607d0e-c248-4568-9494-37b56c48608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:24.402328 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:24.439773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 653/1294] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:12:24.462208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277d0db-679f-4383-b139-31c0027b6e8c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:24.493172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:24.561670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8277d0db-679f-4383-b139-31c0027b6e8c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:24.595330 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff40e96-b872-41f2-b644-07125ad25f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:24.595936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff40e96-b872-41f2-b644-07125ad25f0b None admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:24.596267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff40e96-b872-41f2-b644-07125ad25f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:24.596491 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff40e96-b872-41f2-b644-07125ad25f0b None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:24.597163 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff40e96-b872-41f2-b644-07125ad25f0b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:24.598541 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff40e96-b872-41f2-b644-07125ad25f0b None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:24.612470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 642/1295] 10.222.0.70 () {60 vars in 1141 bytes} [Mon Aug 1 14:12:24 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:12:26.633211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e31071-3669-4e1f-a7b4-af2c2b47ba7d None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:26.633788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e31071-3669-4e1f-a7b4-af2c2b47ba7d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:26.633788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e31071-3669-4e1f-a7b4-af2c2b47ba7d None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:26.635990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 654/1296] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:12:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:26.642387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6999877-ee60-4ea4-a20e-533ba2a78b87 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:26.642940 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6999877-ee60-4ea4-a20e-533ba2a78b87 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:26.643106 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6999877-ee60-4ea4-a20e-533ba2a78b87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:26.665499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c6999877-ee60-4ea4-a20e-533ba2a78b87 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:26.667108 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c6999877-ee60-4ea4-a20e-533ba2a78b87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:26.755114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 643/1297] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:26 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:12:26.777235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e31071-3669-4e1f-a7b4-af2c2b47ba7d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:26.881298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e31071-3669-4e1f-a7b4-af2c2b47ba7d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:26.914276 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa968734-a21c-4df6-b44e-e7e0cd3727e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:26.914874 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa968734-a21c-4df6-b44e-e7e0cd3727e6 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:26.915151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa968734-a21c-4df6-b44e-e7e0cd3727e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:26.915421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa968734-a21c-4df6-b44e-e7e0cd3727e6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:26.916035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa968734-a21c-4df6-b44e-e7e0cd3727e6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:26.917896 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa968734-a21c-4df6-b44e-e7e0cd3727e6 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-fa968734-a21c-4df6-b44e-e7e0cd3727e6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:26.926466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:26.927651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:26.929065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:26.929065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:26.929065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:26.929065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:26.929065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:26.929065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:26.929065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:26.929065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:26.929065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:26.929065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:26.929065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:12:26.929065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:12:26.929065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:12:26.929065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:26.929065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 655/1298] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 1 14:12:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:26.934297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6999877-ee60-4ea4-a20e-533ba2a78b87 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:26.952131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:27.032470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6999877-ee60-4ea4-a20e-533ba2a78b87 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:27.065978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c42cfc-8839-4180-822b-9c39f2d696d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:27.066607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c42cfc-8839-4180-822b-9c39f2d696d2 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:27.066890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c42cfc-8839-4180-822b-9c39f2d696d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:27.067159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c42cfc-8839-4180-822b-9c39f2d696d2 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:27.067828 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c42cfc-8839-4180-822b-9c39f2d696d2 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:27.068126 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c42cfc-8839-4180-822b-9c39f2d696d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:27.069495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c42cfc-8839-4180-822b-9c39f2d696d2 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:27.074520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 644/1299] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Aug 1 14:12:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:27.080475 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa968734-a21c-4df6-b44e-e7e0cd3727e6 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:27.115376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:27.183001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa968734-a21c-4df6-b44e-e7e0cd3727e6 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:27.216405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe69265-0825-4334-9f85-9c3ce15e017c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:27.217004 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe69265-0825-4334-9f85-9c3ce15e017c None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:27.217283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe69265-0825-4334-9f85-9c3ce15e017c None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:27.217603 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe69265-0825-4334-9f85-9c3ce15e017c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:27.218347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe69265-0825-4334-9f85-9c3ce15e017c None admin] RBAC: Adding query filter params (interface=public, service_id=b06a88bdd0274b9c9e933ab06827e941, region_id=RegionOne) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:27.218691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe69265-0825-4334-9f85-9c3ce15e017c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:27.220046 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe69265-0825-4334-9f85-9c3ce15e017c None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:27.224989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 656/1300] 10.222.0.70 () {56 vars in 1251 bytes} [Mon Aug 1 14:12:27 2022] GET /identity/v3/endpoints?service_id=b06a88bdd0274b9c9e933ab06827e941&interface=public®ion_id=RegionOne => generated 194 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:27.231331 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c42cfc-8839-4180-822b-9c39f2d696d2 None admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:27.314339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:27.332005 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c42cfc-8839-4180-822b-9c39f2d696d2 None admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:27.366054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf01cffd-f8b5-4bc3-a679-074afd6eddfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:27.366694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01cffd-f8b5-4bc3-a679-074afd6eddfe None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:27.366976 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01cffd-f8b5-4bc3-a679-074afd6eddfe None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:27.367251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf01cffd-f8b5-4bc3-a679-074afd6eddfe None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:27.367894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01cffd-f8b5-4bc3-a679-074afd6eddfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:27.369271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf01cffd-f8b5-4bc3-a679-074afd6eddfe None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:27.376038 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 645/1301] 10.222.0.70 () {56 vars in 1087 bytes} [Mon Aug 1 14:12:27 2022] GET /identity/v3/services => generated 2191 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:12:29.377227 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5da1f0-2ecf-4074-a9b6-85952d838629 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:29.377773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5da1f0-2ecf-4074-a9b6-85952d838629 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:29.377773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5da1f0-2ecf-4074-a9b6-85952d838629 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:29.379171 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 657/1302] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:12:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:12:29.384244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d0cd4-33c4-42dc-9b63-e78aabbb7886 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:29.384669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d0cd4-33c4-42dc-9b63-e78aabbb7886 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:29.384796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035d0cd4-33c4-42dc-9b63-e78aabbb7886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:29.403089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-035d0cd4-33c4-42dc-9b63-e78aabbb7886 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:12:29.404275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-035d0cd4-33c4-42dc-9b63-e78aabbb7886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:12:29.469079 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 646/1303] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:12:29 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 01 14:12:29.491106 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5da1f0-2ecf-4074-a9b6-85952d838629 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:29.583611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:29.590565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5da1f0-2ecf-4074-a9b6-85952d838629 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:29.622756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5593a-9649-4843-806a-8c724112af59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:29.623372 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5593a-9649-4843-806a-8c724112af59 None admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:29.623647 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5593a-9649-4843-806a-8c724112af59 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:29.623916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b5593a-9649-4843-806a-8c724112af59 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:29.624525 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5593a-9649-4843-806a-8c724112af59 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:29.625867 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b5593a-9649-4843-806a-8c724112af59 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application [None req-62b5593a-9649-4843-806a-8c724112af59 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 01 14:12:29.636558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 01 14:12:29.637590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.get_or_create( Aug 01 14:12:29.638687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 01 14:12:29.638687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application with Lock( Aug 01 14:12:29.638687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 01 14:12:29.638687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self._enter() Aug 01 14:12:29.638687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 01 14:12:29.638687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 01 14:12:29.638687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 01 14:12:29.638687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application return self.creator() Aug 01 14:12:29.638687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 01 14:12:29.638687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application created_value = creator( Aug 01 14:12:29.638687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 01 14:12:29.638687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 01 14:12:29.638687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 01 14:12:29.638687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: ERROR keystone.server.flask.application Aug 01 14:12:29.638687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 658/1304] 10.222.0.70 () {56 vars in 1117 bytes} [Mon Aug 1 14:12:29 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 01 14:12:29.644428 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d0cd4-33c4-42dc-9b63-e78aabbb7886 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:29.720772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:29.743902 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035d0cd4-33c4-42dc-9b63-e78aabbb7886 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:29.777117 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1505a0e7-7a3a-4e5e-b5db-bd348e9b5c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:29.777735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505a0e7-7a3a-4e5e-b5db-bd348e9b5c17 None admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:29.778016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505a0e7-7a3a-4e5e-b5db-bd348e9b5c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:29.778289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1505a0e7-7a3a-4e5e-b5db-bd348e9b5c17 None admin] PATH_INFO: `/v3/services` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:29.779272 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505a0e7-7a3a-4e5e-b5db-bd348e9b5c17 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:12:29.779819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505a0e7-7a3a-4e5e-b5db-bd348e9b5c17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:29.781882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1505a0e7-7a3a-4e5e-b5db-bd348e9b5c17 None admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:29.788744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 647/1305] 10.222.0.70 () {56 vars in 1116 bytes} [Mon Aug 1 14:12:29 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:12:29.797462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5593a-9649-4843-806a-8c724112af59 None admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:12:29.894819 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b5593a-9649-4843-806a-8c724112af59 None admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:12:29.927430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e683184c-3468-4e16-8af2-db4650a20a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:12:29.928029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683184c-3468-4e16-8af2-db4650a20a68 None admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:12:29.928310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683184c-3468-4e16-8af2-db4650a20a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:12:29.928580 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e683184c-3468-4e16-8af2-db4650a20a68 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:12:29.929268 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683184c-3468-4e16-8af2-db4650a20a68 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:12:29.930654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e683184c-3468-4e16-8af2-db4650a20a68 None admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:12:29.950843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 659/1306] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:12:29 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:12:39.785204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=30 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:12:39.945892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:33.360877 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801110ce-d740-46ba-8473-8f9b781fcc0b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:33.361303 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801110ce-d740-46ba-8473-8f9b781fcc0b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:33.361303 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801110ce-d740-46ba-8473-8f9b781fcc0b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:33.368254 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdd2a8-f410-4f59-b07c-e0901ba61c33 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:33.368652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdd2a8-f410-4f59-b07c-e0901ba61c33 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:33.368835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fdd2a8-f410-4f59-b07c-e0901ba61c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:33.371715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 648/1307] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:13:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:33.480827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a1fdd2a8-f410-4f59-b07c-e0901ba61c33 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:33.482086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a1fdd2a8-f410-4f59-b07c-e0901ba61c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:33.602032 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 660/1308] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:33.653497 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d4f8b-ee54-4516-8cd2-73501a59c483 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:33.653805 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d4f8b-ee54-4516-8cd2-73501a59c483 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:33.654192 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d4f8b-ee54-4516-8cd2-73501a59c483 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:33.656022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 649/1309] 10.222.0.70 () {54 vars in 965 bytes} [Mon Aug 1 14:13:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:33.662452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d71c2-487d-489e-897d-cfda2865ff64 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:33.662810 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d71c2-487d-489e-897d-cfda2865ff64 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:33.663089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9d71c2-487d-489e-897d-cfda2865ff64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:33.741666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2b9d71c2-487d-489e-897d-cfda2865ff64 None None] MFA Rules not processed for user `33fcc673845943fc96bc18f011639716`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:33.742968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2b9d71c2-487d-489e-897d-cfda2865ff64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:33.765505 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:33.824815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 661/1310] 10.222.0.70 () {58 vars in 1062 bytes} [Mon Aug 1 14:13:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:33.834080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d4f8b-ee54-4516-8cd2-73501a59c483 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:33.836428 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c49d4f8b-ee54-4516-8cd2-73501a59c483 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:33.948348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d4f8b-ee54-4516-8cd2-73501a59c483 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:34.030355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ee6a43-44dc-4a55-95c3-80fc4c3944c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:34.031042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee6a43-44dc-4a55-95c3-80fc4c3944c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:34.031321 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee6a43-44dc-4a55-95c3-80fc4c3944c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:34.031592 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee6a43-44dc-4a55-95c3-80fc4c3944c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:34.033285 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-09ee6a43-44dc-4a55-95c3-80fc4c3944c2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:34.097486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:34.158370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee6a43-44dc-4a55-95c3-80fc4c3944c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:34.159866 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ee6a43-44dc-4a55-95c3-80fc4c3944c2 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:34.179820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 650/1311] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:36.477206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e2acd-b042-4686-ac6f-d004598c59c1 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:36.477747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e2acd-b042-4686-ac6f-d004598c59c1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:36.477747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e2acd-b042-4686-ac6f-d004598c59c1 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:36.480435 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 662/1312] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:13:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:36.484796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd73625-a083-4676-b55a-69cd0a58f5d2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:36.485246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd73625-a083-4676-b55a-69cd0a58f5d2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:36.485714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd73625-a083-4676-b55a-69cd0a58f5d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:36.560079 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8bd73625-a083-4676-b55a-69cd0a58f5d2 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:36.561282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8bd73625-a083-4676-b55a-69cd0a58f5d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:36.666185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 651/1313] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:13:36.704166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e2acd-b042-4686-ac6f-d004598c59c1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:36.705702 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f41e2acd-b042-4686-ac6f-d004598c59c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:36.816831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e2acd-b042-4686-ac6f-d004598c59c1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:36.895318 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:36.898612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3f4bb9-42f7-4305-b595-9b688f19aa1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:36.899249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f4bb9-42f7-4305-b595-9b688f19aa1a service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:36.899768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f4bb9-42f7-4305-b595-9b688f19aa1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:36.900197 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3f4bb9-42f7-4305-b595-9b688f19aa1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:36.902070 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2e3f4bb9-42f7-4305-b595-9b688f19aa1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:37.013540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f4bb9-42f7-4305-b595-9b688f19aa1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:37.015018 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3f4bb9-42f7-4305-b595-9b688f19aa1a service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:37.033900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 663/1314] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:39.378960 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efb6e8-32a9-4382-87c7-cdcb334f9ef0 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:39.379492 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efb6e8-32a9-4382-87c7-cdcb334f9ef0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:39.379492 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4efb6e8-32a9-4382-87c7-cdcb334f9ef0 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:39.380864 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 652/1315] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:39.386816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f75bcc-8201-44b4-89aa-78e93d31c281 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:39.387225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f75bcc-8201-44b4-89aa-78e93d31c281 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:39.387373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f75bcc-8201-44b4-89aa-78e93d31c281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:39.451714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-62f75bcc-8201-44b4-89aa-78e93d31c281 None None] MFA Rules not processed for user `c37e568c83a64a37acb7f86a4a1011b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:39.452922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-62f75bcc-8201-44b4-89aa-78e93d31c281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:39.508246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:39.552621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 664/1316] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:39 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:39.592927 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efb6e8-32a9-4382-87c7-cdcb334f9ef0 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:39.594473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f4efb6e8-32a9-4382-87c7-cdcb334f9ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:39.604639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:39.698213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4efb6e8-32a9-4382-87c7-cdcb334f9ef0 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:39.770486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc662b-2e20-4322-9ad3-d7f477eb512e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:39.771113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc662b-2e20-4322-9ad3-d7f477eb512e service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:39.771390 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc662b-2e20-4322-9ad3-d7f477eb512e service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:39.771668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc662b-2e20-4322-9ad3-d7f477eb512e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:39.773270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dcbc662b-2e20-4322-9ad3-d7f477eb512e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:39.839441 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:39.886824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc662b-2e20-4322-9ad3-d7f477eb512e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:39.888272 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbc662b-2e20-4322-9ad3-d7f477eb512e service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:39.906372 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 653/1317] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:39 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:42.495749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b199705-cca8-44a7-ab65-4023eaadf18a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:42.496305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b199705-cca8-44a7-ab65-4023eaadf18a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:42.496492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b199705-cca8-44a7-ab65-4023eaadf18a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:42.497897 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 665/1318] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:42.502953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f119252-90b9-4b29-b36a-8062a6a2cbae None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:42.503400 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f119252-90b9-4b29-b36a-8062a6a2cbae None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:42.503498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f119252-90b9-4b29-b36a-8062a6a2cbae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:42.569582 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2f119252-90b9-4b29-b36a-8062a6a2cbae None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:42.570810 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2f119252-90b9-4b29-b36a-8062a6a2cbae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:42.666849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 654/1319] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:42 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:42.705110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b199705-cca8-44a7-ab65-4023eaadf18a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:42.706985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6b199705-cca8-44a7-ab65-4023eaadf18a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:42.815027 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b199705-cca8-44a7-ab65-4023eaadf18a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:42.887793 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722e74eb-b76b-4843-a10a-7dd0dc2e3708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:42.888409 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e74eb-b76b-4843-a10a-7dd0dc2e3708 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:42.888688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e74eb-b76b-4843-a10a-7dd0dc2e3708 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:42.888963 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722e74eb-b76b-4843-a10a-7dd0dc2e3708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:42.890628 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-722e74eb-b76b-4843-a10a-7dd0dc2e3708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:42.897859 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:42.997229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e74eb-b76b-4843-a10a-7dd0dc2e3708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:42.998739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722e74eb-b76b-4843-a10a-7dd0dc2e3708 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:43.018516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 666/1320] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:42 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:45.696622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d85b55-bde3-4cb3-9fa5-9797d44f7307 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:45.697175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d85b55-bde3-4cb3-9fa5-9797d44f7307 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:45.697175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d85b55-bde3-4cb3-9fa5-9797d44f7307 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:45.698502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 655/1321] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:45.703620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e540d-5c92-4ed9-b06b-86b471125d27 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:45.704038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e540d-5c92-4ed9-b06b-86b471125d27 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:45.704309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025e540d-5c92-4ed9-b06b-86b471125d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:45.769572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-025e540d-5c92-4ed9-b06b-86b471125d27 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:45.770798 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-025e540d-5c92-4ed9-b06b-86b471125d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:45.838703 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:45.883433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 667/1322] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:45.936141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b10693-65e9-4aeb-8032-7aef2d9ea080 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:45.936520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b10693-65e9-4aeb-8032-7aef2d9ea080 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:45.936867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b10693-65e9-4aeb-8032-7aef2d9ea080 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:45.938305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 656/1323] 10.222.0.70 () {54 vars in 965 bytes} [Mon Aug 1 14:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:45.944731 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3938fe5-a07b-44df-82b0-ae0e2f27df3a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:45.945153 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3938fe5-a07b-44df-82b0-ae0e2f27df3a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:45.945502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3938fe5-a07b-44df-82b0-ae0e2f27df3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:46.027863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a3938fe5-a07b-44df-82b0-ae0e2f27df3a None None] MFA Rules not processed for user `33fcc673845943fc96bc18f011639716`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:46.029053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a3938fe5-a07b-44df-82b0-ae0e2f27df3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:46.104746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 668/1324] 10.222.0.70 () {58 vars in 1062 bytes} [Mon Aug 1 14:13:45 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:46.113637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b10693-65e9-4aeb-8032-7aef2d9ea080 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:46.115171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b1b10693-65e9-4aeb-8032-7aef2d9ea080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:46.138416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:46.225533 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b10693-65e9-4aeb-8032-7aef2d9ea080 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:46.298484 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74810bc9-ac5e-4171-b7fc-1a3e3ba28c2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:46.299143 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74810bc9-ac5e-4171-b7fc-1a3e3ba28c2f service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:46.299424 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74810bc9-ac5e-4171-b7fc-1a3e3ba28c2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:46.299699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74810bc9-ac5e-4171-b7fc-1a3e3ba28c2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:46.301327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-74810bc9-ac5e-4171-b7fc-1a3e3ba28c2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:46.373770 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:46.413724 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74810bc9-ac5e-4171-b7fc-1a3e3ba28c2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:46.415228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74810bc9-ac5e-4171-b7fc-1a3e3ba28c2f service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:46.434765 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 657/1325] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:48.756314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea5be2-9c44-446e-ac67-31f259ddb8ba None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:48.756787 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea5be2-9c44-446e-ac67-31f259ddb8ba None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:48.756912 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea5be2-9c44-446e-ac67-31f259ddb8ba None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:48.758235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 669/1326] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:13:48.763581 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad46f5-3b33-4d60-b96e-6811f771e2a6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:48.764018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad46f5-3b33-4d60-b96e-6811f771e2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:48.764275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbad46f5-3b33-4d60-b96e-6811f771e2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:48.831267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-cbad46f5-3b33-4d60-b96e-6811f771e2a6 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:48.832464 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cbad46f5-3b33-4d60-b96e-6811f771e2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:48.933225 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 658/1327] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:48.969889 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea5be2-9c44-446e-ac67-31f259ddb8ba None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:48.971455 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d4ea5be2-9c44-446e-ac67-31f259ddb8ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:49.035280 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:49.079822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea5be2-9c44-446e-ac67-31f259ddb8ba None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:49.153615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e903a7-91f0-4bcc-9b4b-9a676a43b570 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:49.154344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e903a7-91f0-4bcc-9b4b-9a676a43b570 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:49.154651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e903a7-91f0-4bcc-9b4b-9a676a43b570 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:49.154921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e903a7-91f0-4bcc-9b4b-9a676a43b570 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:49.156603 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-95e903a7-91f0-4bcc-9b4b-9a676a43b570 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:49.266043 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:49.268511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e903a7-91f0-4bcc-9b4b-9a676a43b570 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:49.270245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e903a7-91f0-4bcc-9b4b-9a676a43b570 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:49.289152 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 670/1328] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:13:51.332044 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106c69a-5a68-4efc-aa94-eb732536ecc0 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:51.332583 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106c69a-5a68-4efc-aa94-eb732536ecc0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:51.332583 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c106c69a-5a68-4efc-aa94-eb732536ecc0 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:51.334598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 659/1329] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:51.339649 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a263e7f-1360-40de-bfc7-6c39fa52b910 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:51.340125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a263e7f-1360-40de-bfc7-6c39fa52b910 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:51.340234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a263e7f-1360-40de-bfc7-6c39fa52b910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:51.407402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1a263e7f-1360-40de-bfc7-6c39fa52b910 None None] MFA Rules not processed for user `c37e568c83a64a37acb7f86a4a1011b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:51.410755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1a263e7f-1360-40de-bfc7-6c39fa52b910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:51.506532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 671/1330] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:51 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:51.543957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106c69a-5a68-4efc-aa94-eb732536ecc0 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:51.545563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c106c69a-5a68-4efc-aa94-eb732536ecc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:51.583131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:51.662669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c106c69a-5a68-4efc-aa94-eb732536ecc0 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:51.735547 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc16a2-b259-4729-9cd4-1f84f228a3a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:51.735856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc16a2-b259-4729-9cd4-1f84f228a3a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:51.736132 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc16a2-b259-4729-9cd4-1f84f228a3a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:51.736402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc16a2-b259-4729-9cd4-1f84f228a3a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:51.738025 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bdcc16a2-b259-4729-9cd4-1f84f228a3a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:51.815760 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:51.847702 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc16a2-b259-4729-9cd4-1f84f228a3a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:51.849085 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc16a2-b259-4729-9cd4-1f84f228a3a7 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:51.867480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 660/1331] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:51 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:54.298378 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fd5f7-9093-4b86-b358-530467f9cc2f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:54.298994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fd5f7-9093-4b86-b358-530467f9cc2f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:54.298994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7fd5f7-9093-4b86-b358-530467f9cc2f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:54.300334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 672/1332] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:54.305530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f5ee7-c285-4711-b113-cc0e0f1713d4 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:54.305961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f5ee7-c285-4711-b113-cc0e0f1713d4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:54.306070 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f5ee7-c285-4711-b113-cc0e0f1713d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:54.372306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-777f5ee7-c285-4711-b113-cc0e0f1713d4 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:54.373507 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-777f5ee7-c285-4711-b113-cc0e0f1713d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:54.469727 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 661/1333] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:54.506690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fd5f7-9093-4b86-b358-530467f9cc2f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:54.508238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6a7fd5f7-9093-4b86-b358-530467f9cc2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:54.577124 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:54.610785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7fd5f7-9093-4b86-b358-530467f9cc2f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:54.684405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee43f4a-f9b3-4641-a534-df7afcc444ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:54.685015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43f4a-f9b3-4641-a534-df7afcc444ee service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:54.685293 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43f4a-f9b3-4641-a534-df7afcc444ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:54.685562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee43f4a-f9b3-4641-a534-df7afcc444ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:54.687209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4ee43f4a-f9b3-4641-a534-df7afcc444ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:54.801203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee43f4a-f9b3-4641-a534-df7afcc444ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:54.802711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee43f4a-f9b3-4641-a534-df7afcc444ee service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:54.812659 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:54.821807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 673/1334] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:56.861429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babc6b7-7acf-4ba3-828a-ee1d40abfcde None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:56.861978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babc6b7-7acf-4ba3-828a-ee1d40abfcde None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:56.861978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3babc6b7-7acf-4ba3-828a-ee1d40abfcde None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:56.863350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 662/1335] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:13:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:56.868577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f410261-b6ed-4837-8e35-8c8e72d2fac4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:56.868989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f410261-b6ed-4837-8e35-8c8e72d2fac4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:56.869113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f410261-b6ed-4837-8e35-8c8e72d2fac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:56.934335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4f410261-b6ed-4837-8e35-8c8e72d2fac4 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:56.935577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4f410261-b6ed-4837-8e35-8c8e72d2fac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:57.030782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 674/1336] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:57.070008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babc6b7-7acf-4ba3-828a-ee1d40abfcde None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:57.071576 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3babc6b7-7acf-4ba3-828a-ee1d40abfcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:57.111653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:57.173894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3babc6b7-7acf-4ba3-828a-ee1d40abfcde None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:13:57.245406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9fbc51-0e0a-4e00-983a-43067c10232c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:13:57.246014 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fbc51-0e0a-4e00-983a-43067c10232c service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:57.246293 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fbc51-0e0a-4e00-983a-43067c10232c service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:57.246564 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9fbc51-0e0a-4e00-983a-43067c10232c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:57.248180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ee9fbc51-0e0a-4e00-983a-43067c10232c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:57.329411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:13:57.355578 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fbc51-0e0a-4e00-983a-43067c10232c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:13:57.357034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee9fbc51-0e0a-4e00-983a-43067c10232c service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:13:57.374725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 663/1337] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:13:59.715418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea84259-4709-40a7-8c3b-924c2ba02aca None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:59.715988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea84259-4709-40a7-8c3b-924c2ba02aca None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:59.715988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea84259-4709-40a7-8c3b-924c2ba02aca None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:59.717321 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 675/1338] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:13:59.722367 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff4e67-7e0c-4972-8f14-857c934608a7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:13:59.722831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff4e67-7e0c-4972-8f14-857c934608a7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:13:59.722938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ff4e67-7e0c-4972-8f14-857c934608a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:13:59.788270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b2ff4e67-7e0c-4972-8f14-857c934608a7 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:13:59.789470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b2ff4e67-7e0c-4972-8f14-857c934608a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:13:59.887155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 664/1339] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:13:59 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:13:59.929916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea84259-4709-40a7-8c3b-924c2ba02aca None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:13:59.931479 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dea84259-4709-40a7-8c3b-924c2ba02aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:00.009633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:00.038567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea84259-4709-40a7-8c3b-924c2ba02aca None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:00.113555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94d0c70-34c8-40fa-b785-156d3f824cdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:00.114173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d0c70-34c8-40fa-b785-156d3f824cdd service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:00.114465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d0c70-34c8-40fa-b785-156d3f824cdd service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:00.114762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d0c70-34c8-40fa-b785-156d3f824cdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:00.116391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e94d0c70-34c8-40fa-b785-156d3f824cdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:00.224870 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d0c70-34c8-40fa-b785-156d3f824cdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:00.226837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94d0c70-34c8-40fa-b785-156d3f824cdd service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:00.245092 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 676/1340] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:13:59 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:04.340185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18426bb-35f9-4de3-a564-7fc14bb97659 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:04.340720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18426bb-35f9-4de3-a564-7fc14bb97659 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:04.340720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18426bb-35f9-4de3-a564-7fc14bb97659 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:04.342086 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 665/1341] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:04.347304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9efae-badd-4df6-b367-087ef5e1bcf3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:04.347716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9efae-badd-4df6-b367-087ef5e1bcf3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:04.347852 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be9efae-badd-4df6-b367-087ef5e1bcf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:04.353571 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:04.418467 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0be9efae-badd-4df6-b367-087ef5e1bcf3 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:04.419774 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0be9efae-badd-4df6-b367-087ef5e1bcf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:04.519000 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 677/1342] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:04.559317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18426bb-35f9-4de3-a564-7fc14bb97659 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:04.560892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c18426bb-35f9-4de3-a564-7fc14bb97659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:04.610232 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:04.676766 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18426bb-35f9-4de3-a564-7fc14bb97659 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:04.756562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4927577f-8a3d-4e8d-a9c2-f1a82d630b1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:04.757208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927577f-8a3d-4e8d-a9c2-f1a82d630b1c service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:04.757490 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927577f-8a3d-4e8d-a9c2-f1a82d630b1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:04.757785 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4927577f-8a3d-4e8d-a9c2-f1a82d630b1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:04.759509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4927577f-8a3d-4e8d-a9c2-f1a82d630b1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:04.856195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:04.873786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927577f-8a3d-4e8d-a9c2-f1a82d630b1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:04.875206 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4927577f-8a3d-4e8d-a9c2-f1a82d630b1c service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:04.893348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 666/1343] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:07.546994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd05081-5965-40f9-8227-bbd77d74586b None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:07.547567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd05081-5965-40f9-8227-bbd77d74586b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:07.547567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd05081-5965-40f9-8227-bbd77d74586b None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:07.549251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 678/1344] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:07.555018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f64966-5fbf-41bf-8b5d-c6dc8969de45 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:07.555568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f64966-5fbf-41bf-8b5d-c6dc8969de45 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:07.555568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f64966-5fbf-41bf-8b5d-c6dc8969de45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:07.630867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c9f64966-5fbf-41bf-8b5d-c6dc8969de45 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:07.632101 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c9f64966-5fbf-41bf-8b5d-c6dc8969de45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:07.737064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 667/1345] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:07 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:07.775311 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd05081-5965-40f9-8227-bbd77d74586b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:07.776846 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2cd05081-5965-40f9-8227-bbd77d74586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:07.863652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:07.882416 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd05081-5965-40f9-8227-bbd77d74586b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:07.955801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4cf730-5319-4970-981c-cd812ffe3ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:07.956423 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cf730-5319-4970-981c-cd812ffe3ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:07.956702 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cf730-5319-4970-981c-cd812ffe3ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:07.956973 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4cf730-5319-4970-981c-cd812ffe3ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:07.959285 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5e4cf730-5319-4970-981c-cd812ffe3ae3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:08.071751 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cf730-5319-4970-981c-cd812ffe3ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:08.073193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4cf730-5319-4970-981c-cd812ffe3ae3 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:08.091883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 679/1346] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:07 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:12.369032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212adee5-529c-48cb-8e0f-9a25efa806c0 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:12.369544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212adee5-529c-48cb-8e0f-9a25efa806c0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:12.369675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212adee5-529c-48cb-8e0f-9a25efa806c0 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:12.371106 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 668/1347] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:12.376292 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815f80b-f76f-45e3-b9c9-7ceb9af68bd4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:12.376718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815f80b-f76f-45e3-b9c9-7ceb9af68bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:12.376843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4815f80b-f76f-45e3-b9c9-7ceb9af68bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:12.394106 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:12.470469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4815f80b-f76f-45e3-b9c9-7ceb9af68bd4 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:12.472226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4815f80b-f76f-45e3-b9c9-7ceb9af68bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:12.590830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 680/1348] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:12.630761 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212adee5-529c-48cb-8e0f-9a25efa806c0 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:12.632491 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-212adee5-529c-48cb-8e0f-9a25efa806c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:12.696587 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:12.746040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212adee5-529c-48cb-8e0f-9a25efa806c0 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:12.832157 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f07d810-022a-489e-887f-e8bc657dfd1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:12.832815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07d810-022a-489e-887f-e8bc657dfd1b service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:12.833093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07d810-022a-489e-887f-e8bc657dfd1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:12.833365 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f07d810-022a-489e-887f-e8bc657dfd1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:12.835051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7f07d810-022a-489e-887f-e8bc657dfd1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:12.964510 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:12.971168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07d810-022a-489e-887f-e8bc657dfd1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:12.972727 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f07d810-022a-489e-887f-e8bc657dfd1b service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:13.001640 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 669/1349] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:17.879317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11003e-0370-4827-9970-eb54e653d956 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:17.879317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11003e-0370-4827-9970-eb54e653d956 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:17.879317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b11003e-0370-4827-9970-eb54e653d956 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:17.879317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 681/1350] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 1 14:14:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:17.888203 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd5f98-624a-42bc-849d-c26e2ced0f8e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:17.888712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd5f98-624a-42bc-849d-c26e2ced0f8e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:17.888802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd5f98-624a-42bc-849d-c26e2ced0f8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:17.984827 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-59dd5f98-624a-42bc-849d-c26e2ced0f8e None None] MFA Rules not processed for user `e210ee6c390849e7a630a677ec52e966`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:17.986332 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-59dd5f98-624a-42bc-849d-c26e2ced0f8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:18.104535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 670/1351] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 1 14:14:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:22.228015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fecba-631b-4d13-b18f-0381ddc20111 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:22.228551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fecba-631b-4d13-b18f-0381ddc20111 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:22.228551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22fecba-631b-4d13-b18f-0381ddc20111 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:22.229908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 682/1352] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 1 14:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:22.235066 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d2cc4-1929-45e9-8a89-d42bb1d3d209 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:22.235490 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d2cc4-1929-45e9-8a89-d42bb1d3d209 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:22.235627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8d2cc4-1929-45e9-8a89-d42bb1d3d209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:22.294363 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:22.319535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8b8d2cc4-1929-45e9-8a89-d42bb1d3d209 None None] MFA Rules not processed for user `e210ee6c390849e7a630a677ec52e966`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:22.320735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8b8d2cc4-1929-45e9-8a89-d42bb1d3d209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:22.431387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 671/1353] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 1 14:14:22 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:22.588830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=59 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:23.824019 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47341a1f-3e34-44ae-98a8-7c485f6feef7 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:23.824662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47341a1f-3e34-44ae-98a8-7c485f6feef7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:23.824662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47341a1f-3e34-44ae-98a8-7c485f6feef7 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:23.825917 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 683/1354] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 1 14:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:23.831236 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c3e00-6269-4f0a-ad83-4957b6cb663e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:23.831651 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c3e00-6269-4f0a-ad83-4957b6cb663e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:23.832395 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c3e00-6269-4f0a-ad83-4957b6cb663e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:23.907703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-813c3e00-6269-4f0a-ad83-4957b6cb663e None None] MFA Rules not processed for user `e210ee6c390849e7a630a677ec52e966`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:23.908904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-813c3e00-6269-4f0a-ad83-4957b6cb663e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:23.950112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:24.021264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 672/1355] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 1 14:14:23 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:27.414254 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e46483-94c1-425b-b10c-c983f3ccea27 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:27.415172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e46483-94c1-425b-b10c-c983f3ccea27 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:27.415613 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e46483-94c1-425b-b10c-c983f3ccea27 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:27.420959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 684/1356] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:27.422688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6371b08-c030-4a64-b389-7ccf2f08886e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:27.423541 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6371b08-c030-4a64-b389-7ccf2f08886e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:27.423887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6371b08-c030-4a64-b389-7ccf2f08886e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:27.518478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f6371b08-c030-4a64-b389-7ccf2f08886e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:27.520372 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f6371b08-c030-4a64-b389-7ccf2f08886e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:27.624544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 673/1357] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:27.679432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e415a93-c727-459b-a757-892f2121e9a5 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:27.680228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e415a93-c727-459b-a757-892f2121e9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:27.680828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e415a93-c727-459b-a757-892f2121e9a5 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:27.682970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 685/1358] 10.222.0.70 () {54 vars in 962 bytes} [Mon Aug 1 14:14:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:27.693457 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a0af8-1738-4eb9-be52-8cd166a6d7be None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:27.694190 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a0af8-1738-4eb9-be52-8cd166a6d7be None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:27.695386 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850a0af8-1738-4eb9-be52-8cd166a6d7be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:27.713834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:27.784033 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-850a0af8-1738-4eb9-be52-8cd166a6d7be None None] MFA Rules not processed for user `e856fd5aff914cfb8b8dd86b39c89bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:27.785294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-850a0af8-1738-4eb9-be52-8cd166a6d7be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:27.919206 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 674/1359] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Aug 1 14:14:27 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:14:27.920968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e415a93-c727-459b-a757-892f2121e9a5 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:27.922477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1e415a93-c727-459b-a757-892f2121e9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:28.096440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e415a93-c727-459b-a757-892f2121e9a5 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:28.174358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:28.218177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86730154-3904-4df0-8774-15f24565b39c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:28.218837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86730154-3904-4df0-8774-15f24565b39c service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:28.219116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86730154-3904-4df0-8774-15f24565b39c service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:28.219387 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86730154-3904-4df0-8774-15f24565b39c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:28.221008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-86730154-3904-4df0-8774-15f24565b39c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:28.322549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86730154-3904-4df0-8774-15f24565b39c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:28.325014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86730154-3904-4df0-8774-15f24565b39c service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:28.346607 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 686/1360] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:30.627108 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b205cb-8886-4da5-8f6a-5aa9b2772404 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:30.627618 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b205cb-8886-4da5-8f6a-5aa9b2772404 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:30.627618 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b205cb-8886-4da5-8f6a-5aa9b2772404 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:30.629644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 675/1361] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:30.634795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c7bb9-fe10-4ef7-9136-702c35f9c631 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:30.635218 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c7bb9-fe10-4ef7-9136-702c35f9c631 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:30.635342 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17c7bb9-fe10-4ef7-9136-702c35f9c631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:30.703835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e17c7bb9-fe10-4ef7-9136-702c35f9c631 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:30.705709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e17c7bb9-fe10-4ef7-9136-702c35f9c631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:30.744874 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:30.814825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 687/1362] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:30.855988 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b205cb-8886-4da5-8f6a-5aa9b2772404 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:30.857307 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-61b205cb-8886-4da5-8f6a-5aa9b2772404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:30.941844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:31.045172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b205cb-8886-4da5-8f6a-5aa9b2772404 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:31.172455 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c66691a-9af1-4e96-b74f-4a7406f5b2cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:31.173077 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66691a-9af1-4e96-b74f-4a7406f5b2cd service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:31.173359 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66691a-9af1-4e96-b74f-4a7406f5b2cd service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:31.173885 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c66691a-9af1-4e96-b74f-4a7406f5b2cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:31.175861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2c66691a-9af1-4e96-b74f-4a7406f5b2cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:31.199933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:31.274311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66691a-9af1-4e96-b74f-4a7406f5b2cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:31.276042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c66691a-9af1-4e96-b74f-4a7406f5b2cd service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:31.295919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 676/1363] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:33.674439 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493f9dd-b13f-413d-a77f-d04a72df63aa None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:33.675584 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493f9dd-b13f-413d-a77f-d04a72df63aa None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:33.676077 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f493f9dd-b13f-413d-a77f-d04a72df63aa None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:33.677650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 688/1364] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:33.683434 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef3ccd-8629-4700-9962-91d1b49955ad None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:33.687799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef3ccd-8629-4700-9962-91d1b49955ad None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:33.688104 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ef3ccd-8629-4700-9962-91d1b49955ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:33.770383 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-60ef3ccd-8629-4700-9962-91d1b49955ad None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:33.771577 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-60ef3ccd-8629-4700-9962-91d1b49955ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:33.873417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:33.878679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 677/1365] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:14:33.921918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4286e-76f1-4851-b49e-49c74e174093 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:33.922320 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4286e-76f1-4851-b49e-49c74e174093 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:33.922888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c4286e-76f1-4851-b49e-49c74e174093 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:33.924447 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 689/1366] 10.222.0.70 () {54 vars in 962 bytes} [Mon Aug 1 14:14:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:33.929837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0163d-b0ae-4ac0-8566-04c80efe4767 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:33.930131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0163d-b0ae-4ac0-8566-04c80efe4767 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:33.930405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e0163d-b0ae-4ac0-8566-04c80efe4767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:34.017760 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-87e0163d-b0ae-4ac0-8566-04c80efe4767 None None] MFA Rules not processed for user `e856fd5aff914cfb8b8dd86b39c89bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:34.019572 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-87e0163d-b0ae-4ac0-8566-04c80efe4767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:34.142358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 678/1367] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Aug 1 14:14:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:34.151709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4286e-76f1-4851-b49e-49c74e174093 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:34.153290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-94c4286e-76f1-4851-b49e-49c74e174093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:34.313636 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c4286e-76f1-4851-b49e-49c74e174093 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:34.335657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:34.436608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0dcaf-ceba-4c6c-bbf4-426e24db6671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:34.436608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0dcaf-ceba-4c6c-bbf4-426e24db6671 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:34.436608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0dcaf-ceba-4c6c-bbf4-426e24db6671 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:34.438882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0dcaf-ceba-4c6c-bbf4-426e24db6671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:34.441330 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-36f0dcaf-ceba-4c6c-bbf4-426e24db6671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:34.536407 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0dcaf-ceba-4c6c-bbf4-426e24db6671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:34.538188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0dcaf-ceba-4c6c-bbf4-426e24db6671 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:34.557648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 690/1368] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:14:35.561074 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43905b3-2691-4941-9a5e-8eaffdba729f None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:35.561602 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43905b3-2691-4941-9a5e-8eaffdba729f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:35.561602 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43905b3-2691-4941-9a5e-8eaffdba729f None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:35.563205 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 679/1369] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:35.568136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5f5e1-fd68-405b-9a77-f5e446821fb3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:35.568585 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5f5e1-fd68-405b-9a77-f5e446821fb3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:35.568679 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b5f5e1-fd68-405b-9a77-f5e446821fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:35.601459 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:35.639892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-19b5f5e1-fd68-405b-9a77-f5e446821fb3 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:35.641281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-19b5f5e1-fd68-405b-9a77-f5e446821fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:35.749250 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 691/1370] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:36.099494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee73ec-c8b6-4c23-9a81-afe24dfc8add None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:36.099494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee73ec-c8b6-4c23-9a81-afe24dfc8add None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:36.099494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ee73ec-c8b6-4c23-9a81-afe24dfc8add None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:36.099494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 680/1371] 10.222.0.70 () {54 vars in 964 bytes} [Mon Aug 1 14:14:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:36.104882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdceb3f-12f1-4cdb-9359-802daf407670 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:36.105256 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdceb3f-12f1-4cdb-9359-802daf407670 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:36.105612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdceb3f-12f1-4cdb-9359-802daf407670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:36.191895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ebdceb3f-12f1-4cdb-9359-802daf407670 None None] MFA Rules not processed for user `a41da5d6d38341deaf1563fe0ebac32b`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:36.193209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ebdceb3f-12f1-4cdb-9359-802daf407670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:36.243450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:36.285468 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 692/1372] 10.222.0.70 () {58 vars in 1061 bytes} [Mon Aug 1 14:14:36 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:36.294305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee73ec-c8b6-4c23-9a81-afe24dfc8add None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:36.295907 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-54ee73ec-c8b6-4c23-9a81-afe24dfc8add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:36.358596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:36.417769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ee73ec-c8b6-4c23-9a81-afe24dfc8add None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:36.496285 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a3965e-e641-4c31-a4dd-3827b5cdd107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:36.496906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3965e-e641-4c31-a4dd-3827b5cdd107 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:36.497185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3965e-e641-4c31-a4dd-3827b5cdd107 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:36.497457 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a3965e-e641-4c31-a4dd-3827b5cdd107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:36.499111 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-18a3965e-e641-4c31-a4dd-3827b5cdd107 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:36.605710 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:36.623342 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3965e-e641-4c31-a4dd-3827b5cdd107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:36.625668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a3965e-e641-4c31-a4dd-3827b5cdd107 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:36.648896 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 681/1373] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:36.717733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee8b25-aea4-4c81-a91f-c2efd231e053 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:36.718238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee8b25-aea4-4c81-a91f-c2efd231e053 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:36.718238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ee8b25-aea4-4c81-a91f-c2efd231e053 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:36.719655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 693/1374] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:14:36.725376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb288c-57aa-43a8-8d89-15bceee778c6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:36.725646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb288c-57aa-43a8-8d89-15bceee778c6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:36.725921 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeb288c-57aa-43a8-8d89-15bceee778c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:36.794072 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-3aeb288c-57aa-43a8-8d89-15bceee778c6 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:36.796334 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3aeb288c-57aa-43a8-8d89-15bceee778c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:36.922906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 682/1375] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:36.952487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee8b25-aea4-4c81-a91f-c2efd231e053 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:36.954447 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-87ee8b25-aea4-4c81-a91f-c2efd231e053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:37.120275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ee8b25-aea4-4c81-a91f-c2efd231e053 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:37.171831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:37.235916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb36af15-d711-4db0-8b91-c00a03e1c02e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:37.236539 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36af15-d711-4db0-8b91-c00a03e1c02e service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:37.236819 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36af15-d711-4db0-8b91-c00a03e1c02e service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:37.237111 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36af15-d711-4db0-8b91-c00a03e1c02e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:37.239294 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-eb36af15-d711-4db0-8b91-c00a03e1c02e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:37.329353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36af15-d711-4db0-8b91-c00a03e1c02e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:37.330991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb36af15-d711-4db0-8b91-c00a03e1c02e service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:37.349844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 694/1376] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:39.410272 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dec5b7-b14e-4ad4-b58b-ed78cccf8fe6 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:39.410718 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dec5b7-b14e-4ad4-b58b-ed78cccf8fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:39.410718 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dec5b7-b14e-4ad4-b58b-ed78cccf8fe6 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:39.412059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 683/1377] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:39.417277 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fafc1-a2c1-4573-9f0d-205a987cb7f5 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:39.417739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fafc1-a2c1-4573-9f0d-205a987cb7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:39.417900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659fafc1-a2c1-4573-9f0d-205a987cb7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:39.491216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-659fafc1-a2c1-4573-9f0d-205a987cb7f5 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:39.492431 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-659fafc1-a2c1-4573-9f0d-205a987cb7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:39.499107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:39.597851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 695/1378] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:39.641862 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dec5b7-b14e-4ad4-b58b-ed78cccf8fe6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:39.643968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-45dec5b7-b14e-4ad4-b58b-ed78cccf8fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:39.728487 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:39.817422 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dec5b7-b14e-4ad4-b58b-ed78cccf8fe6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:39.941054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf738fb-fbdd-4e1f-b1e5-9f27ad32df9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:39.941667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf738fb-fbdd-4e1f-b1e5-9f27ad32df9e service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:39.941948 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf738fb-fbdd-4e1f-b1e5-9f27ad32df9e service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:39.942222 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf738fb-fbdd-4e1f-b1e5-9f27ad32df9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:39.943870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bbf738fb-fbdd-4e1f-b1e5-9f27ad32df9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:39.964052 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:40.055871 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf738fb-fbdd-4e1f-b1e5-9f27ad32df9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:40.057505 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf738fb-fbdd-4e1f-b1e5-9f27ad32df9e service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:40.076587 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 684/1379] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:42.170695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb001f-c9e9-4fe9-99c9-b3c03c3d3a62 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:42.171211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb001f-c9e9-4fe9-99c9-b3c03c3d3a62 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:42.171211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cb001f-c9e9-4fe9-99c9-b3c03c3d3a62 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:42.172676 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 696/1380] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:42.177739 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c449b3-4fa6-48d2-b284-8c94f0bffe57 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:42.178171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c449b3-4fa6-48d2-b284-8c94f0bffe57 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:42.178275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c449b3-4fa6-48d2-b284-8c94f0bffe57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:42.257676 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e0c449b3-4fa6-48d2-b284-8c94f0bffe57 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:42.258921 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e0c449b3-4fa6-48d2-b284-8c94f0bffe57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:42.355460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:42.362851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 685/1381] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:42.406970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb001f-c9e9-4fe9-99c9-b3c03c3d3a62 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:42.408729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b4cb001f-c9e9-4fe9-99c9-b3c03c3d3a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:42.568769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:42.581816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cb001f-c9e9-4fe9-99c9-b3c03c3d3a62 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:42.710822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4598f69-05b7-4672-8f84-b0857e686b57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:42.712043 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598f69-05b7-4672-8f84-b0857e686b57 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:42.712708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598f69-05b7-4672-8f84-b0857e686b57 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:42.712894 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4598f69-05b7-4672-8f84-b0857e686b57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:42.715131 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a4598f69-05b7-4672-8f84-b0857e686b57 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:42.813740 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4598f69-05b7-4672-8f84-b0857e686b57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:42.816108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4598f69-05b7-4672-8f84-b0857e686b57 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:42.827284 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:42.837874 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 697/1382] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:44.951900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35c1ef-6ff5-4092-b707-f49f5eb63873 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:44.952451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35c1ef-6ff5-4092-b707-f49f5eb63873 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:44.952557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d35c1ef-6ff5-4092-b707-f49f5eb63873 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:44.954103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 686/1383] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:44.960385 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521015e-57f1-4c21-bc2a-d258d53f5ec3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:44.960851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521015e-57f1-4c21-bc2a-d258d53f5ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:44.960947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7521015e-57f1-4c21-bc2a-d258d53f5ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:45.030212 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7521015e-57f1-4c21-bc2a-d258d53f5ec3 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:45.031450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7521015e-57f1-4c21-bc2a-d258d53f5ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:45.154416 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 698/1384] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:45.205666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35c1ef-6ff5-4092-b707-f49f5eb63873 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:45.207253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7d35c1ef-6ff5-4092-b707-f49f5eb63873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:45.393808 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d35c1ef-6ff5-4092-b707-f49f5eb63873 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:45.468871 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:45.517180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6438fb66-02c7-4423-8b1d-c31d0bd53cde service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:45.517799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438fb66-02c7-4423-8b1d-c31d0bd53cde service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:45.518076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438fb66-02c7-4423-8b1d-c31d0bd53cde service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:45.518350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6438fb66-02c7-4423-8b1d-c31d0bd53cde service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:45.520535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6438fb66-02c7-4423-8b1d-c31d0bd53cde service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:45.621959 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438fb66-02c7-4423-8b1d-c31d0bd53cde service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:45.624618 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6438fb66-02c7-4423-8b1d-c31d0bd53cde service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:45.651482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 687/1385] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:47.900413 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c51e2-71ba-4522-b5b0-4cb80729c5a4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:47.900981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c51e2-71ba-4522-b5b0-4cb80729c5a4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:47.900981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c51e2-71ba-4522-b5b0-4cb80729c5a4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:47.902330 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 699/1386] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:47.907903 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96454f82-63f7-404e-b89b-424fcd212a5d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:47.908304 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96454f82-63f7-404e-b89b-424fcd212a5d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:47.908485 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96454f82-63f7-404e-b89b-424fcd212a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:47.977784 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-96454f82-63f7-404e-b89b-424fcd212a5d None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:47.979125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-96454f82-63f7-404e-b89b-424fcd212a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:48.022099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:48.098185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 688/1387] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:14:48.145763 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c51e2-71ba-4522-b5b0-4cb80729c5a4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:48.147381 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-878c51e2-71ba-4522-b5b0-4cb80729c5a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:48.228612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:48.301172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c51e2-71ba-4522-b5b0-4cb80729c5a4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:48.435306 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102b216-2ac2-4ecc-bdfc-6f84da9e035e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:48.435930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102b216-2ac2-4ecc-bdfc-6f84da9e035e service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:48.436269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102b216-2ac2-4ecc-bdfc-6f84da9e035e service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:48.436544 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102b216-2ac2-4ecc-bdfc-6f84da9e035e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:48.438201 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3102b216-2ac2-4ecc-bdfc-6f84da9e035e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:48.478706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:48.531866 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102b216-2ac2-4ecc-bdfc-6f84da9e035e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:48.533483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3102b216-2ac2-4ecc-bdfc-6f84da9e035e service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:48.552825 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 700/1388] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:14:50.906174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bbda9-ff16-46ca-98f5-f2e17bcdec2c None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:50.906781 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bbda9-ff16-46ca-98f5-f2e17bcdec2c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:50.906781 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659bbda9-ff16-46ca-98f5-f2e17bcdec2c None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:50.908243 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 689/1389] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:50.913847 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b38a29-a7e5-4a7b-a117-c8987228b41c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:50.914280 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b38a29-a7e5-4a7b-a117-c8987228b41c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:50.914471 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b38a29-a7e5-4a7b-a117-c8987228b41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:50.984273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e8b38a29-a7e5-4a7b-a117-c8987228b41c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:50.985522 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e8b38a29-a7e5-4a7b-a117-c8987228b41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:51.090734 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 701/1390] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:51.136248 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bbda9-ff16-46ca-98f5-f2e17bcdec2c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:51.137779 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-659bbda9-ff16-46ca-98f5-f2e17bcdec2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:51.285006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659bbda9-ff16-46ca-98f5-f2e17bcdec2c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:51.301749 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:51.399940 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7b4c59-59c1-4920-a874-94f28bb37ae3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:51.400470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b4c59-59c1-4920-a874-94f28bb37ae3 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:51.400813 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b4c59-59c1-4920-a874-94f28bb37ae3 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:51.401093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7b4c59-59c1-4920-a874-94f28bb37ae3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:51.402769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ab7b4c59-59c1-4920-a874-94f28bb37ae3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:51.494030 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b4c59-59c1-4920-a874-94f28bb37ae3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:51.495688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7b4c59-59c1-4920-a874-94f28bb37ae3 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:51.514264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 690/1391] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:51.991752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659575e3-e2db-4736-b236-3cfa4627054f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:51.992305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659575e3-e2db-4736-b236-3cfa4627054f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:51.992305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659575e3-e2db-4736-b236-3cfa4627054f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:51.993761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 702/1392] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:51.999310 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03cd32-d4f5-43a7-aed4-57b05e2184d8 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:52.000369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03cd32-d4f5-43a7-aed4-57b05e2184d8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:52.000369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f03cd32-d4f5-43a7-aed4-57b05e2184d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:52.028536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:52.070957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2f03cd32-d4f5-43a7-aed4-57b05e2184d8 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:52.072175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2f03cd32-d4f5-43a7-aed4-57b05e2184d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:52.173097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 691/1393] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:52.229115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b698dc-9699-4dd8-bebf-0dbcea9121ee None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:52.229406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b698dc-9699-4dd8-bebf-0dbcea9121ee None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:52.229688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b698dc-9699-4dd8-bebf-0dbcea9121ee None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:52.231290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 703/1394] 10.222.0.70 () {54 vars in 966 bytes} [Mon Aug 1 14:14:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:52.236534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237abf09-6c26-4aca-ad01-fa2fee55375f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:52.236892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237abf09-6c26-4aca-ad01-fa2fee55375f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:52.237795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237abf09-6c26-4aca-ad01-fa2fee55375f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:52.312980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-237abf09-6c26-4aca-ad01-fa2fee55375f None None] MFA Rules not processed for user `bcc213ef64924074bd16152228913ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:52.314188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-237abf09-6c26-4aca-ad01-fa2fee55375f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:52.354539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:52.391559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 692/1395] 10.222.0.70 () {58 vars in 1063 bytes} [Mon Aug 1 14:14:52 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:52.399338 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b698dc-9699-4dd8-bebf-0dbcea9121ee None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:52.400864 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-74b698dc-9699-4dd8-bebf-0dbcea9121ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:52.414629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:52.505951 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b698dc-9699-4dd8-bebf-0dbcea9121ee None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:52.578814 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d633ee-8a0b-4813-bd28-d746b99aeb4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc213ef64924074bd16152228913ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:52.579601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d633ee-8a0b-4813-bd28-d746b99aeb4f service glance] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:52.579878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d633ee-8a0b-4813-bd28-d746b99aeb4f service glance] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:52.580147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d633ee-8a0b-4813-bd28-d746b99aeb4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:52.581788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-08d633ee-8a0b-4813-bd28-d746b99aeb4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:52.649341 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:52.693697 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d633ee-8a0b-4813-bd28-d746b99aeb4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:52.695194 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d633ee-8a0b-4813-bd28-d746b99aeb4f service glance] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:52.713605 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 704/1396] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:53.453311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8aa5e-cbc7-4e98-a2e4-baae9c2df247 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:53.453831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8aa5e-cbc7-4e98-a2e4-baae9c2df247 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:53.453939 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f8aa5e-cbc7-4e98-a2e4-baae9c2df247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:53.522679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-15f8aa5e-cbc7-4e98-a2e4-baae9c2df247 None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:53.523826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-15f8aa5e-cbc7-4e98-a2e4-baae9c2df247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:53.598508 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd523e0-bf6c-4c2a-a9d6-99b5c56dfd2e None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:53.599131 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd523e0-bf6c-4c2a-a9d6-99b5c56dfd2e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:53.599131 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd523e0-bf6c-4c2a-a9d6-99b5c56dfd2e None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:53.600505 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 705/1397] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:14:53.605233 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed8e72-db71-4962-a1d6-3c3865ba61a8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:53.605515 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed8e72-db71-4962-a1d6-3c3865ba61a8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:53.605784 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed8e72-db71-4962-a1d6-3c3865ba61a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:53.616228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 693/1398] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 1 14:14:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:53.661258 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8795bbc-1628-410e-94d0-c124e1b00b56 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:53.661553 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8795bbc-1628-410e-94d0-c124e1b00b56 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:53.661859 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8795bbc-1628-410e-94d0-c124e1b00b56 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:53.663437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 694/1399] 10.222.0.70 () {54 vars in 943 bytes} [Mon Aug 1 14:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:53.669725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c728a18-dd6b-488d-b007-892d17710219 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:53.670034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c728a18-dd6b-488d-b007-892d17710219 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:53.670307 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c728a18-dd6b-488d-b007-892d17710219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:53.675987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4eed8e72-db71-4962-a1d6-3c3865ba61a8 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:53.677244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4eed8e72-db71-4962-a1d6-3c3865ba61a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:53.745234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:53.754251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4c728a18-dd6b-488d-b007-892d17710219 None None] MFA Rules not processed for user `98cccf60a5424986b2e92b523542a640`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:53.755494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4c728a18-dd6b-488d-b007-892d17710219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:53.782410 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 706/1400] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:14:53.826848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed8e72-db71-4962-a1d6-3c3865ba61a8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:53.828084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4eed8e72-db71-4962-a1d6-3c3865ba61a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:53.855252 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:53.865827 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 695/1401] 10.222.0.70 () {58 vars in 1040 bytes} [Mon Aug 1 14:14:53 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:14:53.875295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c728a18-dd6b-488d-b007-892d17710219 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:53.886477 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c728a18-dd6b-488d-b007-892d17710219 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:53.949433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed8e72-db71-4962-a1d6-3c3865ba61a8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:53.990562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79babbc4-c7ed-450c-be57-dee1366f60d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:53.991262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79babbc4-c7ed-450c-be57-dee1366f60d1 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:53.991544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79babbc4-c7ed-450c-be57-dee1366f60d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:53.991818 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79babbc4-c7ed-450c-be57-dee1366f60d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:53.993580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-79babbc4-c7ed-450c-be57-dee1366f60d1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:53.996454 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:54.071633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e88f0d-e4ba-45bd-98db-244f5342865e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:54.072256 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e88f0d-e4ba-45bd-98db-244f5342865e service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:54.072531 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e88f0d-e4ba-45bd-98db-244f5342865e service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:54.072803 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e88f0d-e4ba-45bd-98db-244f5342865e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:54.074434 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-16e88f0d-e4ba-45bd-98db-244f5342865e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:54.078996 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79babbc4-c7ed-450c-be57-dee1366f60d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:54.080916 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79babbc4-c7ed-450c-be57-dee1366f60d1 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:54.089374 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 696/1402] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:14:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 14:14:54.093424 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:54.171294 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e88f0d-e4ba-45bd-98db-244f5342865e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:54.172945 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e88f0d-e4ba-45bd-98db-244f5342865e service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:54.192355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 707/1403] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:14:56.255005 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc44d65-2791-4806-902a-c846b7c7edac None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:56.255521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc44d65-2791-4806-902a-c846b7c7edac None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:56.255521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc44d65-2791-4806-902a-c846b7c7edac None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:56.256827 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 697/1404] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:56.262346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144937a-33df-4218-b92d-f498c967c697 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:56.262835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144937a-33df-4218-b92d-f498c967c697 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:56.262942 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6144937a-33df-4218-b92d-f498c967c697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:56.335962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6144937a-33df-4218-b92d-f498c967c697 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:56.337199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6144937a-33df-4218-b92d-f498c967c697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:56.444360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:56.458674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 708/1405] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:56.497332 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc44d65-2791-4806-902a-c846b7c7edac None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:56.498926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1dc44d65-2791-4806-902a-c846b7c7edac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:56.679041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:56.681447 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc44d65-2791-4806-902a-c846b7c7edac None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:56.814668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b453033-3e3d-4124-9570-e2c5252a4627 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:56.815326 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b453033-3e3d-4124-9570-e2c5252a4627 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:56.815578 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b453033-3e3d-4124-9570-e2c5252a4627 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:56.815857 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b453033-3e3d-4124-9570-e2c5252a4627 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:56.817520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8b453033-3e3d-4124-9570-e2c5252a4627 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:56.924635 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b453033-3e3d-4124-9570-e2c5252a4627 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:56.926383 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b453033-3e3d-4124-9570-e2c5252a4627 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:56.948129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 698/1406] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:14:59.019892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611ee7a-5363-4a1c-ae67-51a6f7deef68 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:59.020431 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611ee7a-5363-4a1c-ae67-51a6f7deef68 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:59.020431 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e611ee7a-5363-4a1c-ae67-51a6f7deef68 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:59.021967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 709/1407] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:14:59.026917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bf618-69d4-4364-afbb-44768a4d5092 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:59.027342 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bf618-69d4-4364-afbb-44768a4d5092 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:59.027511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724bf618-69d4-4364-afbb-44768a4d5092 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:59.032214 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:59.109330 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-724bf618-69d4-4364-afbb-44768a4d5092 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:14:59.110557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-724bf618-69d4-4364-afbb-44768a4d5092 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:59.220029 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 699/1408] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:14:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:14:59.266637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611ee7a-5363-4a1c-ae67-51a6f7deef68 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:14:59.269049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e611ee7a-5363-4a1c-ae67-51a6f7deef68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:59.535015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e611ee7a-5363-4a1c-ae67-51a6f7deef68 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:14:59.610792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:14:59.659755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f89911-cc69-4c29-be0a-1a91cfcf6bc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:14:59.660374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f89911-cc69-4c29-be0a-1a91cfcf6bc1 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:14:59.660649 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f89911-cc69-4c29-be0a-1a91cfcf6bc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:14:59.660915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f89911-cc69-4c29-be0a-1a91cfcf6bc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:14:59.662674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-14f89911-cc69-4c29-be0a-1a91cfcf6bc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:14:59.761588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f89911-cc69-4c29-be0a-1a91cfcf6bc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:14:59.763254 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f89911-cc69-4c29-be0a-1a91cfcf6bc1 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:14:59.783639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 710/1409] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:14:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:15:09.218351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=64 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:09.780987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=64 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:16.692250 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d218d23-c8f5-4c5f-afa3-950a395eb212 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:16.692798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d218d23-c8f5-4c5f-afa3-950a395eb212 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:16.692798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d218d23-c8f5-4c5f-afa3-950a395eb212 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:16.694185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 700/1410] 10.222.0.70 () {54 vars in 918 bytes} [Mon Aug 1 14:15:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:16.699408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c6f83-4ad2-4383-880d-4b63d2221410 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:16.699816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c6f83-4ad2-4383-880d-4b63d2221410 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:16.699930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c6f83-4ad2-4383-880d-4b63d2221410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:16.775117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ba9c6f83-4ad2-4383-880d-4b63d2221410 None None] MFA Rules not processed for user `e210ee6c390849e7a630a677ec52e966`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:16.776321 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ba9c6f83-4ad2-4383-880d-4b63d2221410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:16.884546 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 711/1411] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Aug 1 14:15:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:16.899626 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f477cf-886a-43f3-a37d-3f51a24369a6 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:16.899920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f477cf-886a-43f3-a37d-3f51a24369a6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:16.900200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f477cf-886a-43f3-a37d-3f51a24369a6 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:16.901556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 701/1412] 10.222.0.70 () {54 vars in 918 bytes} [Mon Aug 1 14:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:16.906223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501feb4-1909-4fd5-b6cf-edfdc210a94d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:16.906514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501feb4-1909-4fd5-b6cf-edfdc210a94d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:16.906823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a501feb4-1909-4fd5-b6cf-edfdc210a94d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:16.994255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:16.999347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a501feb4-1909-4fd5-b6cf-edfdc210a94d None None] MFA Rules not processed for user `e856fd5aff914cfb8b8dd86b39c89bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:17.001449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a501feb4-1909-4fd5-b6cf-edfdc210a94d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:17.120251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 712/1413] 10.222.0.70 () {58 vars in 1015 bytes} [Mon Aug 1 14:15:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:15:19.583273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5ce3d-74f3-4442-8421-afec34bdd38d None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:19.583854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5ce3d-74f3-4442-8421-afec34bdd38d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:19.583854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5ce3d-74f3-4442-8421-afec34bdd38d None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:19.585181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:19.590287 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035b56c-0b36-4828-b814-110f11d1937c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:19.590754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035b56c-0b36-4828-b814-110f11d1937c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:19.590883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8035b56c-0b36-4828-b814-110f11d1937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:19.656494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8035b56c-0b36-4828-b814-110f11d1937c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:19.657710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8035b56c-0b36-4828-b814-110f11d1937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:19.712707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:19.754819 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:15:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:19.797683 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5ce3d-74f3-4442-8421-afec34bdd38d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:19.799257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-eaa5ce3d-74f3-4442-8421-afec34bdd38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:19.944406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5ce3d-74f3-4442-8421-afec34bdd38d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:20.020112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:20.059616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ee4eb3-8686-4327-81e7-8ada1087d67e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:20.060227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee4eb3-8686-4327-81e7-8ada1087d67e service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:20.060501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee4eb3-8686-4327-81e7-8ada1087d67e service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:20.060767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ee4eb3-8686-4327-81e7-8ada1087d67e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:20.062445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d1ee4eb3-8686-4327-81e7-8ada1087d67e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:20.150509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee4eb3-8686-4327-81e7-8ada1087d67e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:20.152160 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ee4eb3-8686-4327-81e7-8ada1087d67e service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:20.169872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 703/1416] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:21.082919 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648074b-db27-43cb-871b-a0f9d7711b5a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:21.083448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648074b-db27-43cb-871b-a0f9d7711b5a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:21.083448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7648074b-db27-43cb-871b-a0f9d7711b5a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:21.084730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:15:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:21.089714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23413e83-05e6-47ec-b719-1fcaac96f914 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:21.090118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23413e83-05e6-47ec-b719-1fcaac96f914 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:21.090266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23413e83-05e6-47ec-b719-1fcaac96f914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:21.169724 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-23413e83-05e6-47ec-b719-1fcaac96f914 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:21.170963 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-23413e83-05e6-47ec-b719-1fcaac96f914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:21.197636 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:21.267282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:15:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:15:21.420121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648074b-db27-43cb-871b-a0f9d7711b5a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:21.421585 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7648074b-db27-43cb-871b-a0f9d7711b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:21.570237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7648074b-db27-43cb-871b-a0f9d7711b5a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:21.609761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:21.684044 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31039b8-b145-4413-8a23-2c51cfef0c0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:21.684608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31039b8-b145-4413-8a23-2c51cfef0c0a service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:21.684864 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31039b8-b145-4413-8a23-2c51cfef0c0a service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:21.685134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31039b8-b145-4413-8a23-2c51cfef0c0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:21.686870 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c31039b8-b145-4413-8a23-2c51cfef0c0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:21.777003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31039b8-b145-4413-8a23-2c51cfef0c0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:21.778623 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31039b8-b145-4413-8a23-2c51cfef0c0a service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:21.796914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 715/1419] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:22.682323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7c05a-6d1e-4992-8cf5-b338a1d124da None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:22.682919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7c05a-6d1e-4992-8cf5-b338a1d124da None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:22.682919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a7c05a-6d1e-4992-8cf5-b338a1d124da None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:22.684251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:22.689136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58dc2d-dc58-43cd-800c-3a0fc6934354 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:22.689587 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58dc2d-dc58-43cd-800c-3a0fc6934354 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:22.689687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58dc2d-dc58-43cd-800c-3a0fc6934354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:22.743495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:22.765145 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8f58dc2d-dc58-43cd-800c-3a0fc6934354 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:22.766339 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8f58dc2d-dc58-43cd-800c-3a0fc6934354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:22.861912 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:15:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:23.016529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7c05a-6d1e-4992-8cf5-b338a1d124da None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:23.018103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-51a7c05a-6d1e-4992-8cf5-b338a1d124da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:23.165771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a7c05a-6d1e-4992-8cf5-b338a1d124da None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:23.179138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:23.280705 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a6c05-5159-449d-b351-a2dfcbd925aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:23.281234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6c05-5159-449d-b351-a2dfcbd925aa service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:23.281513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6c05-5159-449d-b351-a2dfcbd925aa service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:23.281783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a6c05-5159-449d-b351-a2dfcbd925aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:23.283431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b85a6c05-5159-449d-b351-a2dfcbd925aa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:23.381262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a6c05-5159-449d-b351-a2dfcbd925aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:23.382950 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a6c05-5159-449d-b351-a2dfcbd925aa service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:23.400919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 706/1422] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:24.256901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df3dd5-17b4-4878-b080-2f36ca87b6df None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:24.257439 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df3dd5-17b4-4878-b080-2f36ca87b6df None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:24.257439 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22df3dd5-17b4-4878-b080-2f36ca87b6df None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:24.258788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:15:24.263732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe35ff-6a5c-4b87-b1a1-f3609eb6ca40 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:24.264151 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe35ff-6a5c-4b87-b1a1-f3609eb6ca40 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:24.264282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafe35ff-6a5c-4b87-b1a1-f3609eb6ca40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:24.284983 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:24.342874 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-fafe35ff-6a5c-4b87-b1a1-f3609eb6ca40 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:24.344090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fafe35ff-6a5c-4b87-b1a1-f3609eb6ca40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:24.438850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:15:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:24.591348 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df3dd5-17b4-4878-b080-2f36ca87b6df None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:24.592866 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-22df3dd5-17b4-4878-b080-2f36ca87b6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:24.700729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:24.736625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22df3dd5-17b4-4878-b080-2f36ca87b6df None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:24.849018 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8dc55-73b7-433d-b997-72d428f090ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:24.849567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8dc55-73b7-433d-b997-72d428f090ac service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:24.849850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8dc55-73b7-433d-b997-72d428f090ac service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:24.850157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8dc55-73b7-433d-b997-72d428f090ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:24.851798 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a4d8dc55-73b7-433d-b997-72d428f090ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:24.928838 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:24.942824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8dc55-73b7-433d-b997-72d428f090ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:24.944426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8dc55-73b7-433d-b997-72d428f090ac service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:24.962289 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 718/1425] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:25.821962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f95c6-8960-4bee-9f52-b2969651f73f None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:25.822538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f95c6-8960-4bee-9f52-b2969651f73f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:25.822538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82f95c6-8960-4bee-9f52-b2969651f73f None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:25.823910 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:15:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:25.829012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9cbfb-8112-4392-bbc8-116fd5330cef None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:25.829457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9cbfb-8112-4392-bbc8-116fd5330cef None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:25.829570 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea9cbfb-8112-4392-bbc8-116fd5330cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:25.905044 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-bea9cbfb-8112-4392-bbc8-116fd5330cef None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:25.906263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bea9cbfb-8112-4392-bbc8-116fd5330cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:26.003986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:15:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:26.154426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f95c6-8960-4bee-9f52-b2969651f73f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:26.155891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e82f95c6-8960-4bee-9f52-b2969651f73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:26.239807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:26.301914 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82f95c6-8960-4bee-9f52-b2969651f73f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:26.416478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d77013-9856-4720-8998-323a8a621a7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:26.417019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d77013-9856-4720-8998-323a8a621a7d service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:26.417317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d77013-9856-4720-8998-323a8a621a7d service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:26.417566 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d77013-9856-4720-8998-323a8a621a7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:26.419213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e9d77013-9856-4720-8998-323a8a621a7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:26.466747 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:26.508262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d77013-9856-4720-8998-323a8a621a7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:26.509859 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d77013-9856-4720-8998-323a8a621a7d service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:26.527471 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 709/1428] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:27.333545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37cc6-eb19-465d-8661-a159c2d9d233 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:27.334098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37cc6-eb19-465d-8661-a159c2d9d233 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:27.334098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc37cc6-eb19-465d-8661-a159c2d9d233 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:27.335498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:15:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:27.340487 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3100eb-fe2f-4884-b738-94344c24ec4b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:27.340893 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3100eb-fe2f-4884-b738-94344c24ec4b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:27.341077 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3100eb-fe2f-4884-b738-94344c24ec4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:27.416573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-6c3100eb-fe2f-4884-b738-94344c24ec4b None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:27.417775 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6c3100eb-fe2f-4884-b738-94344c24ec4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:27.514115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:15:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:27.662913 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc37cc6-eb19-465d-8661-a159c2d9d233 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:27.664405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ecc37cc6-eb19-465d-8661-a159c2d9d233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:27.713073 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:27.810427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc37cc6-eb19-465d-8661-a159c2d9d233 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:27.921283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b38af0-d68c-4ddb-875c-cff0e473c82c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:27.921820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b38af0-d68c-4ddb-875c-cff0e473c82c service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:27.922099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b38af0-d68c-4ddb-875c-cff0e473c82c service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:27.922369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b38af0-d68c-4ddb-875c-cff0e473c82c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:27.924015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b6b38af0-d68c-4ddb-875c-cff0e473c82c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:27.931475 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:28.016837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b38af0-d68c-4ddb-875c-cff0e473c82c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:28.018456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b38af0-d68c-4ddb-875c-cff0e473c82c service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:28.036965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 721/1431] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:28.837140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e529b-b4a3-4f7b-a079-3ce77695d762 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:28.837575 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e529b-b4a3-4f7b-a079-3ce77695d762 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:28.837670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483e529b-b4a3-4f7b-a079-3ce77695d762 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:28.839065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:28.843870 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6246d-7be7-4df5-ade0-a33af3a5822a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:28.844269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6246d-7be7-4df5-ade0-a33af3a5822a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:28.844418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6246d-7be7-4df5-ade0-a33af3a5822a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:28.919298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-23b6246d-7be7-4df5-ade0-a33af3a5822a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:28.920513 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-23b6246d-7be7-4df5-ade0-a33af3a5822a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:28.989283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:29.019068 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:29.169362 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e529b-b4a3-4f7b-a079-3ce77695d762 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:29.170832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-483e529b-b4a3-4f7b-a079-3ce77695d762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:29.188042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:29.320403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483e529b-b4a3-4f7b-a079-3ce77695d762 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:29.408161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:29.441836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31b8962-ba25-4f9a-8f75-4c89e99b5df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:29.442383 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b8962-ba25-4f9a-8f75-4c89e99b5df8 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:29.442690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b8962-ba25-4f9a-8f75-4c89e99b5df8 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:29.442960 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31b8962-ba25-4f9a-8f75-4c89e99b5df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:29.444612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c31b8962-ba25-4f9a-8f75-4c89e99b5df8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:29.533113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b8962-ba25-4f9a-8f75-4c89e99b5df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:29.534820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c31b8962-ba25-4f9a-8f75-4c89e99b5df8 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:29.552811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 712/1434] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:30.359983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25943419-1959-4a01-99b7-59aa243b53f7 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:30.360568 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25943419-1959-4a01-99b7-59aa243b53f7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:30.360568 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25943419-1959-4a01-99b7-59aa243b53f7 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:30.361905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:30.367519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4abae3-40c1-4de7-82bf-01a337cbb516 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:30.367948 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4abae3-40c1-4de7-82bf-01a337cbb516 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:30.368057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4abae3-40c1-4de7-82bf-01a337cbb516 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:30.443725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4b4abae3-40c1-4de7-82bf-01a337cbb516 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:30.444926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4b4abae3-40c1-4de7-82bf-01a337cbb516 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:30.486334 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:30.541141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:30.693251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25943419-1959-4a01-99b7-59aa243b53f7 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:30.694851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-25943419-1959-4a01-99b7-59aa243b53f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:30.840546 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25943419-1959-4a01-99b7-59aa243b53f7 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:30.899717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:30.960452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc405936-4c55-447b-a4a1-247f8a9e001f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:30.960992 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc405936-4c55-447b-a4a1-247f8a9e001f service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:30.961268 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc405936-4c55-447b-a4a1-247f8a9e001f service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:30.961537 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc405936-4c55-447b-a4a1-247f8a9e001f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:30.963193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fc405936-4c55-447b-a4a1-247f8a9e001f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:31.052043 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc405936-4c55-447b-a4a1-247f8a9e001f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:31.053660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc405936-4c55-447b-a4a1-247f8a9e001f service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:31.072315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 724/1437] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:31.890747 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058a862-57a0-4435-9c64-28d26a32b627 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:31.891279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058a862-57a0-4435-9c64-28d26a32b627 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:31.891393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2058a862-57a0-4435-9c64-28d26a32b627 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:31.892671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:31.897498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99860f65-4594-4d52-b878-35d591526f88 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:31.897956 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99860f65-4594-4d52-b878-35d591526f88 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:31.898057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99860f65-4594-4d52-b878-35d591526f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:31.973880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-99860f65-4594-4d52-b878-35d591526f88 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:31.975129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-99860f65-4594-4d52-b878-35d591526f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:31.977140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:32.072704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:32.225942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058a862-57a0-4435-9c64-28d26a32b627 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:32.227518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2058a862-57a0-4435-9c64-28d26a32b627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:32.373583 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2058a862-57a0-4435-9c64-28d26a32b627 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:32.404131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:32.501239 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45defacd-11b0-4205-ba0c-0ea46ded1796 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:32.501863 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45defacd-11b0-4205-ba0c-0ea46ded1796 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:32.502142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45defacd-11b0-4205-ba0c-0ea46ded1796 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:32.502414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45defacd-11b0-4205-ba0c-0ea46ded1796 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:32.504593 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-45defacd-11b0-4205-ba0c-0ea46ded1796 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:32.593655 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45defacd-11b0-4205-ba0c-0ea46ded1796 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:32.595321 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45defacd-11b0-4205-ba0c-0ea46ded1796 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:32.613020 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 715/1440] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:34.527294 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd385b4a-07c3-4de6-8efa-75c27635ad52 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:34.527880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd385b4a-07c3-4de6-8efa-75c27635ad52 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:34.527880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd385b4a-07c3-4de6-8efa-75c27635ad52 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:34.529233 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:15:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:34.535002 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82de9cb-336b-4a9a-8c31-439fbacea2de None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:34.535445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82de9cb-336b-4a9a-8c31-439fbacea2de None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:34.535555 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82de9cb-336b-4a9a-8c31-439fbacea2de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:34.575325 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:34.601768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c82de9cb-336b-4a9a-8c31-439fbacea2de None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:34.603022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c82de9cb-336b-4a9a-8c31-439fbacea2de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:34.698366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:15:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:34.737655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd385b4a-07c3-4de6-8efa-75c27635ad52 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:34.739215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dd385b4a-07c3-4de6-8efa-75c27635ad52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:34.843768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd385b4a-07c3-4de6-8efa-75c27635ad52 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:34.875465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:34.917985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd52688-bebb-40b0-841b-058281c0282a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:34.918627 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd52688-bebb-40b0-841b-058281c0282a service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:34.918909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd52688-bebb-40b0-841b-058281c0282a service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:34.919178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd52688-bebb-40b0-841b-058281c0282a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:34.920805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ffd52688-bebb-40b0-841b-058281c0282a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:35.030275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd52688-bebb-40b0-841b-058281c0282a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:35.031751 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd52688-bebb-40b0-841b-058281c0282a service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:35.049772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 727/1443] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:37.220993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cbbdd-2faf-4d53-aac7-c628359b1f4d None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:37.221601 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cbbdd-2faf-4d53-aac7-c628359b1f4d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:37.221601 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1cbbdd-2faf-4d53-aac7-c628359b1f4d None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:37.223429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:37.228792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d298ba5-29d9-4930-b421-7f1cfc40cb19 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:37.229231 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d298ba5-29d9-4930-b421-7f1cfc40cb19 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:37.229340 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d298ba5-29d9-4930-b421-7f1cfc40cb19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:37.295002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8d298ba5-29d9-4930-b421-7f1cfc40cb19 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:37.296208 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8d298ba5-29d9-4930-b421-7f1cfc40cb19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:37.311126 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:37.395931 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:15:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:37.434405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cbbdd-2faf-4d53-aac7-c628359b1f4d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:37.435999 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6a1cbbdd-2faf-4d53-aac7-c628359b1f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:37.547423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1cbbdd-2faf-4d53-aac7-c628359b1f4d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:37.559357 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:37.620861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3ae5d5-f022-4d9a-9061-400c5078ab3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:37.621480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ae5d5-f022-4d9a-9061-400c5078ab3c service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:37.621762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ae5d5-f022-4d9a-9061-400c5078ab3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:37.622035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3ae5d5-f022-4d9a-9061-400c5078ab3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:37.623732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0a3ae5d5-f022-4d9a-9061-400c5078ab3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:37.734154 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ae5d5-f022-4d9a-9061-400c5078ab3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:37.735632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3ae5d5-f022-4d9a-9061-400c5078ab3c service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:37.753130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 718/1446] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:40.049693 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee3ab4-b2b4-45af-b3db-4788e98631e1 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:40.050206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee3ab4-b2b4-45af-b3db-4788e98631e1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:40.050872 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ee3ab4-b2b4-45af-b3db-4788e98631e1 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:40.052220 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:15:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:40.057345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e855-0f8d-4266-9396-642a6ef84b01 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:40.057751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e855-0f8d-4266-9396-642a6ef84b01 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:40.057860 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47e855-0f8d-4266-9396-642a6ef84b01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:40.105911 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:40.123926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4c47e855-0f8d-4266-9396-642a6ef84b01 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:40.125115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4c47e855-0f8d-4266-9396-642a6ef84b01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:40.220575 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:40.260327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee3ab4-b2b4-45af-b3db-4788e98631e1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:40.261855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c3ee3ab4-b2b4-45af-b3db-4788e98631e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:40.372304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ee3ab4-b2b4-45af-b3db-4788e98631e1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:40.412617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:40.447395 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7195c00a-147e-4381-baeb-ad2ed6eab2ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:40.448018 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195c00a-147e-4381-baeb-ad2ed6eab2ff service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:40.448297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195c00a-147e-4381-baeb-ad2ed6eab2ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:40.448569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7195c00a-147e-4381-baeb-ad2ed6eab2ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:40.450200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7195c00a-147e-4381-baeb-ad2ed6eab2ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:40.557621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195c00a-147e-4381-baeb-ad2ed6eab2ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:40.559081 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7195c00a-147e-4381-baeb-ad2ed6eab2ff service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:40.576706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 730/1449] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:42.703283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93273c74-717f-474b-adbc-e4ebb04c3486 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:42.703851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93273c74-717f-474b-adbc-e4ebb04c3486 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:42.703851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93273c74-717f-474b-adbc-e4ebb04c3486 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:42.705170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:42.710795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b2b45-ca87-4fd7-8501-20f55f7e2721 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:42.711230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b2b45-ca87-4fd7-8501-20f55f7e2721 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:42.711328 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40b2b45-ca87-4fd7-8501-20f55f7e2721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:42.777057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b40b2b45-ca87-4fd7-8501-20f55f7e2721 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:42.778265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b40b2b45-ca87-4fd7-8501-20f55f7e2721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:42.798427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:42.876474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:42.915006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93273c74-717f-474b-adbc-e4ebb04c3486 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:42.916527 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-93273c74-717f-474b-adbc-e4ebb04c3486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:43.019223 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93273c74-717f-474b-adbc-e4ebb04c3486 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:43.039060 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:43.093088 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e80afc-9259-41f8-93bd-96d387143f93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:43.093703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e80afc-9259-41f8-93bd-96d387143f93 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:43.093986 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e80afc-9259-41f8-93bd-96d387143f93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:43.094260 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e80afc-9259-41f8-93bd-96d387143f93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:43.095917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-33e80afc-9259-41f8-93bd-96d387143f93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:43.203311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e80afc-9259-41f8-93bd-96d387143f93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:43.204763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e80afc-9259-41f8-93bd-96d387143f93 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:43.227891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 721/1452] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:45.306796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6199f29-6ec1-41b5-8bae-fa55b4912fcf None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:45.307361 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6199f29-6ec1-41b5-8bae-fa55b4912fcf None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:45.307361 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6199f29-6ec1-41b5-8bae-fa55b4912fcf None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:45.308717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:45.313883 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a6f77-e374-43fe-8260-da4f9c4d9272 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:45.314290 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a6f77-e374-43fe-8260-da4f9c4d9272 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:45.314438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836a6f77-e374-43fe-8260-da4f9c4d9272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:45.378889 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:45.381881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-836a6f77-e374-43fe-8260-da4f9c4d9272 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:45.383689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-836a6f77-e374-43fe-8260-da4f9c4d9272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:45.485923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:45.524355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6199f29-6ec1-41b5-8bae-fa55b4912fcf None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:45.525917 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b6199f29-6ec1-41b5-8bae-fa55b4912fcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:45.632380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6199f29-6ec1-41b5-8bae-fa55b4912fcf None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:45.682125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:45.707743 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bc1267-2d2a-4742-bfd4-a2f2b8be60bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:45.708358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1267-2d2a-4742-bfd4-a2f2b8be60bd service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:45.708637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1267-2d2a-4742-bfd4-a2f2b8be60bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:45.708909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bc1267-2d2a-4742-bfd4-a2f2b8be60bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:45.710629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-74bc1267-2d2a-4742-bfd4-a2f2b8be60bd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:45.817821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc1267-2d2a-4742-bfd4-a2f2b8be60bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:45.819279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bc1267-2d2a-4742-bfd4-a2f2b8be60bd service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:45.837812 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 733/1455] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:47.922409 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348a295-cb65-42b8-bceb-42df052ed28b None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:47.923025 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348a295-cb65-42b8-bceb-42df052ed28b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:47.923025 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b348a295-cb65-42b8-bceb-42df052ed28b None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:47.924334 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:15:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:47.929893 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06781087-4967-45bd-b2f2-5433664af3ff None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:47.930344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06781087-4967-45bd-b2f2-5433664af3ff None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:47.930480 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06781087-4967-45bd-b2f2-5433664af3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:47.999611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-06781087-4967-45bd-b2f2-5433664af3ff None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:48.000720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-06781087-4967-45bd-b2f2-5433664af3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:48.032488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:48.220440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:15:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:15:48.258702 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348a295-cb65-42b8-bceb-42df052ed28b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:48.260217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b348a295-cb65-42b8-bceb-42df052ed28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:48.362067 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b348a295-cb65-42b8-bceb-42df052ed28b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:48.390325 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:48.437594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e7fb16-6a12-46bb-af9f-da48aa536503 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:48.438217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7fb16-6a12-46bb-af9f-da48aa536503 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:48.438498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7fb16-6a12-46bb-af9f-da48aa536503 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:48.438805 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e7fb16-6a12-46bb-af9f-da48aa536503 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:48.440426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-92e7fb16-6a12-46bb-af9f-da48aa536503 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:48.551475 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7fb16-6a12-46bb-af9f-da48aa536503 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:48.552942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e7fb16-6a12-46bb-af9f-da48aa536503 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:48.570936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 724/1458] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:50.629405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99821a7-4060-48e7-ad3a-573af4e4e884 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:50.629974 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99821a7-4060-48e7-ad3a-573af4e4e884 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:50.629974 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99821a7-4060-48e7-ad3a-573af4e4e884 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:50.631317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:15:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:50.636455 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4b89e-aa1a-4af3-bc84-af5d0edb338b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:50.636902 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4b89e-aa1a-4af3-bc84-af5d0edb338b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:50.637017 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4b89e-aa1a-4af3-bc84-af5d0edb338b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:50.702917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-36c4b89e-aa1a-4af3-bc84-af5d0edb338b None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:50.704115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-36c4b89e-aa1a-4af3-bc84-af5d0edb338b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:50.713150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:50.802237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:50.839579 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99821a7-4060-48e7-ad3a-573af4e4e884 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:50.841103 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f99821a7-4060-48e7-ad3a-573af4e4e884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:50.944369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99821a7-4060-48e7-ad3a-573af4e4e884 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:51.000026 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:51.018537 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a3a260-e4e7-43bd-8cb4-e22c78901141 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:51.019201 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3a260-e4e7-43bd-8cb4-e22c78901141 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:51.019460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3a260-e4e7-43bd-8cb4-e22c78901141 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:51.019725 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a3a260-e4e7-43bd-8cb4-e22c78901141 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:51.021334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-86a3a260-e4e7-43bd-8cb4-e22c78901141 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:51.127813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3a260-e4e7-43bd-8cb4-e22c78901141 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:51.129274 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a3a260-e4e7-43bd-8cb4-e22c78901141 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:51.146862 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 736/1461] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:53.216491 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74cf14-3e39-4d94-90a8-aa8038d5a30c None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:53.217019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74cf14-3e39-4d94-90a8-aa8038d5a30c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:53.217019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e74cf14-3e39-4d94-90a8-aa8038d5a30c None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:53.218378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:53.224316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb8d80-550f-40a1-8fb0-077c00278b7e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:53.224752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb8d80-550f-40a1-8fb0-077c00278b7e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:53.224861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb8d80-550f-40a1-8fb0-077c00278b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:53.289832 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d1cb8d80-550f-40a1-8fb0-077c00278b7e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:53.291059 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d1cb8d80-550f-40a1-8fb0-077c00278b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:53.329328 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:53.389120 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:15:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:15:53.427101 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74cf14-3e39-4d94-90a8-aa8038d5a30c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:53.428663 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9e74cf14-3e39-4d94-90a8-aa8038d5a30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:53.533586 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e74cf14-3e39-4d94-90a8-aa8038d5a30c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:53.571399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:53.610897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733dbb56-9619-48ea-a716-31933d0ec2be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:53.611514 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dbb56-9619-48ea-a716-31933d0ec2be service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:53.611795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dbb56-9619-48ea-a716-31933d0ec2be service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:53.612070 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733dbb56-9619-48ea-a716-31933d0ec2be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:53.613723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-733dbb56-9619-48ea-a716-31933d0ec2be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:53.728681 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dbb56-9619-48ea-a716-31933d0ec2be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:53.730379 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733dbb56-9619-48ea-a716-31933d0ec2be service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:53.751621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 727/1464] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:55.804876 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac898d1-e20c-4d7d-8ec4-6f1e214214cc None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:55.805424 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac898d1-e20c-4d7d-8ec4-6f1e214214cc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:55.805526 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac898d1-e20c-4d7d-8ec4-6f1e214214cc None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:55.806909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:55.812255 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d2127-3cb0-433a-a93e-ead468908d3d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:55.812718 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d2127-3cb0-433a-a93e-ead468908d3d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:55.812831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090d2127-3cb0-433a-a93e-ead468908d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:55.878588 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-090d2127-3cb0-433a-a93e-ead468908d3d None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:55.879814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-090d2127-3cb0-433a-a93e-ead468908d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:55.897940 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:55.982279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:56.018420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac898d1-e20c-4d7d-8ec4-6f1e214214cc None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:56.020513 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5ac898d1-e20c-4d7d-8ec4-6f1e214214cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:56.123539 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac898d1-e20c-4d7d-8ec4-6f1e214214cc None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:56.188902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:56.196188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf82284f-648c-4b68-b1a8-3713120c7b72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:56.196798 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82284f-648c-4b68-b1a8-3713120c7b72 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:56.197072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82284f-648c-4b68-b1a8-3713120c7b72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:56.197345 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf82284f-648c-4b68-b1a8-3713120c7b72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:56.199001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bf82284f-648c-4b68-b1a8-3713120c7b72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:56.306107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82284f-648c-4b68-b1a8-3713120c7b72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:56.307580 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf82284f-648c-4b68-b1a8-3713120c7b72 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:56.325346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 739/1467] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:15:58.348234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed01d45-6ec5-45c5-9409-dc37958c1570 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:58.348768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed01d45-6ec5-45c5-9409-dc37958c1570 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:58.348768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed01d45-6ec5-45c5-9409-dc37958c1570 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:58.350141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:15:58.355506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296619d-d0fc-4782-ab13-f1217ebe638f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:58.355907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296619d-d0fc-4782-ab13-f1217ebe638f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:58.356059 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296619d-d0fc-4782-ab13-f1217ebe638f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:58.421939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2296619d-d0fc-4782-ab13-f1217ebe638f None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:15:58.423173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2296619d-d0fc-4782-ab13-f1217ebe638f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:58.471843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:58.520470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:15:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:15:58.556923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed01d45-6ec5-45c5-9409-dc37958c1570 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:15:58.558469 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bed01d45-6ec5-45c5-9409-dc37958c1570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:58.675099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed01d45-6ec5-45c5-9409-dc37958c1570 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:15:58.722373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:15:58.748118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3420c37-06d5-4522-b71d-814dfbf45511 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:15:58.748728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3420c37-06d5-4522-b71d-814dfbf45511 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:15:58.749006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3420c37-06d5-4522-b71d-814dfbf45511 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:15:58.749278 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3420c37-06d5-4522-b71d-814dfbf45511 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:15:58.750925 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d3420c37-06d5-4522-b71d-814dfbf45511 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:15:58.857880 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3420c37-06d5-4522-b71d-814dfbf45511 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:15:58.859360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3420c37-06d5-4522-b71d-814dfbf45511 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:15:58.877355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 730/1470] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:15:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:16:08.518100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=22 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:08.875064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=66 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:18.605235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ab93f-510e-4974-b7fa-fd11921df7e9 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:18.605805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ab93f-510e-4974-b7fa-fd11921df7e9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:18.605805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7ab93f-510e-4974-b7fa-fd11921df7e9 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:18.607168 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 741/1471] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:16:18.612273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69d7d9-c2a2-44dd-b119-6e665c727ef1 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:18.612681 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69d7d9-c2a2-44dd-b119-6e665c727ef1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:18.612821 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e69d7d9-c2a2-44dd-b119-6e665c727ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:18.680010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-3e69d7d9-c2a2-44dd-b119-6e665c727ef1 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:16:18.681224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3e69d7d9-c2a2-44dd-b119-6e665c727ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:18.779228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 731/1472] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:16:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:16:18.869383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97133f24-1466-457f-be54-cf5373e09cd6 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:18.869670 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97133f24-1466-457f-be54-cf5373e09cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:18.869949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97133f24-1466-457f-be54-cf5373e09cd6 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:18.871351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 742/1473] 10.222.0.70 () {54 vars in 966 bytes} [Mon Aug 1 14:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:16:18.876301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ac676-baed-4f95-9877-b7476b4cbd2a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:18.876600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ac676-baed-4f95-9877-b7476b4cbd2a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:18.876876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ac676-baed-4f95-9877-b7476b4cbd2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:18.952254 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d63ac676-baed-4f95-9877-b7476b4cbd2a None None] MFA Rules not processed for user `bcc213ef64924074bd16152228913ef1`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:16:18.953465 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d63ac676-baed-4f95-9877-b7476b4cbd2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:18.974334 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:19.152189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 732/1474] 10.222.0.70 () {58 vars in 1063 bytes} [Mon Aug 1 14:16:18 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:16:19.159732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97133f24-1466-457f-be54-cf5373e09cd6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:19.161329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-97133f24-1466-457f-be54-cf5373e09cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:19.267813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97133f24-1466-457f-be54-cf5373e09cd6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:19.340923 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e29453-cc19-40be-a88b-a3842c57ef02 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc213ef64924074bd16152228913ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:19.341535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e29453-cc19-40be-a88b-a3842c57ef02 service glance] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:19.341815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e29453-cc19-40be-a88b-a3842c57ef02 service glance] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:19.342082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e29453-cc19-40be-a88b-a3842c57ef02 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:19.343747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a4e29453-cc19-40be-a88b-a3842c57ef02 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:19.397667 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:19.454662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e29453-cc19-40be-a88b-a3842c57ef02 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:19.456097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e29453-cc19-40be-a88b-a3842c57ef02 service glance] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:19.475734 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 743/1475] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:16:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:16:21.575065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712f0c5-b86c-472c-93b1-49df65f6a693 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:21.575633 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712f0c5-b86c-472c-93b1-49df65f6a693 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:21.575633 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1712f0c5-b86c-472c-93b1-49df65f6a693 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:21.576951 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 733/1476] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:16:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:16:21.582985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a82e8-acfe-43f2-aad3-3fd54e4eb700 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:21.583402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a82e8-acfe-43f2-aad3-3fd54e4eb700 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:21.583402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a82e8-acfe-43f2-aad3-3fd54e4eb700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:21.648147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-988a82e8-acfe-43f2-aad3-3fd54e4eb700 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:16:21.649358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-988a82e8-acfe-43f2-aad3-3fd54e4eb700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:21.749226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 744/1477] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:16:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:16:21.772908 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712f0c5-b86c-472c-93b1-49df65f6a693 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:21.774450 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1712f0c5-b86c-472c-93b1-49df65f6a693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:21.905346 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1712f0c5-b86c-472c-93b1-49df65f6a693 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:21.953559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:21.999724 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f1f704-78c9-4075-8d55-c3471c47b7fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:21.999883 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1f704-78c9-4075-8d55-c3471c47b7fa admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:22.000145 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1f704-78c9-4075-8d55-c3471c47b7fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:22.000422 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f1f704-78c9-4075-8d55-c3471c47b7fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:22.001114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1f704-78c9-4075-8d55-c3471c47b7fa admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:22.002892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: WARNING py.warnings [None req-69f1f704-78c9-4075-8d55-c3471c47b7fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:16:22.002892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: warnings.warn(msg) Aug 01 14:16:22.002892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: Aug 01 14:16:22.004041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f1f704-78c9-4075-8d55-c3471c47b7fa admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:22.023109 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 734/1478] 10.222.0.70 () {56 vars in 1108 bytes} [Mon Aug 1 14:16:21 2022] GET /identity/v3/projects => generated 2553 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:16:24.060342 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d275d7d-88ce-4eef-b07d-cd8f2024bdf4 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:24.060847 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d275d7d-88ce-4eef-b07d-cd8f2024bdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:24.060958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d275d7d-88ce-4eef-b07d-cd8f2024bdf4 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:24.062245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 745/1479] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:16:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:16:24.067664 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9657a-d66e-4eda-9d18-95d1322b5293 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:24.068065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9657a-d66e-4eda-9d18-95d1322b5293 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:24.068247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b9657a-d66e-4eda-9d18-95d1322b5293 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:24.133563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-33b9657a-d66e-4eda-9d18-95d1322b5293 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:16:24.134796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-33b9657a-d66e-4eda-9d18-95d1322b5293 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:24.233104 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 735/1480] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:16:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:16:24.275522 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d275d7d-88ce-4eef-b07d-cd8f2024bdf4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:24.277078 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4d275d7d-88ce-4eef-b07d-cd8f2024bdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:24.287596 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:24.425581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d275d7d-88ce-4eef-b07d-cd8f2024bdf4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:24.504725 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:24.537503 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a6e757-983e-4de7-8fe0-e616965bf128 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:24.538112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6e757-983e-4de7-8fe0-e616965bf128 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:24.538391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6e757-983e-4de7-8fe0-e616965bf128 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:24.538692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a6e757-983e-4de7-8fe0-e616965bf128 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:24.540316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e4a6e757-983e-4de7-8fe0-e616965bf128 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:24.627355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6e757-983e-4de7-8fe0-e616965bf128 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:24.629553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a6e757-983e-4de7-8fe0-e616965bf128 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:24.648027 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 746/1481] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:16:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:16:26.822236 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3777b7-2403-433d-a333-34ff7bdaec9a None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:26.822833 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3777b7-2403-433d-a333-34ff7bdaec9a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:26.822833 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3777b7-2403-433d-a333-34ff7bdaec9a None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:26.824172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 736/1482] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:16:26.829260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed352d-763c-42b8-8685-0a16d8ee99e9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:26.829654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed352d-763c-42b8-8685-0a16d8ee99e9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:26.829812 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ed352d-763c-42b8-8685-0a16d8ee99e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:26.895982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c7ed352d-763c-42b8-8685-0a16d8ee99e9 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:16:26.897206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c7ed352d-763c-42b8-8685-0a16d8ee99e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:26.943450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:26.993978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 747/1483] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:16:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:16:27.029164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3777b7-2403-433d-a333-34ff7bdaec9a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:27.030768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fa3777b7-2403-433d-a333-34ff7bdaec9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:27.055442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:27.136283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3777b7-2403-433d-a333-34ff7bdaec9a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:27.209310 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aee572-39ce-4655-aa7a-ca953d89ac7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:27.209925 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aee572-39ce-4655-aa7a-ca953d89ac7d service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:27.210209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aee572-39ce-4655-aa7a-ca953d89ac7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:27.210484 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aee572-39ce-4655-aa7a-ca953d89ac7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:27.212151 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-48aee572-39ce-4655-aa7a-ca953d89ac7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:27.285699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:27.319813 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aee572-39ce-4655-aa7a-ca953d89ac7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:27.321266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aee572-39ce-4655-aa7a-ca953d89ac7d service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:27.339914 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 737/1484] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:16:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:16:29.374001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adc749-b875-4292-b2e4-db42a4d32049 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:29.374562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adc749-b875-4292-b2e4-db42a4d32049 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:29.374562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0adc749-b875-4292-b2e4-db42a4d32049 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:29.375962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 748/1485] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:16:29.381279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ff0aa-703b-48cd-a6d0-451d0903bd62 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:29.381679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ff0aa-703b-48cd-a6d0-451d0903bd62 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:29.381850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ff0aa-703b-48cd-a6d0-451d0903bd62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:29.449768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0f9ff0aa-703b-48cd-a6d0-451d0903bd62 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:16:29.451875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0f9ff0aa-703b-48cd-a6d0-451d0903bd62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:29.549950 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 738/1486] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:16:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:16:29.588014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adc749-b875-4292-b2e4-db42a4d32049 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:29.589581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d0adc749-b875-4292-b2e4-db42a4d32049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:29.691922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0adc749-b875-4292-b2e4-db42a4d32049 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:29.763026 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:29.764891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4087411d-3217-4cba-b465-e932ca094f55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:29.765526 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087411d-3217-4cba-b465-e932ca094f55 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:29.766003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087411d-3217-4cba-b465-e932ca094f55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:29.766448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4087411d-3217-4cba-b465-e932ca094f55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:29.768288 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4087411d-3217-4cba-b465-e932ca094f55 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:29.880254 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087411d-3217-4cba-b465-e932ca094f55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:29.881690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4087411d-3217-4cba-b465-e932ca094f55 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:29.900359 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 749/1487] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:16:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:16:31.995141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbe4eb-6232-4441-bf50-af5e25e9fd77 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:31.995682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbe4eb-6232-4441-bf50-af5e25e9fd77 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:31.995799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bbe4eb-6232-4441-bf50-af5e25e9fd77 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:31.997059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 739/1488] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:16:32.002407 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c262ad1-d608-4d73-9e19-6a77940d3099 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:32.002834 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c262ad1-d608-4d73-9e19-6a77940d3099 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:32.002987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c262ad1-d608-4d73-9e19-6a77940d3099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:32.069307 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0c262ad1-d608-4d73-9e19-6a77940d3099 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:16:32.070430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0c262ad1-d608-4d73-9e19-6a77940d3099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:32.122455 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:32.166262 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 750/1489] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:16:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:16:32.206132 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbe4eb-6232-4441-bf50-af5e25e9fd77 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:32.208012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-72bbe4eb-6232-4441-bf50-af5e25e9fd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:32.244169 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:32.312324 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bbe4eb-6232-4441-bf50-af5e25e9fd77 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:32.384649 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75c3ffb-5c00-43be-8cd2-5925f71372f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:32.385189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c3ffb-5c00-43be-8cd2-5925f71372f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:32.385467 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c3ffb-5c00-43be-8cd2-5925f71372f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:32.385736 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75c3ffb-5c00-43be-8cd2-5925f71372f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:32.387370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a75c3ffb-5c00-43be-8cd2-5925f71372f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:32.471164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:32.500618 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c3ffb-5c00-43be-8cd2-5925f71372f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:32.502074 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75c3ffb-5c00-43be-8cd2-5925f71372f1 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:32.520200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 740/1490] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:16:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:16:34.737458 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5665d-dd30-43ac-b2d1-a6169bb22361 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:34.738029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5665d-dd30-43ac-b2d1-a6169bb22361 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:34.738029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5665d-dd30-43ac-b2d1-a6169bb22361 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:34.739425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 751/1491] 10.222.0.70 () {54 vars in 926 bytes} [Mon Aug 1 14:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:16:34.744454 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfc5d9-3824-445d-b710-bccc8cdc5462 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:34.744842 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfc5d9-3824-445d-b710-bccc8cdc5462 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:34.745004 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfc5d9-3824-445d-b710-bccc8cdc5462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:34.810788 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-96dfc5d9-3824-445d-b710-bccc8cdc5462 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:16:34.812013 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-96dfc5d9-3824-445d-b710-bccc8cdc5462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:34.907203 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 741/1492] 10.222.0.70 () {58 vars in 1023 bytes} [Mon Aug 1 14:16:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:16:34.946510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5665d-dd30-43ac-b2d1-a6169bb22361 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:16:34.948044 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2ed5665d-dd30-43ac-b2d1-a6169bb22361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:35.058279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5665d-dd30-43ac-b2d1-a6169bb22361 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:16:35.135134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb78b2e-03ab-4993-ace9-4af166f17010 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:16:35.135811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb78b2e-03ab-4993-ace9-4af166f17010 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:16:35.136099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb78b2e-03ab-4993-ace9-4af166f17010 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:16:35.136375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb78b2e-03ab-4993-ace9-4af166f17010 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:16:35.138029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8bb78b2e-03ab-4993-ace9-4af166f17010 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:16:35.148239 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:35.248751 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb78b2e-03ab-4993-ace9-4af166f17010 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:16:35.250176 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb78b2e-03ab-4993-ace9-4af166f17010 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:16:35.268616 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 752/1493] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:16:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:16:44.905388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=82 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:16:45.266281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=50 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:03.883491 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c91dcc-93ca-4b15-bb58-47d2fe0a051e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:03.884078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c91dcc-93ca-4b15-bb58-47d2fe0a051e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:03.884078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c91dcc-93ca-4b15-bb58-47d2fe0a051e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:03.960344 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-58c91dcc-93ca-4b15-bb58-47d2fe0a051e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:18:03.961541 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-58c91dcc-93ca-4b15-bb58-47d2fe0a051e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:04.058710 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 742/1494] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:18:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:18:04.066958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cef57-eff1-4b5f-b9f0-f38dfdd65840 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:04.067445 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cef57-eff1-4b5f-b9f0-f38dfdd65840 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:04.067558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85cef57-eff1-4b5f-b9f0-f38dfdd65840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:04.141776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d85cef57-eff1-4b5f-b9f0-f38dfdd65840 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:18:04.143711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d85cef57-eff1-4b5f-b9f0-f38dfdd65840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:04.238506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 753/1495] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:18:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:18:04.243125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c91dcc-93ca-4b15-bb58-47d2fe0a051e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:04.244326 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-58c91dcc-93ca-4b15-bb58-47d2fe0a051e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:04.256604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c91dcc-93ca-4b15-bb58-47d2fe0a051e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:04.315918 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:04.349671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899f83b-aa27-4ecb-9959-9e729da64845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:04.350288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899f83b-aa27-4ecb-9959-9e729da64845 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:04.350563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899f83b-aa27-4ecb-9959-9e729da64845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:04.350865 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899f83b-aa27-4ecb-9959-9e729da64845 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:04.351552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899f83b-aa27-4ecb-9959-9e729da64845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:18:04.351853 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899f83b-aa27-4ecb-9959-9e729da64845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:04.352876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: WARNING py.warnings [None req-9899f83b-aa27-4ecb-9959-9e729da64845 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:04.352876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: warnings.warn(msg) Aug 01 14:18:04.352876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: Aug 01 14:18:04.353761 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899f83b-aa27-4ecb-9959-9e729da64845 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:04.364989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 743/1496] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:18:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:18:04.373584 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cef57-eff1-4b5f-b9f0-f38dfdd65840 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:04.383242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85cef57-eff1-4b5f-b9f0-f38dfdd65840 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:04.448803 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:04.483719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4da0d-ea55-427b-9e68-2dada1837e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:04.484337 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4da0d-ea55-427b-9e68-2dada1837e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:04.484619 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4da0d-ea55-427b-9e68-2dada1837e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:04.484891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4da0d-ea55-427b-9e68-2dada1837e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:04.485551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4da0d-ea55-427b-9e68-2dada1837e86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:04.487325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: WARNING py.warnings [None req-b6a4da0d-ea55-427b-9e68-2dada1837e86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:04.487325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: warnings.warn(msg) Aug 01 14:18:04.487325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: Aug 01 14:18:04.488552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4da0d-ea55-427b-9e68-2dada1837e86 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:04.544061 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 754/1497] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:18:04 2022] POST /identity/v3/projects => generated 379 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:18:04.548313 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899f83b-aa27-4ecb-9959-9e729da64845 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:04.549903 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9899f83b-aa27-4ecb-9959-9e729da64845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:04.584040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899f83b-aa27-4ecb-9959-9e729da64845 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:04.678483 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c295c80-cc62-49cd-b3fc-b1da949abc1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:04.679118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c295c80-cc62-49cd-b3fc-b1da949abc1a admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:04.679395 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c295c80-cc62-49cd-b3fc-b1da949abc1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:04.679665 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c295c80-cc62-49cd-b3fc-b1da949abc1a admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:04.680319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c295c80-cc62-49cd-b3fc-b1da949abc1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:04.681337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: WARNING py.warnings [None req-5c295c80-cc62-49cd-b3fc-b1da949abc1a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:04.681337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: warnings.warn(msg) Aug 01 14:18:04.681337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: Aug 01 14:18:04.682541 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c295c80-cc62-49cd-b3fc-b1da949abc1a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:04.724094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 744/1498] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:18:04 2022] POST /identity/v3/users => generated 290 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:18:04.727872 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4da0d-ea55-427b-9e68-2dada1837e86 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:04.729408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b6a4da0d-ea55-427b-9e68-2dada1837e86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:04.793411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4da0d-ea55-427b-9e68-2dada1837e86 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:04.879538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:04.890450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b1975-cc48-481a-8b40-ebf1906a133c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:04.891098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b1975-cc48-481a-8b40-ebf1906a133c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:04.891377 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b1975-cc48-481a-8b40-ebf1906a133c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:04.891648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6b1975-cc48-481a-8b40-ebf1906a133c admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:04.892885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b1975-cc48-481a-8b40-ebf1906a133c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:04.893890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: WARNING py.warnings [None req-de6b1975-cc48-481a-8b40-ebf1906a133c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:04.893890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: warnings.warn(msg) Aug 01 14:18:04.893890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: Aug 01 14:18:04.894805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6b1975-cc48-481a-8b40-ebf1906a133c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:04.907475 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 755/1499] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:18:04.912029 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c295c80-cc62-49cd-b3fc-b1da949abc1a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:04.913636 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5c295c80-cc62-49cd-b3fc-b1da949abc1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:04.925198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c295c80-cc62-49cd-b3fc-b1da949abc1a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:04.950046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:05.025979 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91478b44-1bcd-4251-bc87-6d168f51d3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:05.026622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91478b44-1bcd-4251-bc87-6d168f51d3df admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:05.026908 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91478b44-1bcd-4251-bc87-6d168f51d3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:05.027176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91478b44-1bcd-4251-bc87-6d168f51d3df admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:05.027861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91478b44-1bcd-4251-bc87-6d168f51d3df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:05.028887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: WARNING py.warnings [None req-91478b44-1bcd-4251-bc87-6d168f51d3df admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:05.028887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: warnings.warn(msg) Aug 01 14:18:05.028887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: Aug 01 14:18:05.029776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91478b44-1bcd-4251-bc87-6d168f51d3df admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:05.042031 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 745/1500] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:18:04 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:18:05.046347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b1975-cc48-481a-8b40-ebf1906a133c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:05.047899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-de6b1975-cc48-481a-8b40-ebf1906a133c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:05.081468 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6b1975-cc48-481a-8b40-ebf1906a133c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:05.178237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f4bef7-b03b-4f17-8e9a-0b8844cb1429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:05.178950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4bef7-b03b-4f17-8e9a-0b8844cb1429 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:05.179231 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4bef7-b03b-4f17-8e9a-0b8844cb1429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:05.179513 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f4bef7-b03b-4f17-8e9a-0b8844cb1429 admin admin] PATH_INFO: `/v3/projects/45114cc3543c4be286a9064555da680e/users/904fd6b382a9491496d22e772c408659/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:05.201561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4bef7-b03b-4f17-8e9a-0b8844cb1429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45114cc3543c4be286a9064555da680e, user_id=904fd6b382a9491496d22e772c408659, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:05.202597 dv-cinder-845990-5-smb devstack@keystone.service[80141]: WARNING py.warnings [None req-66f4bef7-b03b-4f17-8e9a-0b8844cb1429 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:05.202597 dv-cinder-845990-5-smb devstack@keystone.service[80141]: warnings.warn(msg) Aug 01 14:18:05.202597 dv-cinder-845990-5-smb devstack@keystone.service[80141]: Aug 01 14:18:05.205194 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f4bef7-b03b-4f17-8e9a-0b8844cb1429 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:05.229102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 756/1501] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:18:05 2022] PUT /identity/v3/projects/45114cc3543c4be286a9064555da680e/users/904fd6b382a9491496d22e772c408659/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:18:05.241257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80aac5-cadb-4e56-86da-5a45db34d5a7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:05.241546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80aac5-cadb-4e56-86da-5a45db34d5a7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:05.241819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f80aac5-cadb-4e56-86da-5a45db34d5a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:05.302742 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1f80aac5-cadb-4e56-86da-5a45db34d5a7 None None] MFA Rules not processed for user `904fd6b382a9491496d22e772c408659`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:18:05.304120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1f80aac5-cadb-4e56-86da-5a45db34d5a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:05.388852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 746/1502] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:18:05.402662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f4b6e-b9d6-4e03-81c6-40d68b988780 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:05.402662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f4b6e-b9d6-4e03-81c6-40d68b988780 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:05.402956 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2f4b6e-b9d6-4e03-81c6-40d68b988780 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:05.404287 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 757/1503] 10.222.0.70 () {54 vars in 964 bytes} [Mon Aug 1 14:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:18:05.409349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78000bdd-df61-4855-8182-8828123ec660 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:05.409635 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78000bdd-df61-4855-8182-8828123ec660 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:05.409911 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78000bdd-df61-4855-8182-8828123ec660 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:05.441323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:05.485019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-78000bdd-df61-4855-8182-8828123ec660 None None] MFA Rules not processed for user `a41da5d6d38341deaf1563fe0ebac32b`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:18:05.486766 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-78000bdd-df61-4855-8182-8828123ec660 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:05.561419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 747/1504] 10.222.0.70 () {58 vars in 1061 bytes} [Mon Aug 1 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:18:05.569712 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f4b6e-b9d6-4e03-81c6-40d68b988780 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:05.571329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7d2f4b6e-b9d6-4e03-81c6-40d68b988780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:05.620616 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:05.677260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2f4b6e-b9d6-4e03-81c6-40d68b988780 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:05.754091 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a59915-7efe-4bc2-851c-714f55c872d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:05.754736 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a59915-7efe-4bc2-851c-714f55c872d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:05.755014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a59915-7efe-4bc2-851c-714f55c872d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:05.755290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a59915-7efe-4bc2-851c-714f55c872d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:05.756916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-28a59915-7efe-4bc2-851c-714f55c872d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:05.856163 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a59915-7efe-4bc2-851c-714f55c872d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:05.857528 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a59915-7efe-4bc2-851c-714f55c872d2 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:05.861627 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:05.876270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 758/1505] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:18:05 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:18:05.920626 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53d63-d3ff-444b-b291-305cb66deeab None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:05.921040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53d63-d3ff-444b-b291-305cb66deeab None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:05.921178 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c53d63-d3ff-444b-b291-305cb66deeab None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:05.922440 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 748/1506] 10.222.0.70 () {52 vars in 830 bytes} [Mon Aug 1 14:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:18:05.926701 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a59915-7efe-4bc2-851c-714f55c872d2 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:05.927947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-28a59915-7efe-4bc2-851c-714f55c872d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:06.030254 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a59915-7efe-4bc2-851c-714f55c872d2 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:06.123565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81335da3-4e51-4609-aff6-51e5e3af43c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:06.124225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81335da3-4e51-4609-aff6-51e5e3af43c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:06.124411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81335da3-4e51-4609-aff6-51e5e3af43c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:06.124678 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81335da3-4e51-4609-aff6-51e5e3af43c4 admin admin] PATH_INFO: `/v3/users/904fd6b382a9491496d22e772c408659` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:06.136765 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81335da3-4e51-4609-aff6-51e5e3af43c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=904fd6b382a9491496d22e772c408659)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:06.137789 dv-cinder-845990-5-smb devstack@keystone.service[80141]: WARNING py.warnings [None req-81335da3-4e51-4609-aff6-51e5e3af43c4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:06.137789 dv-cinder-845990-5-smb devstack@keystone.service[80141]: warnings.warn(msg) Aug 01 14:18:06.137789 dv-cinder-845990-5-smb devstack@keystone.service[80141]: Aug 01 14:18:06.139030 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81335da3-4e51-4609-aff6-51e5e3af43c4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:06.149101 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:06.204356 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-81335da3-4e51-4609-aff6-51e5e3af43c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '904fd6b382a9491496d22e772c408659'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:18:06.228097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-81335da3-4e51-4609-aff6-51e5e3af43c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '904fd6b382a9491496d22e772c408659'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:18:06.241681 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-81335da3-4e51-4609-aff6-51e5e3af43c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '904fd6b382a9491496d22e772c408659'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:18:06.242174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-81335da3-4e51-4609-aff6-51e5e3af43c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '904fd6b382a9491496d22e772c408659'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:18:06.250506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-81335da3-4e51-4609-aff6-51e5e3af43c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '904fd6b382a9491496d22e772c408659'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:18:06.256488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 759/1507] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:18:05 2022] DELETE /identity/v3/users/904fd6b382a9491496d22e772c408659 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:18:06.261075 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d930-f2fb-4cb5-9ca7-6ff2b92cb174 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:06.261432 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d930-f2fb-4cb5-9ca7-6ff2b92cb174 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:06.261820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0492d930-f2fb-4cb5-9ca7-6ff2b92cb174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:06.318283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0492d930-f2fb-4cb5-9ca7-6ff2b92cb174 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:18:06.319506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0492d930-f2fb-4cb5-9ca7-6ff2b92cb174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:06.394962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:06.408624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 749/1508] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:18:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:18:06.418732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81335da3-4e51-4609-aff6-51e5e3af43c4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:06.419981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-81335da3-4e51-4609-aff6-51e5e3af43c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:06.520440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81335da3-4e51-4609-aff6-51e5e3af43c4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:06.576380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:06.597670 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf3bd7-8890-45b5-87ac-72b1dc7123b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:06.598290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf3bd7-8890-45b5-87ac-72b1dc7123b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:06.598600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf3bd7-8890-45b5-87ac-72b1dc7123b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:06.598866 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf3bd7-8890-45b5-87ac-72b1dc7123b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:06.600492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-23cf3bd7-8890-45b5-87ac-72b1dc7123b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:06.709366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf3bd7-8890-45b5-87ac-72b1dc7123b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:06.710758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cf3bd7-8890-45b5-87ac-72b1dc7123b0 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:06.728770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 760/1509] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:18:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:18:07.083928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492d930-f2fb-4cb5-9ca7-6ff2b92cb174 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:18:07.085628 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0492d930-f2fb-4cb5-9ca7-6ff2b92cb174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:18:07.099431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0492d930-f2fb-4cb5-9ca7-6ff2b92cb174 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:18:07.206635 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2720e4d9-722c-4eae-abd8-bcba2fffb926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:18:07.206856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720e4d9-722c-4eae-abd8-bcba2fffb926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:18:07.207157 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720e4d9-722c-4eae-abd8-bcba2fffb926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:18:07.207699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2720e4d9-722c-4eae-abd8-bcba2fffb926 admin admin] PATH_INFO: `/v3/projects/45114cc3543c4be286a9064555da680e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:18:07.218403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720e4d9-722c-4eae-abd8-bcba2fffb926 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45114cc3543c4be286a9064555da680e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:18:07.219535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: WARNING py.warnings [None req-2720e4d9-722c-4eae-abd8-bcba2fffb926 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:18:07.219535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: warnings.warn(msg) Aug 01 14:18:07.219535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: Aug 01 14:18:07.220778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2720e4d9-722c-4eae-abd8-bcba2fffb926 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:18:07.278720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2720e4d9-722c-4eae-abd8-bcba2fffb926 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45114cc3543c4be286a9064555da680e', 'request_id': 'req-2720e4d9-722c-4eae-abd8-bcba2fffb926'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:18:07.285066 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2720e4d9-722c-4eae-abd8-bcba2fffb926 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45114cc3543c4be286a9064555da680e', 'request_id': 'req-2720e4d9-722c-4eae-abd8-bcba2fffb926'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:18:07.294138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2720e4d9-722c-4eae-abd8-bcba2fffb926 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45114cc3543c4be286a9064555da680e', 'request_id': 'req-2720e4d9-722c-4eae-abd8-bcba2fffb926'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:18:07.323151 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2720e4d9-722c-4eae-abd8-bcba2fffb926 admin admin] The token cache is being invalidate because project 45114cc3543c4be286a9064555da680e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:18:07.323434 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2720e4d9-722c-4eae-abd8-bcba2fffb926 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:18:07.323854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2720e4d9-722c-4eae-abd8-bcba2fffb926 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:18:07.325251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 750/1510] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:18:07 2022] DELETE /identity/v3/projects/45114cc3543c4be286a9064555da680e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:18:16.726550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=62 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:18:17.321134 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:01.717078 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54939a-4c1a-490c-8112-cea2480fb251 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:01.717680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54939a-4c1a-490c-8112-cea2480fb251 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:01.717680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff54939a-4c1a-490c-8112-cea2480fb251 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:01.719027 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:01.723800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c812547-3eef-4c19-bac8-81e0220037f7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:01.724253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c812547-3eef-4c19-bac8-81e0220037f7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:01.724375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c812547-3eef-4c19-bac8-81e0220037f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:01.803430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-5c812547-3eef-4c19-bac8-81e0220037f7 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:01.805179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5c812547-3eef-4c19-bac8-81e0220037f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:01.911611 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:20:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:02.070508 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54939a-4c1a-490c-8112-cea2480fb251 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:02.072652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ff54939a-4c1a-490c-8112-cea2480fb251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:02.191110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff54939a-4c1a-490c-8112-cea2480fb251 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:02.196583 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c1f1c55-5da3-4548-aa25-8a2aa4d6f7f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:02.197199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f1c55-5da3-4548-aa25-8a2aa4d6f7f8 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:02.197483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f1c55-5da3-4548-aa25-8a2aa4d6f7f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:02.197759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c1f1c55-5da3-4548-aa25-8a2aa4d6f7f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:02.205756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f1c55-5da3-4548-aa25-8a2aa4d6f7f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:02.207644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c1f1c55-5da3-4548-aa25-8a2aa4d6f7f8 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:02.217002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 762/1513] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:03.043349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d85506-a972-46b7-b676-58a80c24a904 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:03.043835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d85506-a972-46b7-b676-58a80c24a904 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:03.043950 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d85506-a972-46b7-b676-58a80c24a904 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:03.045251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:03.050243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc257b-916b-466a-bdfa-5542872cddc9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:03.050662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc257b-916b-466a-bdfa-5542872cddc9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:03.050828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dc257b-916b-466a-bdfa-5542872cddc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:03.070072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c8dc257b-916b-466a-bdfa-5542872cddc9 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:03.071305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c8dc257b-916b-466a-bdfa-5542872cddc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:03.079157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:20:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:03.229739 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d85506-a972-46b7-b676-58a80c24a904 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:03.244091 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d85506-a972-46b7-b676-58a80c24a904 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:03.249513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5700ecc9-8be6-46db-9037-9b09c2eb5f78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:03.250113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700ecc9-8be6-46db-9037-9b09c2eb5f78 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:03.250394 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700ecc9-8be6-46db-9037-9b09c2eb5f78 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:03.250705 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5700ecc9-8be6-46db-9037-9b09c2eb5f78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:03.258824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700ecc9-8be6-46db-9037-9b09c2eb5f78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:03.260420 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5700ecc9-8be6-46db-9037-9b09c2eb5f78 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:03.269767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 753/1516] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:03.726919 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026354db-f50c-4d57-b523-0a00608cb7a8 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:03.727206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026354db-f50c-4d57-b523-0a00608cb7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:03.727508 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026354db-f50c-4d57-b523-0a00608cb7a8 None None] PATH_INFO: `/v3` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:03.728807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 764/1517] 10.222.0.67 () {54 vars in 925 bytes} [Mon Aug 1 14:20:03 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:20:03.735448 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4b958-4b73-4cc9-9b63-8c7f9373ef44 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:03.735735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4b958-4b73-4cc9-9b63-8c7f9373ef44 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:03.736007 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c4b958-4b73-4cc9-9b63-8c7f9373ef44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:03.793875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f8c4b958-4b73-4cc9-9b63-8c7f9373ef44 None None] MFA Rules not processed for user `e210ee6c390849e7a630a677ec52e966`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:03.795086 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f8c4b958-4b73-4cc9-9b63-8c7f9373ef44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:03.812640 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:03.867574 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 754/1518] 10.222.0.67 () {58 vars in 1015 bytes} [Mon Aug 1 14:20:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:20:12.918770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563cfb7-094f-459e-8856-2e550987a0eb None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:12.919561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563cfb7-094f-459e-8856-2e550987a0eb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:12.919561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1563cfb7-094f-459e-8856-2e550987a0eb None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:12.923777 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 765/1519] 10.222.0.70 () {54 vars in 961 bytes} [Mon Aug 1 14:20:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:12.931013 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e3b0f-32e1-44cc-9949-c4a01fb915c8 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:12.931013 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e3b0f-32e1-44cc-9949-c4a01fb915c8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:12.931013 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7e3b0f-32e1-44cc-9949-c4a01fb915c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:12.951928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7b7e3b0f-32e1-44cc-9949-c4a01fb915c8 None None] MFA Rules not processed for user `e210ee6c390849e7a630a677ec52e966`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:12.953180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7b7e3b0f-32e1-44cc-9949-c4a01fb915c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:12.962743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 755/1520] 10.222.0.70 () {58 vars in 1058 bytes} [Mon Aug 1 14:20:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:12.971493 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563cfb7-094f-459e-8856-2e550987a0eb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:12.985948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1563cfb7-094f-459e-8856-2e550987a0eb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:12.990918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0928a8a8-4fa7-44b4-b021-b8eadb148dc2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210ee6c390849e7a630a677ec52e966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:12.991559 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928a8a8-4fa7-44b4-b021-b8eadb148dc2 service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:12.991838 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928a8a8-4fa7-44b4-b021-b8eadb148dc2 service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:12.992107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0928a8a8-4fa7-44b4-b021-b8eadb148dc2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:13.002326 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928a8a8-4fa7-44b4-b021-b8eadb148dc2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:13.003978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0928a8a8-4fa7-44b4-b021-b8eadb148dc2 service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:13.013879 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 766/1521] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:14.488730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6a124-e0c3-47ae-89e2-05d82ccfb1eb None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:14.489332 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6a124-e0c3-47ae-89e2-05d82ccfb1eb None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:14.489332 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec6a124-e0c3-47ae-89e2-05d82ccfb1eb None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:14.490639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:20:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:14.496170 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811abcf-cbac-423d-bc25-8614b1d5e5f2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:14.496629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811abcf-cbac-423d-bc25-8614b1d5e5f2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:14.496726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4811abcf-cbac-423d-bc25-8614b1d5e5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:14.516349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4811abcf-cbac-423d-bc25-8614b1d5e5f2 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:14.517539 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4811abcf-cbac-423d-bc25-8614b1d5e5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:14.525303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:20:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:20:14.677992 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6a124-e0c3-47ae-89e2-05d82ccfb1eb None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:14.695118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec6a124-e0c3-47ae-89e2-05d82ccfb1eb None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:14.700451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac83e792-2ef7-4f9c-8ed4-e41f233b63fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:14.701170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83e792-2ef7-4f9c-8ed4-e41f233b63fd service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:14.701552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83e792-2ef7-4f9c-8ed4-e41f233b63fd service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:14.701825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac83e792-2ef7-4f9c-8ed4-e41f233b63fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:14.710171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83e792-2ef7-4f9c-8ed4-e41f233b63fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:14.711808 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac83e792-2ef7-4f9c-8ed4-e41f233b63fd service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:14.720968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 757/1524] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:15.541375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364876c1-85ec-4987-9eb4-afd17172c41f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:15.541941 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364876c1-85ec-4987-9eb4-afd17172c41f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:15.541941 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364876c1-85ec-4987-9eb4-afd17172c41f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:15.543335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 1 14:20:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:15.548626 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8006f4-b599-4716-9f80-c06d4395bb6a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:15.549092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8006f4-b599-4716-9f80-c06d4395bb6a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:15.549202 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8006f4-b599-4716-9f80-c06d4395bb6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:15.568539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8e8006f4-b599-4716-9f80-c06d4395bb6a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:15.569777 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8e8006f4-b599-4716-9f80-c06d4395bb6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:15.577610 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 1 14:20:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:15.729939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364876c1-85ec-4987-9eb4-afd17172c41f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:15.744720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364876c1-85ec-4987-9eb4-afd17172c41f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:15.750170 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb785839-3994-4406-b873-edfeef4e10bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:15.750802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb785839-3994-4406-b873-edfeef4e10bc service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:15.751360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb785839-3994-4406-b873-edfeef4e10bc service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:15.751641 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb785839-3994-4406-b873-edfeef4e10bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:15.759709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb785839-3994-4406-b873-edfeef4e10bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:15.761282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb785839-3994-4406-b873-edfeef4e10bc service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:15.770644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 769/1527] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:19.715292 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274c291-7823-4b7f-a084-85fdd6ed397d None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.715891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274c291-7823-4b7f-a084-85fdd6ed397d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.715891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3274c291-7823-4b7f-a084-85fdd6ed397d None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.717182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:19.722476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d2e08-a8cd-4b14-a868-a12c874478d7 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.722897 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d2e08-a8cd-4b14-a868-a12c874478d7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.723183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925d2e08-a8cd-4b14-a868-a12c874478d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.743533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-925d2e08-a8cd-4b14-a868-a12c874478d7 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:19.744745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-925d2e08-a8cd-4b14-a868-a12c874478d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.752480 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:19.825102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274c291-7823-4b7f-a084-85fdd6ed397d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:19.826858 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3274c291-7823-4b7f-a084-85fdd6ed397d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:19.905114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3274c291-7823-4b7f-a084-85fdd6ed397d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:19.908702 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb23c3f-ce1b-4c0c-93de-9fa786db6974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:19.909311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb23c3f-ce1b-4c0c-93de-9fa786db6974 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:19.909591 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb23c3f-ce1b-4c0c-93de-9fa786db6974 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:19.909864 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb23c3f-ce1b-4c0c-93de-9fa786db6974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:19.918771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb23c3f-ce1b-4c0c-93de-9fa786db6974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:19.920214 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb23c3f-ce1b-4c0c-93de-9fa786db6974 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:19.929382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 760/1530] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:21.925872 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cce2ba-0f08-461c-b32c-c10554f99d53 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.926465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cce2ba-0f08-461c-b32c-c10554f99d53 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.926465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cce2ba-0f08-461c-b32c-c10554f99d53 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.927840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:20:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:21.932972 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b85970-cccb-4ec5-9e95-a5b219cf28f5 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:21.933390 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b85970-cccb-4ec5-9e95-a5b219cf28f5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:21.933505 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b85970-cccb-4ec5-9e95-a5b219cf28f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:21.952565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f6b85970-cccb-4ec5-9e95-a5b219cf28f5 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:21.953749 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f6b85970-cccb-4ec5-9e95-a5b219cf28f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:21.962621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:20:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:21.998789 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cce2ba-0f08-461c-b32c-c10554f99d53 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:22.000534 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c4cce2ba-0f08-461c-b32c-c10554f99d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:22.013453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cce2ba-0f08-461c-b32c-c10554f99d53 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:22.017012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423f7072-1723-4369-9e74-c8c3c04aa081 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:22.017612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f7072-1723-4369-9e74-c8c3c04aa081 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:22.017899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f7072-1723-4369-9e74-c8c3c04aa081 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:22.018175 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423f7072-1723-4369-9e74-c8c3c04aa081 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:22.027658 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f7072-1723-4369-9e74-c8c3c04aa081 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:22.029084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423f7072-1723-4369-9e74-c8c3c04aa081 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:22.039202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 772/1533] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:25.661115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd13eb-e123-4a00-aadb-f943049ab9d2 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:25.661726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd13eb-e123-4a00-aadb-f943049ab9d2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:25.661726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04dd13eb-e123-4a00-aadb-f943049ab9d2 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:25.663699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:25.668755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40ac20-83fe-4ea2-87d6-acde5fc5fb26 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:25.669175 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40ac20-83fe-4ea2-87d6-acde5fc5fb26 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:25.669305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b40ac20-83fe-4ea2-87d6-acde5fc5fb26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:25.688360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0b40ac20-83fe-4ea2-87d6-acde5fc5fb26 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:25.689535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0b40ac20-83fe-4ea2-87d6-acde5fc5fb26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:25.697447 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:20:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:26.006559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd13eb-e123-4a00-aadb-f943049ab9d2 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:26.008263 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-04dd13eb-e123-4a00-aadb-f943049ab9d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:26.072406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:26.086525 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04dd13eb-e123-4a00-aadb-f943049ab9d2 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:26.090367 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002bd4f0-afa5-49f2-946e-e5bd6cba68c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:26.091180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bd4f0-afa5-49f2-946e-e5bd6cba68c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:26.091684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bd4f0-afa5-49f2-946e-e5bd6cba68c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:26.092195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002bd4f0-afa5-49f2-946e-e5bd6cba68c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:26.105656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bd4f0-afa5-49f2-946e-e5bd6cba68c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:26.107165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002bd4f0-afa5-49f2-946e-e5bd6cba68c4 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:26.117324 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 763/1536] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:28.124377 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29643a5-d642-4cb7-8b71-5cefc92e3b4e None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:28.124926 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29643a5-d642-4cb7-8b71-5cefc92e3b4e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:28.124926 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29643a5-d642-4cb7-8b71-5cefc92e3b4e None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:28.126284 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Mon Aug 1 14:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:20:28.131642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa3756-7ff2-4851-9bff-9a1add3a96d9 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:28.132215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa3756-7ff2-4851-9bff-9a1add3a96d9 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:28.132215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfa3756-7ff2-4851-9bff-9a1add3a96d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:28.151653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7dfa3756-7ff2-4851-9bff-9a1add3a96d9 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:20:28.152852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7dfa3756-7ff2-4851-9bff-9a1add3a96d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:28.160700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Mon Aug 1 14:20:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:20:28.470036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29643a5-d642-4cb7-8b71-5cefc92e3b4e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:20:28.471764 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a29643a5-d642-4cb7-8b71-5cefc92e3b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:20:28.479813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:28.486425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29643a5-d642-4cb7-8b71-5cefc92e3b4e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:20:28.489961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9ee17d-39cc-4d9c-9168-c899b099ce78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:20:28.490557 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ee17d-39cc-4d9c-9168-c899b099ce78 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:20:28.490860 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ee17d-39cc-4d9c-9168-c899b099ce78 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:20:28.491686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9ee17d-39cc-4d9c-9168-c899b099ce78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:20:28.500545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ee17d-39cc-4d9c-9168-c899b099ce78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:20:28.501954 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9ee17d-39cc-4d9c-9168-c899b099ce78 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:20:28.511103 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 775/1539] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:20:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:20:38.146879 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=11 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:20:38.507024 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:11.380176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c3e56-62b3-42e0-bd89-252ee153927f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.380871 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c3e56-62b3-42e0-bd89-252ee153927f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.380871 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38c3e56-62b3-42e0-bd89-252ee153927f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.402992 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e38c3e56-62b3-42e0-bd89-252ee153927f None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:11.404329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e38c3e56-62b3-42e0-bd89-252ee153927f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:11.417177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 765/1540] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:11.426176 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d512c8-b51b-4956-b134-0654b0bb3099 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.426775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d512c8-b51b-4956-b134-0654b0bb3099 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.426775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d512c8-b51b-4956-b134-0654b0bb3099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.453091 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e1d512c8-b51b-4956-b134-0654b0bb3099 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:11.454311 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e1d512c8-b51b-4956-b134-0654b0bb3099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:11.467599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 776/1541] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:11.473320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c3e56-62b3-42e0-bd89-252ee153927f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:11.484016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38c3e56-62b3-42e0-bd89-252ee153927f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:11.493092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c8335d-7201-42c3-a458-cb23d73c9741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:11.493730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8335d-7201-42c3-a458-cb23d73c9741 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.494007 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8335d-7201-42c3-a458-cb23d73c9741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.494280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c8335d-7201-42c3-a458-cb23d73c9741 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.495022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8335d-7201-42c3-a458-cb23d73c9741 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:11.495324 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8335d-7201-42c3-a458-cb23d73c9741 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:11.496961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c8335d-7201-42c3-a458-cb23d73c9741 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:11.510444 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 766/1542] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:11.518407 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d512c8-b51b-4956-b134-0654b0bb3099 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:11.528350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d512c8-b51b-4956-b134-0654b0bb3099 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:11.537511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecaf96-5878-45df-a058-b937047f7530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:11.538155 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecaf96-5878-45df-a058-b937047f7530 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.538437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecaf96-5878-45df-a058-b937047f7530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.538746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ecaf96-5878-45df-a058-b937047f7530 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.539434 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecaf96-5878-45df-a058-b937047f7530 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:11.541365 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ecaf96-5878-45df-a058-b937047f7530 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:11.575304 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034e7a4-1ce8-48a1-880b-92d9bfd24c51 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.575665 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034e7a4-1ce8-48a1-880b-92d9bfd24c51 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.575917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e034e7a4-1ce8-48a1-880b-92d9bfd24c51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.611219 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e034e7a4-1ce8-48a1-880b-92d9bfd24c51 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:11.612442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e034e7a4-1ce8-48a1-880b-92d9bfd24c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:11.615206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 777/1543] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:11.623776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecaf96-5878-45df-a058-b937047f7530 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:11.765271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 767/1544] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:11.766467 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555da02-c9d6-4249-863d-5f41680c699a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.766781 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555da02-c9d6-4249-863d-5f41680c699a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.767191 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1555da02-c9d6-4249-863d-5f41680c699a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.775058 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ecaf96-5878-45df-a058-b937047f7530 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:11.784390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ccdb6e-1acb-40bb-a49d-60a24010c99e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:11.785547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccdb6e-1acb-40bb-a49d-60a24010c99e admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.785824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccdb6e-1acb-40bb-a49d-60a24010c99e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.786094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ccdb6e-1acb-40bb-a49d-60a24010c99e admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.787641 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccdb6e-1acb-40bb-a49d-60a24010c99e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:11.788849 dv-cinder-845990-5-smb devstack@keystone.service[80141]: WARNING py.warnings [None req-85ccdb6e-1acb-40bb-a49d-60a24010c99e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:22:11.788849 dv-cinder-845990-5-smb devstack@keystone.service[80141]: warnings.warn(msg) Aug 01 14:22:11.788849 dv-cinder-845990-5-smb devstack@keystone.service[80141]: Aug 01 14:22:11.791102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ccdb6e-1acb-40bb-a49d-60a24010c99e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:11.809635 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1555da02-c9d6-4249-863d-5f41680c699a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:11.811087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1555da02-c9d6-4249-863d-5f41680c699a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:11.826530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 768/1545] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:11.829226 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0d255-8048-444b-a359-8fbf82c2b062 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.829512 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0d255-8048-444b-a359-8fbf82c2b062 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.829807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0d255-8048-444b-a359-8fbf82c2b062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.835480 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 778/1546] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/users => generated 285 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:11.836753 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579e091-a460-428a-b57e-4f0e2abf5125 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.837039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579e091-a460-428a-b57e-4f0e2abf5125 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.837312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d579e091-a460-428a-b57e-4f0e2abf5125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.866986 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-80e0d255-8048-444b-a359-8fbf82c2b062 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:11.868248 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-80e0d255-8048-444b-a359-8fbf82c2b062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:11.868886 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d579e091-a460-428a-b57e-4f0e2abf5125 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:11.870260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d579e091-a460-428a-b57e-4f0e2abf5125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:11.882607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 769/1547] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:11.882607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f4bdf-af9c-4635-a27b-fb24af263e32 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.882607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f4bdf-af9c-4635-a27b-fb24af263e32 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.882607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f4bdf-af9c-4635-a27b-fb24af263e32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.883646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 779/1548] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:11.885264 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c7412-6b82-4f56-b750-788e81186e9e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.885749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c7412-6b82-4f56-b750-788e81186e9e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.886234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25c7412-6b82-4f56-b750-788e81186e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.911096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-cd1f4bdf-af9c-4635-a27b-fb24af263e32 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:11.912537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cd1f4bdf-af9c-4635-a27b-fb24af263e32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:11.914785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e25c7412-6b82-4f56-b750-788e81186e9e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:11.916220 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e25c7412-6b82-4f56-b750-788e81186e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:11.921951 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 770/1549] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:11.929611 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f4bdf-af9c-4635-a27b-fb24af263e32 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:11.931393 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 780/1550] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:11.933238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46c453-9e10-46c0-b7ff-0218217a4eab None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.934719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46c453-9e10-46c0-b7ff-0218217a4eab None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.935273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46c453-9e10-46c0-b7ff-0218217a4eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.938528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f4bdf-af9c-4635-a27b-fb24af263e32 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:11.943730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f19d55-c22d-40d6-9b8b-927237354f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:11.944706 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f19d55-c22d-40d6-9b8b-927237354f4c admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.944977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f19d55-c22d-40d6-9b8b-927237354f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.945249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f19d55-c22d-40d6-9b8b-927237354f4c admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.945944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f19d55-c22d-40d6-9b8b-927237354f4c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:11.948663 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f19d55-c22d-40d6-9b8b-927237354f4c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:11.960409 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3d46c453-9e10-46c0-b7ff-0218217a4eab None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:11.962730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3d46c453-9e10-46c0-b7ff-0218217a4eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:11.967610 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 771/1551] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:11 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:11.967610 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db358a11-ace1-4211-b625-6ce5097a1195 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.967610 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db358a11-ace1-4211-b625-6ce5097a1195 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.967610 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db358a11-ace1-4211-b625-6ce5097a1195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.974288 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 781/1552] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:11.975552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f81c4-bfef-40ea-b6d2-2cf43d678162 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:11.975835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f81c4-bfef-40ea-b6d2-2cf43d678162 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:11.976259 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60f81c4-bfef-40ea-b6d2-2cf43d678162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:11.995542 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-db358a11-ace1-4211-b625-6ce5097a1195 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:11.995924 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a60f81c4-bfef-40ea-b6d2-2cf43d678162 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:11.996753 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-db358a11-ace1-4211-b625-6ce5097a1195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:11.997124 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a60f81c4-bfef-40ea-b6d2-2cf43d678162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.005488 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 772/1553] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:12.005865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 782/1554] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:12.009703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db358a11-ace1-4211-b625-6ce5097a1195 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.009829 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367bc63-945b-42e5-83f6-d6d40966fa9a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.009829 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367bc63-945b-42e5-83f6-d6d40966fa9a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.009829 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367bc63-945b-42e5-83f6-d6d40966fa9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.019443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db358a11-ace1-4211-b625-6ce5097a1195 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.024005 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58da5abb-93af-4b0c-859f-0ec4506d4276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.024608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da5abb-93af-4b0c-859f-0ec4506d4276 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.024883 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da5abb-93af-4b0c-859f-0ec4506d4276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.025152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58da5abb-93af-4b0c-859f-0ec4506d4276 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.025836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da5abb-93af-4b0c-859f-0ec4506d4276 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:12.026137 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da5abb-93af-4b0c-859f-0ec4506d4276 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.026832 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8367bc63-945b-42e5-83f6-d6d40966fa9a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:12.027774 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58da5abb-93af-4b0c-859f-0ec4506d4276 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.028015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8367bc63-945b-42e5-83f6-d6d40966fa9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.035860 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 783/1555] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:12.036823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367bc63-945b-42e5-83f6-d6d40966fa9a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.047182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 773/1556] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:12.047182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaaaa4-7cd0-4dc9-84bb-9e0b30fcd844 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.047182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaaaa4-7cd0-4dc9-84bb-9e0b30fcd844 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.047182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aaaaa4-7cd0-4dc9-84bb-9e0b30fcd844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.053341 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367bc63-945b-42e5-83f6-d6d40966fa9a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.058058 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8b1152-ff59-41f9-8065-3bb7779c5a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.058706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b1152-ff59-41f9-8065-3bb7779c5a8e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.058986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b1152-ff59-41f9-8065-3bb7779c5a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.059909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8b1152-ff59-41f9-8065-3bb7779c5a8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.060618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b1152-ff59-41f9-8065-3bb7779c5a8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:12.060923 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b1152-ff59-41f9-8065-3bb7779c5a8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.061932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: WARNING py.warnings [None req-4d8b1152-ff59-41f9-8065-3bb7779c5a8e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:22:12.061932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: warnings.warn(msg) Aug 01 14:22:12.061932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: Aug 01 14:22:12.062201 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e8aaaaa4-7cd0-4dc9-84bb-9e0b30fcd844 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:12.062835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8b1152-ff59-41f9-8065-3bb7779c5a8e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.063393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e8aaaaa4-7cd0-4dc9-84bb-9e0b30fcd844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.072188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 774/1557] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:12.073024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaaaa4-7cd0-4dc9-84bb-9e0b30fcd844 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.075530 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 784/1558] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:12.076647 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc50f7-6f14-438e-a0d7-2e9449e836f2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.076937 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc50f7-6f14-438e-a0d7-2e9449e836f2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.077211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eddc50f7-6f14-438e-a0d7-2e9449e836f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.088274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aaaaa4-7cd0-4dc9-84bb-9e0b30fcd844 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.092896 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68500ed2-77dc-4758-89f8-0fc6427119ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.093490 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68500ed2-77dc-4758-89f8-0fc6427119ac admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.093767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68500ed2-77dc-4758-89f8-0fc6427119ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.094036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68500ed2-77dc-4758-89f8-0fc6427119ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.094752 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68500ed2-77dc-4758-89f8-0fc6427119ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.096374 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68500ed2-77dc-4758-89f8-0fc6427119ac admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.096558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-eddc50f7-6f14-438e-a0d7-2e9449e836f2 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:12.097745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-eddc50f7-6f14-438e-a0d7-2e9449e836f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.105840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 785/1559] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:12.106375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 775/1560] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:12.106647 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc50f7-6f14-438e-a0d7-2e9449e836f2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.107029 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68500ed2-77dc-4758-89f8-0fc6427119ac admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.118057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eddc50f7-6f14-438e-a0d7-2e9449e836f2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.118460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68500ed2-77dc-4758-89f8-0fc6427119ac admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.122679 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45085b9-1603-48d2-825e-2ca6a62d6931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.122967 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef6481-1641-4aab-b113-6789754483b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.123288 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45085b9-1603-48d2-825e-2ca6a62d6931 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.123552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef6481-1641-4aab-b113-6789754483b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.123676 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45085b9-1603-48d2-825e-2ca6a62d6931 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.123841 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef6481-1641-4aab-b113-6789754483b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.123954 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45085b9-1603-48d2-825e-2ca6a62d6931 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.124133 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffef6481-1641-4aab-b113-6789754483b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.124538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45085b9-1603-48d2-825e-2ca6a62d6931 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:12.124774 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef6481-1641-4aab-b113-6789754483b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:12.124890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45085b9-1603-48d2-825e-2ca6a62d6931 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.125076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef6481-1641-4aab-b113-6789754483b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.126458 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45085b9-1603-48d2-825e-2ca6a62d6931 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.126667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffef6481-1641-4aab-b113-6789754483b4 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.138281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 786/1561] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:12.139066 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 776/1562] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:12.139350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111fb65-b90d-417e-b92c-d5c0b50ef817 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.139637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111fb65-b90d-417e-b92c-d5c0b50ef817 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.139846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef6481-1641-4aab-b113-6789754483b4 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.139958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8111fb65-b90d-417e-b92c-d5c0b50ef817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.157428 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffef6481-1641-4aab-b113-6789754483b4 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.160405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8111fb65-b90d-417e-b92c-d5c0b50ef817 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:12.161626 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8111fb65-b90d-417e-b92c-d5c0b50ef817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.162415 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd41ef-cbd9-4af0-8107-84a4907b0801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.163134 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd41ef-cbd9-4af0-8107-84a4907b0801 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.163415 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd41ef-cbd9-4af0-8107-84a4907b0801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.163689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdd41ef-cbd9-4af0-8107-84a4907b0801 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.164376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd41ef-cbd9-4af0-8107-84a4907b0801 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.165404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: WARNING py.warnings [None req-cbdd41ef-cbd9-4af0-8107-84a4907b0801 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:22:12.165404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: warnings.warn(msg) Aug 01 14:22:12.165404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: Aug 01 14:22:12.166618 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdd41ef-cbd9-4af0-8107-84a4907b0801 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.169663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 787/1563] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:12.170893 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec52ad1-0f99-4987-9492-f9471f812cef None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.171177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec52ad1-0f99-4987-9492-f9471f812cef None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.171449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec52ad1-0f99-4987-9492-f9471f812cef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.191474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-eec52ad1-0f99-4987-9492-f9471f812cef None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:12.192694 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-eec52ad1-0f99-4987-9492-f9471f812cef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.196834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 777/1564] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/projects => generated 381 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:12.197699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd41ef-cbd9-4af0-8107-84a4907b0801 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.200766 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 788/1565] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:12.201532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec52ad1-0f99-4987-9492-f9471f812cef None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.211580 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec52ad1-0f99-4987-9492-f9471f812cef None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.241599 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:12.243250 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:12.275115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdd41ef-cbd9-4af0-8107-84a4907b0801 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.278228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54610ded-3e31-49cc-9fe9-615c178a0121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.278949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54610ded-3e31-49cc-9fe9-615c178a0121 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.279338 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54610ded-3e31-49cc-9fe9-615c178a0121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.279627 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54610ded-3e31-49cc-9fe9-615c178a0121 admin admin] PATH_INFO: `/v3/projects/aa6c54d2ec23462c846a0414d7c0234d/users/6635f24728384effb9fc590ebed52487/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.280471 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cccd22-91b5-41a3-9a8f-ebbc4def930d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.281096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cccd22-91b5-41a3-9a8f-ebbc4def930d admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.281379 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cccd22-91b5-41a3-9a8f-ebbc4def930d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.281654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cccd22-91b5-41a3-9a8f-ebbc4def930d admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.282326 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cccd22-91b5-41a3-9a8f-ebbc4def930d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.284310 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cccd22-91b5-41a3-9a8f-ebbc4def930d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.295200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54610ded-3e31-49cc-9fe9-615c178a0121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa6c54d2ec23462c846a0414d7c0234d, user_id=6635f24728384effb9fc590ebed52487, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.298863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54610ded-3e31-49cc-9fe9-615c178a0121 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.315630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 778/1566] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/projects => generated 391 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:12.315630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cccd22-91b5-41a3-9a8f-ebbc4def930d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.316481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 789/1567] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:12 2022] PUT /identity/v3/projects/aa6c54d2ec23462c846a0414d7c0234d/users/6635f24728384effb9fc590ebed52487/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:12.316481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54610ded-3e31-49cc-9fe9-615c178a0121 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.383079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54610ded-3e31-49cc-9fe9-615c178a0121 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.383340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cccd22-91b5-41a3-9a8f-ebbc4def930d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.388012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495770b5-6acd-41c8-b4ba-c9fe8b753b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.388162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdd307-76d9-483c-952a-cab77c828bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.388637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495770b5-6acd-41c8-b4ba-c9fe8b753b4b admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.388772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdd307-76d9-483c-952a-cab77c828bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.388920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495770b5-6acd-41c8-b4ba-c9fe8b753b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.389056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdd307-76d9-483c-952a-cab77c828bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.389196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495770b5-6acd-41c8-b4ba-c9fe8b753b4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.389335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fdd307-76d9-483c-952a-cab77c828bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.389897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495770b5-6acd-41c8-b4ba-c9fe8b753b4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:12.390020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdd307-76d9-483c-952a-cab77c828bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.390204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495770b5-6acd-41c8-b4ba-c9fe8b753b4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.391854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-495770b5-6acd-41c8-b4ba-c9fe8b753b4b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.391978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fdd307-76d9-483c-952a-cab77c828bbc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.403558 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 779/1568] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:12.404174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495770b5-6acd-41c8-b4ba-c9fe8b753b4b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.414250 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495770b5-6acd-41c8-b4ba-c9fe8b753b4b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.419774 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af780d-6de7-479b-bb9f-caf2da1dc028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.420392 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af780d-6de7-479b-bb9f-caf2da1dc028 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.420677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af780d-6de7-479b-bb9f-caf2da1dc028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.420948 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59af780d-6de7-479b-bb9f-caf2da1dc028 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.421597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af780d-6de7-479b-bb9f-caf2da1dc028 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.423567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59af780d-6de7-479b-bb9f-caf2da1dc028 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.426591 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 790/1569] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:12.427426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdd307-76d9-483c-952a-cab77c828bbc admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.456022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 780/1570] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:12.456022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af780d-6de7-479b-bb9f-caf2da1dc028 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.491750 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fdd307-76d9-483c-952a-cab77c828bbc admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.515012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59af780d-6de7-479b-bb9f-caf2da1dc028 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.519650 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66009bea-8bfd-42d0-a566-3ca0367e07d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.520262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66009bea-8bfd-42d0-a566-3ca0367e07d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.520543 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66009bea-8bfd-42d0-a566-3ca0367e07d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.520819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66009bea-8bfd-42d0-a566-3ca0367e07d3 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.521468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66009bea-8bfd-42d0-a566-3ca0367e07d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.523588 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66009bea-8bfd-42d0-a566-3ca0367e07d3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.538423 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:12.546417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 781/1571] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:12.547344 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66009bea-8bfd-42d0-a566-3ca0367e07d3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.554760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b43712-0f2d-4ef7-b592-f85e8d4c6f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.555463 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b43712-0f2d-4ef7-b592-f85e8d4c6f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.555743 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b43712-0f2d-4ef7-b592-f85e8d4c6f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.556017 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b43712-0f2d-4ef7-b592-f85e8d4c6f5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.556709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b43712-0f2d-4ef7-b592-f85e8d4c6f5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:12.556958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66009bea-8bfd-42d0-a566-3ca0367e07d3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.557066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b43712-0f2d-4ef7-b592-f85e8d4c6f5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.558621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b43712-0f2d-4ef7-b592-f85e8d4c6f5e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.562224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ddbb8e-ffd8-4330-8bdc-0320970099e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.562919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddbb8e-ffd8-4330-8bdc-0320970099e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.563269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddbb8e-ffd8-4330-8bdc-0320970099e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.563612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ddbb8e-ffd8-4330-8bdc-0320970099e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.564368 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddbb8e-ffd8-4330-8bdc-0320970099e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:12.564745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddbb8e-ffd8-4330-8bdc-0320970099e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.566989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ddbb8e-ffd8-4330-8bdc-0320970099e6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.571080 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 791/1572] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:12.571857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b43712-0f2d-4ef7-b592-f85e8d4c6f5e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.581591 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b43712-0f2d-4ef7-b592-f85e8d4c6f5e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.590634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 782/1573] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:12.590634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e2943-e78e-425b-8bf7-107360f63f9e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.590634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e2943-e78e-425b-8bf7-107360f63f9e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.590634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e2943-e78e-425b-8bf7-107360f63f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.592806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00aea9-6c35-4927-9f4f-f97b8b0241c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.593701 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00aea9-6c35-4927-9f4f-f97b8b0241c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.594830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00aea9-6c35-4927-9f4f-f97b8b0241c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.595125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b00aea9-6c35-4927-9f4f-f97b8b0241c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.595812 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00aea9-6c35-4927-9f4f-f97b8b0241c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.598298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b00aea9-6c35-4927-9f4f-f97b8b0241c1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.606186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:12.617591 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-ea5e2943-e78e-425b-8bf7-107360f63f9e None None] MFA Rules not processed for user `6635f24728384effb9fc590ebed52487`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:12.618841 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ea5e2943-e78e-425b-8bf7-107360f63f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:12.620502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 792/1574] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/users => generated 296 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:12.621495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00aea9-6c35-4927-9f4f-f97b8b0241c1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.631674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b00aea9-6c35-4927-9f4f-f97b8b0241c1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.636464 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ee3b0-d386-40bc-8eeb-de4f4a7664ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.637379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ee3b0-d386-40bc-8eeb-de4f4a7664ac admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.637500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ee3b0-d386-40bc-8eeb-de4f4a7664ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.637910 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6ee3b0-d386-40bc-8eeb-de4f4a7664ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.638600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ee3b0-d386-40bc-8eeb-de4f4a7664ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.640654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6ee3b0-d386-40bc-8eeb-de4f4a7664ac admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.669032 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 793/1575] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/projects => generated 355 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:12.669804 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ee3b0-d386-40bc-8eeb-de4f4a7664ac admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.689724 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 783/1576] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:12.690550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e2943-e78e-425b-8bf7-107360f63f9e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.703851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e2943-e78e-425b-8bf7-107360f63f9e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.732529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6ee3b0-d386-40bc-8eeb-de4f4a7664ac admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.737318 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd393ea7-b78d-4a32-bd77-8fe9d4bd8ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.738145 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd393ea7-b78d-4a32-bd77-8fe9d4bd8ca8 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.738435 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd393ea7-b78d-4a32-bd77-8fe9d4bd8ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.738745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd393ea7-b78d-4a32-bd77-8fe9d4bd8ca8 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.739397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd393ea7-b78d-4a32-bd77-8fe9d4bd8ca8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.741362 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd393ea7-b78d-4a32-bd77-8fe9d4bd8ca8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.761731 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd39af-1164-462c-b57c-4fadde7d5aa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.762353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd39af-1164-462c-b57c-4fadde7d5aa8 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.762674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd39af-1164-462c-b57c-4fadde7d5aa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.762950 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd39af-1164-462c-b57c-4fadde7d5aa8 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.763602 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd39af-1164-462c-b57c-4fadde7d5aa8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.764054 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 794/1577] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/users => generated 284 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:12.764766 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd393ea7-b78d-4a32-bd77-8fe9d4bd8ca8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.765737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccd39af-1164-462c-b57c-4fadde7d5aa8 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.776159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd393ea7-b78d-4a32-bd77-8fe9d4bd8ca8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.780932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63434f1a-d41c-411c-8c97-289f2418c89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.781577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63434f1a-d41c-411c-8c97-289f2418c89c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.781939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63434f1a-d41c-411c-8c97-289f2418c89c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.782068 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63434f1a-d41c-411c-8c97-289f2418c89c admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.782769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63434f1a-d41c-411c-8c97-289f2418c89c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.784355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63434f1a-d41c-411c-8c97-289f2418c89c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.791221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 784/1578] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:12.791221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd39af-1164-462c-b57c-4fadde7d5aa8 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.798075 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 795/1579] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:12.798075 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63434f1a-d41c-411c-8c97-289f2418c89c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.800827 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd39af-1164-462c-b57c-4fadde7d5aa8 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.805457 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909863d-e73d-4ba9-9aed-4a26578f372c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.806059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909863d-e73d-4ba9-9aed-4a26578f372c admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.806338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909863d-e73d-4ba9-9aed-4a26578f372c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.806642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3909863d-e73d-4ba9-9aed-4a26578f372c admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.806905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63434f1a-d41c-411c-8c97-289f2418c89c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.807294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909863d-e73d-4ba9-9aed-4a26578f372c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.809235 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3909863d-e73d-4ba9-9aed-4a26578f372c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.811394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364cc9e-abd4-4d58-a1b5-0fee9de6e542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.811971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364cc9e-abd4-4d58-a1b5-0fee9de6e542 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.812246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364cc9e-abd4-4d58-a1b5-0fee9de6e542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.812516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6364cc9e-abd4-4d58-a1b5-0fee9de6e542 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.813152 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364cc9e-abd4-4d58-a1b5-0fee9de6e542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.815157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6364cc9e-abd4-4d58-a1b5-0fee9de6e542 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.839743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 785/1580] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/projects => generated 389 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:12.840642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909863d-e73d-4ba9-9aed-4a26578f372c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.843080 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 796/1581] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:12.844198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364cc9e-abd4-4d58-a1b5-0fee9de6e542 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.902962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3909863d-e73d-4ba9-9aed-4a26578f372c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.906682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6364cc9e-abd4-4d58-a1b5-0fee9de6e542 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.907706 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9730bd-9fa0-48c9-a682-b46a92e05f44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.908322 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9730bd-9fa0-48c9-a682-b46a92e05f44 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.908608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9730bd-9fa0-48c9-a682-b46a92e05f44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.908878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9730bd-9fa0-48c9-a682-b46a92e05f44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.909599 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9730bd-9fa0-48c9-a682-b46a92e05f44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.911251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9730bd-9fa0-48c9-a682-b46a92e05f44 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.911646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4af25-c929-4e0e-b605-0c54fee42cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.912289 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4af25-c929-4e0e-b605-0c54fee42cca admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.912571 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4af25-c929-4e0e-b605-0c54fee42cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.912849 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa4af25-c929-4e0e-b605-0c54fee42cca admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.913503 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4af25-c929-4e0e-b605-0c54fee42cca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.915624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa4af25-c929-4e0e-b605-0c54fee42cca admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.921337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 786/1582] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:12.921973 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9730bd-9fa0-48c9-a682-b46a92e05f44 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.923523 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:12.928608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:12.933465 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9730bd-9fa0-48c9-a682-b46a92e05f44 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.939424 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 797/1583] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/users => generated 278 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:12.939554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ea797-1093-403d-9fea-875759e52bd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.940072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4af25-c929-4e0e-b605-0c54fee42cca admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.940189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ea797-1093-403d-9fea-875759e52bd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.940388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ea797-1093-403d-9fea-875759e52bd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.941335 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2ea797-1093-403d-9fea-875759e52bd5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.942059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ea797-1093-403d-9fea-875759e52bd5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.944138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2ea797-1093-403d-9fea-875759e52bd5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.950377 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa4af25-c929-4e0e-b605-0c54fee42cca admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:12.955178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428407bf-bd3e-48fb-ace8-bd7ba24d4639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:12.956035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428407bf-bd3e-48fb-ace8-bd7ba24d4639 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:12.956317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428407bf-bd3e-48fb-ace8-bd7ba24d4639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:12.956619 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428407bf-bd3e-48fb-ace8-bd7ba24d4639 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:12.957307 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428407bf-bd3e-48fb-ace8-bd7ba24d4639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:12.958928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428407bf-bd3e-48fb-ace8-bd7ba24d4639 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:12.969454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 798/1584] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:12.970246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428407bf-bd3e-48fb-ace8-bd7ba24d4639 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.974712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 787/1585] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:12 2022] POST /identity/v3/projects => generated 369 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:12.975984 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ea797-1093-403d-9fea-875759e52bd5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:12.980184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428407bf-bd3e-48fb-ace8-bd7ba24d4639 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.037742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0a4d2-5fe2-4e4b-a157-4d3bae803851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.038364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0a4d2-5fe2-4e4b-a157-4d3bae803851 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.038685 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0a4d2-5fe2-4e4b-a157-4d3bae803851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.038965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e0a4d2-5fe2-4e4b-a157-4d3bae803851 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.039657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0a4d2-5fe2-4e4b-a157-4d3bae803851 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.039922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2ea797-1093-403d-9fea-875759e52bd5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.041322 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e0a4d2-5fe2-4e4b-a157-4d3bae803851 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.045621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc4308-5c9a-465e-8e26-033671d99c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.046445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc4308-5c9a-465e-8e26-033671d99c17 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.046828 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc4308-5c9a-465e-8e26-033671d99c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.047099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbc4308-5c9a-465e-8e26-033671d99c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.047787 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc4308-5c9a-465e-8e26-033671d99c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.049429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbc4308-5c9a-465e-8e26-033671d99c17 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.051945 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 799/1586] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:13.053023 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0a4d2-5fe2-4e4b-a157-4d3bae803851 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.060650 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 788/1587] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:13.062640 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc4308-5c9a-465e-8e26-033671d99c17 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.064902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e0a4d2-5fe2-4e4b-a157-4d3bae803851 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.070393 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fef72-168b-425e-8a4a-58c489363115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.071030 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fef72-168b-425e-8a4a-58c489363115 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.071305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fef72-168b-425e-8a4a-58c489363115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.071575 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14fef72-168b-425e-8a4a-58c489363115 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.072255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fef72-168b-425e-8a4a-58c489363115 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.073037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbc4308-5c9a-465e-8e26-033671d99c17 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.074211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14fef72-168b-425e-8a4a-58c489363115 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.077835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d65322-e415-4156-8ff4-7c42aefcfaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.078425 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d65322-e415-4156-8ff4-7c42aefcfaa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.078730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d65322-e415-4156-8ff4-7c42aefcfaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.079002 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d65322-e415-4156-8ff4-7c42aefcfaa3 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.079638 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d65322-e415-4156-8ff4-7c42aefcfaa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.081854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d65322-e415-4156-8ff4-7c42aefcfaa3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.094935 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 800/1588] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:13.095760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fef72-168b-425e-8a4a-58c489363115 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.105861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 789/1589] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/users => generated 290 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:13.106178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14fef72-168b-425e-8a4a-58c489363115 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.106704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d65322-e415-4156-8ff4-7c42aefcfaa3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.110927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27140cd1-264e-4bd1-a3c9-392e7244174a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.111654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27140cd1-264e-4bd1-a3c9-392e7244174a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.111780 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27140cd1-264e-4bd1-a3c9-392e7244174a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.112043 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27140cd1-264e-4bd1-a3c9-392e7244174a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.113690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27140cd1-264e-4bd1-a3c9-392e7244174a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.114984 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27140cd1-264e-4bd1-a3c9-392e7244174a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.116886 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d65322-e415-4156-8ff4-7c42aefcfaa3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.121557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbb575-0542-449c-aaa4-95b0f17b3242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.122150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbb575-0542-449c-aaa4-95b0f17b3242 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.122430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbb575-0542-449c-aaa4-95b0f17b3242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.122739 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbbb575-0542-449c-aaa4-95b0f17b3242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.123440 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbb575-0542-449c-aaa4-95b0f17b3242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.125022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbbb575-0542-449c-aaa4-95b0f17b3242 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.125609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 801/1590] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:13.126388 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27140cd1-264e-4bd1-a3c9-392e7244174a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.135656 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27140cd1-264e-4bd1-a3c9-392e7244174a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.137541 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 790/1591] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:13.137541 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbb575-0542-449c-aaa4-95b0f17b3242 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.141529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58403f28-f5d7-4a1f-ab40-c99c244d462d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.142203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58403f28-f5d7-4a1f-ab40-c99c244d462d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.142479 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58403f28-f5d7-4a1f-ab40-c99c244d462d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.142778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58403f28-f5d7-4a1f-ab40-c99c244d462d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.143449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58403f28-f5d7-4a1f-ab40-c99c244d462d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.145018 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58403f28-f5d7-4a1f-ab40-c99c244d462d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.147956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbbb575-0542-449c-aaa4-95b0f17b3242 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.152723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548155cc-67e3-435d-9f10-3ed8cfbec752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.153311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548155cc-67e3-435d-9f10-3ed8cfbec752 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.153589 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548155cc-67e3-435d-9f10-3ed8cfbec752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.153861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548155cc-67e3-435d-9f10-3ed8cfbec752 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.154534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548155cc-67e3-435d-9f10-3ed8cfbec752 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.158044 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 802/1592] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:13.158044 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58403f28-f5d7-4a1f-ab40-c99c244d462d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.158270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548155cc-67e3-435d-9f10-3ed8cfbec752 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.168690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58403f28-f5d7-4a1f-ab40-c99c244d462d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.174651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932a2a9-7cdf-4345-a02f-954007ec7f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.175349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932a2a9-7cdf-4345-a02f-954007ec7f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.175612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932a2a9-7cdf-4345-a02f-954007ec7f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.175929 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932a2a9-7cdf-4345-a02f-954007ec7f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.176631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932a2a9-7cdf-4345-a02f-954007ec7f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.178224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9932a2a9-7cdf-4345-a02f-954007ec7f32 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.181847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 791/1593] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/users => generated 291 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:13.181847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548155cc-67e3-435d-9f10-3ed8cfbec752 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.192411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 803/1594] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:13.192594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548155cc-67e3-435d-9f10-3ed8cfbec752 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.192702 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932a2a9-7cdf-4345-a02f-954007ec7f32 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.195014 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9d6da-a527-4b95-88b3-2d403aa48e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.196289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9d6da-a527-4b95-88b3-2d403aa48e06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.196596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9d6da-a527-4b95-88b3-2d403aa48e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.196868 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9d6da-a527-4b95-88b3-2d403aa48e06 admin admin] PATH_INFO: `/v3/projects/836e0fdc361f47cc80b2020b45f07d44/users/bb10455b85f94e8cbf3aeb660fefa9d4/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.199971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9932a2a9-7cdf-4345-a02f-954007ec7f32 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.204568 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266183a7-10c6-47d2-a54c-e9260ce5bf85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.205165 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266183a7-10c6-47d2-a54c-e9260ce5bf85 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.205705 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266183a7-10c6-47d2-a54c-e9260ce5bf85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.205979 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266183a7-10c6-47d2-a54c-e9260ce5bf85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.207247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266183a7-10c6-47d2-a54c-e9260ce5bf85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.208888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266183a7-10c6-47d2-a54c-e9260ce5bf85 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.212835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9d6da-a527-4b95-88b3-2d403aa48e06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=836e0fdc361f47cc80b2020b45f07d44, user_id=bb10455b85f94e8cbf3aeb660fefa9d4, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.213884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: WARNING py.warnings [None req-e0f9d6da-a527-4b95-88b3-2d403aa48e06 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:22:13.213884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: warnings.warn(msg) Aug 01 14:22:13.213884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: Aug 01 14:22:13.215852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f9d6da-a527-4b95-88b3-2d403aa48e06 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.219894 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 804/1595] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:13.223642 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266183a7-10c6-47d2-a54c-e9260ce5bf85 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.230663 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 792/1596] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:13 2022] PUT /identity/v3/projects/836e0fdc361f47cc80b2020b45f07d44/users/bb10455b85f94e8cbf3aeb660fefa9d4/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:13.231518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9d6da-a527-4b95-88b3-2d403aa48e06 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.233524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266183a7-10c6-47d2-a54c-e9260ce5bf85 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.295321 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497ac67-3178-4309-b104-f00661752e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.295850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497ac67-3178-4309-b104-f00661752e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.296129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497ac67-3178-4309-b104-f00661752e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.296401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497ac67-3178-4309-b104-f00661752e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.296869 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9d6da-a527-4b95-88b3-2d403aa48e06 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.297109 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497ac67-3178-4309-b104-f00661752e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.298754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497ac67-3178-4309-b104-f00661752e20 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.302062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dd593-cf6e-4978-9c7e-eafb3b8268ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.302766 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dd593-cf6e-4978-9c7e-eafb3b8268ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.303053 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dd593-cf6e-4978-9c7e-eafb3b8268ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.303315 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2dd593-cf6e-4978-9c7e-eafb3b8268ba admin admin] PATH_INFO: `/v3/projects/19f75a5937eb45ec8d211ac5f7d37b77/users/666b3c9d23604bf0aefc4f09374f92c8/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.309699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 805/1597] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:13.310669 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497ac67-3178-4309-b104-f00661752e20 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.318488 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:13.320335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497ac67-3178-4309-b104-f00661752e20 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.321925 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dd593-cf6e-4978-9c7e-eafb3b8268ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=19f75a5937eb45ec8d211ac5f7d37b77, user_id=666b3c9d23604bf0aefc4f09374f92c8, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.325463 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be81aa3-29b2-45f6-90d7-f3079fdcaad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.325888 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2dd593-cf6e-4978-9c7e-eafb3b8268ba admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.326051 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be81aa3-29b2-45f6-90d7-f3079fdcaad6 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.326336 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be81aa3-29b2-45f6-90d7-f3079fdcaad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.326632 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be81aa3-29b2-45f6-90d7-f3079fdcaad6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.327307 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be81aa3-29b2-45f6-90d7-f3079fdcaad6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.328863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be81aa3-29b2-45f6-90d7-f3079fdcaad6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.331382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:13.340650 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 793/1598] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:13 2022] PUT /identity/v3/projects/19f75a5937eb45ec8d211ac5f7d37b77/users/666b3c9d23604bf0aefc4f09374f92c8/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:13.341434 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dd593-cf6e-4978-9c7e-eafb3b8268ba admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.344846 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 806/1599] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:13.345744 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be81aa3-29b2-45f6-90d7-f3079fdcaad6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.355696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be81aa3-29b2-45f6-90d7-f3079fdcaad6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.402946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2dd593-cf6e-4978-9c7e-eafb3b8268ba admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.407561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91040e79-0cb7-4d31-bbbb-9e799fbb3ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.408352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91040e79-0cb7-4d31-bbbb-9e799fbb3ed5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.408614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91040e79-0cb7-4d31-bbbb-9e799fbb3ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.408885 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91040e79-0cb7-4d31-bbbb-9e799fbb3ed5 admin admin] PATH_INFO: `/v3/projects/070f86aba1574bc48f204f3470e21124/users/828f50086e7c4a43bc852dcf0c416374/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.414596 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c707f49-d7e4-4b6e-a402-e47dc9ae9415 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.415245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c707f49-d7e4-4b6e-a402-e47dc9ae9415 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.415526 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c707f49-d7e4-4b6e-a402-e47dc9ae9415 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.415799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c707f49-d7e4-4b6e-a402-e47dc9ae9415 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.416486 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c707f49-d7e4-4b6e-a402-e47dc9ae9415 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.418080 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c707f49-d7e4-4b6e-a402-e47dc9ae9415 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.423906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91040e79-0cb7-4d31-bbbb-9e799fbb3ed5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=070f86aba1574bc48f204f3470e21124, user_id=828f50086e7c4a43bc852dcf0c416374, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.427177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91040e79-0cb7-4d31-bbbb-9e799fbb3ed5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.431639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 807/1600] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:13.431639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c707f49-d7e4-4b6e-a402-e47dc9ae9415 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.440194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 794/1601] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:13 2022] PUT /identity/v3/projects/070f86aba1574bc48f204f3470e21124/users/828f50086e7c4a43bc852dcf0c416374/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:13.440806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c707f49-d7e4-4b6e-a402-e47dc9ae9415 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.441052 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91040e79-0cb7-4d31-bbbb-9e799fbb3ed5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.498056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7c859-1dd1-47a8-9bb8-4a279e9bd6ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.498758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7c859-1dd1-47a8-9bb8-4a279e9bd6ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.499036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7c859-1dd1-47a8-9bb8-4a279e9bd6ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.499305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7c859-1dd1-47a8-9bb8-4a279e9bd6ad admin admin] PATH_INFO: `/v3/projects/ffdd6264b71843e1bfbb327a70ddd3b2/users/614de29f4fde415a9e858d82ebfffb6c/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.504876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91040e79-0cb7-4d31-bbbb-9e799fbb3ed5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.509768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7011800e-b18d-4d1b-b341-1786139fb104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.510406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011800e-b18d-4d1b-b341-1786139fb104 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.510707 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011800e-b18d-4d1b-b341-1786139fb104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.510985 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7011800e-b18d-4d1b-b341-1786139fb104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.511709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011800e-b18d-4d1b-b341-1786139fb104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.513341 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7011800e-b18d-4d1b-b341-1786139fb104 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.515334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7c859-1dd1-47a8-9bb8-4a279e9bd6ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdd6264b71843e1bfbb327a70ddd3b2, user_id=614de29f4fde415a9e858d82ebfffb6c, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.518034 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7c859-1dd1-47a8-9bb8-4a279e9bd6ad admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.524340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 795/1602] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:13.525862 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb4007-0d5a-4ffe-bcd7-689d802370a9 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.526153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb4007-0d5a-4ffe-bcd7-689d802370a9 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.526508 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2eb4007-0d5a-4ffe-bcd7-689d802370a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.532674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 808/1603] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:13 2022] PUT /identity/v3/projects/ffdd6264b71843e1bfbb327a70ddd3b2/users/614de29f4fde415a9e858d82ebfffb6c/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:13.533486 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7c859-1dd1-47a8-9bb8-4a279e9bd6ad admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.554974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d2eb4007-0d5a-4ffe-bcd7-689d802370a9 None None] MFA Rules not processed for user `bb10455b85f94e8cbf3aeb660fefa9d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:13.556094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d2eb4007-0d5a-4ffe-bcd7-689d802370a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:13.596849 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7c859-1dd1-47a8-9bb8-4a279e9bd6ad admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.602037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c0b673-8672-48bc-836c-0d0ce80db94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.602679 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0b673-8672-48bc-836c-0d0ce80db94e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.602965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0b673-8672-48bc-836c-0d0ce80db94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.603238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c0b673-8672-48bc-836c-0d0ce80db94e admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.603919 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c0b673-8672-48bc-836c-0d0ce80db94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.605502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c0b673-8672-48bc-836c-0d0ce80db94e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.615326 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 809/1604] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:13 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:13.616562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6570e-1913-4e8d-828f-6dc6e68e3936 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.616847 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6570e-1913-4e8d-828f-6dc6e68e3936 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.617116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6570e-1913-4e8d-828f-6dc6e68e3936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.628849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:13.636874 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 796/1605] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:13.637721 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb4007-0d5a-4ffe-bcd7-689d802370a9 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.637890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d3d6570e-1913-4e8d-828f-6dc6e68e3936 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:13.639155 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d3d6570e-1913-4e8d-828f-6dc6e68e3936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:13.648388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2eb4007-0d5a-4ffe-bcd7-689d802370a9 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.653094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad406841-e770-4ab6-8ea8-f6cd7f8a0bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.653749 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad406841-e770-4ab6-8ea8-f6cd7f8a0bd3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.654028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad406841-e770-4ab6-8ea8-f6cd7f8a0bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.654301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad406841-e770-4ab6-8ea8-f6cd7f8a0bd3 admin admin] PATH_INFO: `/v3/projects/5589c824a1fd454b90360b2f578197ec/users/1ed0b61ac1ec447d9d65caf6c50619de/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.655762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 810/1606] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:13.656732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6570e-1913-4e8d-828f-6dc6e68e3936 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.668545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6570e-1913-4e8d-828f-6dc6e68e3936 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.672502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad406841-e770-4ab6-8ea8-f6cd7f8a0bd3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5589c824a1fd454b90360b2f578197ec, user_id=1ed0b61ac1ec447d9d65caf6c50619de, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.673570 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b023657-024f-4f2a-a7e8-8e83de4b16e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.674251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b023657-024f-4f2a-a7e8-8e83de4b16e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.674526 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b023657-024f-4f2a-a7e8-8e83de4b16e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.674822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b023657-024f-4f2a-a7e8-8e83de4b16e5 admin admin] PATH_INFO: `/v3/projects/2d5356c5a5b84b1c85b3d587b9083223/users/a6f87ad8aa064b7086cd5e4b9cc2d1eb/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.675283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad406841-e770-4ab6-8ea8-f6cd7f8a0bd3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.677288 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:13.689102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 797/1607] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:13 2022] PUT /identity/v3/projects/5589c824a1fd454b90360b2f578197ec/users/1ed0b61ac1ec447d9d65caf6c50619de/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:13.690338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4460f-22d2-422b-ad3b-0de39caf1779 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.690646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4460f-22d2-422b-ad3b-0de39caf1779 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.690947 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4460f-22d2-422b-ad3b-0de39caf1779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.700686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b023657-024f-4f2a-a7e8-8e83de4b16e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5356c5a5b84b1c85b3d587b9083223, user_id=a6f87ad8aa064b7086cd5e4b9cc2d1eb, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.703418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b023657-024f-4f2a-a7e8-8e83de4b16e5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.717951 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 811/1608] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:13 2022] PUT /identity/v3/projects/2d5356c5a5b84b1c85b3d587b9083223/users/a6f87ad8aa064b7086cd5e4b9cc2d1eb/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:13.719004 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b023657-024f-4f2a-a7e8-8e83de4b16e5 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.724842 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-17e4460f-22d2-422b-ad3b-0de39caf1779 None None] MFA Rules not processed for user `828f50086e7c4a43bc852dcf0c416374`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:13.726037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-17e4460f-22d2-422b-ad3b-0de39caf1779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:13.780212 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b023657-024f-4f2a-a7e8-8e83de4b16e5 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.785388 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d2835-56cd-499f-9f66-6d30477a124a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.786049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d2835-56cd-499f-9f66-6d30477a124a admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.786320 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d2835-56cd-499f-9f66-6d30477a124a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.786640 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d2835-56cd-499f-9f66-6d30477a124a admin admin] PATH_INFO: `/v3/projects/14e4d4c3c71d4348a9f1ec3cea1be646/users/246f0156a53e4931bc24158b06e85654/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.789476 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 798/1609] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:13.790778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f9b92-9f23-4dd7-a62e-6765ab3c1901 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.791066 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f9b92-9f23-4dd7-a62e-6765ab3c1901 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.791339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572f9b92-9f23-4dd7-a62e-6765ab3c1901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.802484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d2835-56cd-499f-9f66-6d30477a124a admin admin] RBAC: Authorizing `identity:create_grant(project_id=14e4d4c3c71d4348a9f1ec3cea1be646, user_id=246f0156a53e4931bc24158b06e85654, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.805712 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d2835-56cd-499f-9f66-6d30477a124a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.809951 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-572f9b92-9f23-4dd7-a62e-6765ab3c1901 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:13.811343 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-572f9b92-9f23-4dd7-a62e-6765ab3c1901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:13.823281 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 799/1610] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:13.823441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 812/1611] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:13 2022] PUT /identity/v3/projects/14e4d4c3c71d4348a9f1ec3cea1be646/users/246f0156a53e4931bc24158b06e85654/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:13.823543 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f9b92-9f23-4dd7-a62e-6765ab3c1901 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.823637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d2835-56cd-499f-9f66-6d30477a124a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.837240 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572f9b92-9f23-4dd7-a62e-6765ab3c1901 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.885294 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d2835-56cd-499f-9f66-6d30477a124a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.890014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2dd14-1d37-433c-87fa-749a7aec1c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.890662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2dd14-1d37-433c-87fa-749a7aec1c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.890928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2dd14-1d37-433c-87fa-749a7aec1c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.891196 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2dd14-1d37-433c-87fa-749a7aec1c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.891843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2dd14-1d37-433c-87fa-749a7aec1c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.892525 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d242002-deb8-4c1b-9d44-46eccf59e60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.893217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242002-deb8-4c1b-9d44-46eccf59e60c admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.893496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242002-deb8-4c1b-9d44-46eccf59e60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.893735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2dd14-1d37-433c-87fa-749a7aec1c26 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.893835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d242002-deb8-4c1b-9d44-46eccf59e60c admin admin] PATH_INFO: `/v3/projects/c34baccea2194944bd4b491bb434dc01/users/3c069d8c991d482992951ba0eb7b3395/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.908502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242002-deb8-4c1b-9d44-46eccf59e60c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c34baccea2194944bd4b491bb434dc01, user_id=3c069d8c991d482992951ba0eb7b3395, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:13.911576 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d242002-deb8-4c1b-9d44-46eccf59e60c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:13.921210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 813/1612] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:13.922314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2dd14-1d37-433c-87fa-749a7aec1c26 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:13.924603 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 800/1613] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:13 2022] PUT /identity/v3/projects/c34baccea2194944bd4b491bb434dc01/users/3c069d8c991d482992951ba0eb7b3395/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:13.925851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02f748-01ba-42c5-b79f-9b1356054b03 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.926137 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02f748-01ba-42c5-b79f-9b1356054b03 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.926416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02f748-01ba-42c5-b79f-9b1356054b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.953798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-aa02f748-01ba-42c5-b79f-9b1356054b03 None None] MFA Rules not processed for user `1ed0b61ac1ec447d9d65caf6c50619de`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:13.955052 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-aa02f748-01ba-42c5-b79f-9b1356054b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:13.981386 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2dd14-1d37-433c-87fa-749a7aec1c26 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:13.981568 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca956c-9ac8-4c68-887c-a461f39aec07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:13.982188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca956c-9ac8-4c68-887c-a461f39aec07 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:13.982472 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca956c-9ac8-4c68-887c-a461f39aec07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:13.982771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aca956c-9ac8-4c68-887c-a461f39aec07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:13.987289 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:13.988620 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:14.026614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 801/1614] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:13 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:14.027588 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02f748-01ba-42c5-b79f-9b1356054b03 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.058826 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca956c-9ac8-4c68-887c-a461f39aec07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.060183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aca956c-9ac8-4c68-887c-a461f39aec07 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.070390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 814/1615] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:14.071226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca956c-9ac8-4c68-887c-a461f39aec07 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.090156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa02f748-01ba-42c5-b79f-9b1356054b03 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.095221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c57ccb-7b66-43f6-a21a-baa40738c487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.095700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c57ccb-7b66-43f6-a21a-baa40738c487 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.096012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c57ccb-7b66-43f6-a21a-baa40738c487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.096354 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c57ccb-7b66-43f6-a21a-baa40738c487 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.097013 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c57ccb-7b66-43f6-a21a-baa40738c487 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.098684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c57ccb-7b66-43f6-a21a-baa40738c487 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.109829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 802/1616] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:14.111322 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd04f-c132-4042-9589-2086250f1375 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.111612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd04f-c132-4042-9589-2086250f1375 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.111881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bd04f-c132-4042-9589-2086250f1375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.132337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9c2bd04f-c132-4042-9589-2086250f1375 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:14.133514 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9c2bd04f-c132-4042-9589-2086250f1375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:14.138763 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aca956c-9ac8-4c68-887c-a461f39aec07 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.141436 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 803/1617] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:14.142952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f782a2-fe6e-4e65-a48a-2ed904bfb223 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.143828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f782a2-fe6e-4e65-a48a-2ed904bfb223 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.143828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f782a2-fe6e-4e65-a48a-2ed904bfb223 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.144731 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f782a2-fe6e-4e65-a48a-2ed904bfb223 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.146087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd04f-c132-4042-9589-2086250f1375 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.157496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2bd04f-c132-4042-9589-2086250f1375 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.161419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155844bb-588d-4ca9-b840-4d78df9af9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.162049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155844bb-588d-4ca9-b840-4d78df9af9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.162350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155844bb-588d-4ca9-b840-4d78df9af9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.162760 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155844bb-588d-4ca9-b840-4d78df9af9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.172815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155844bb-588d-4ca9-b840-4d78df9af9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.174915 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155844bb-588d-4ca9-b840-4d78df9af9d2 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.185872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 804/1618] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:14.186668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155844bb-588d-4ca9-b840-4d78df9af9d2 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.198690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155844bb-588d-4ca9-b840-4d78df9af9d2 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.204555 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241738c-5d8f-4f35-811b-1330506e9be8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.205236 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241738c-5d8f-4f35-811b-1330506e9be8 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.206016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241738c-5d8f-4f35-811b-1330506e9be8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.206161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8241738c-5d8f-4f35-811b-1330506e9be8 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.207375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241738c-5d8f-4f35-811b-1330506e9be8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.209489 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8241738c-5d8f-4f35-811b-1330506e9be8 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.217302 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f782a2-fe6e-4e65-a48a-2ed904bfb223 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.218882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f782a2-fe6e-4e65-a48a-2ed904bfb223 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.230938 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 815/1619] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:14 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:14.232607 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19baf5d-0dc9-4fe7-a1a4-81745e3cf252 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.233050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19baf5d-0dc9-4fe7-a1a4-81745e3cf252 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.233316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19baf5d-0dc9-4fe7-a1a4-81745e3cf252 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.239000 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 805/1620] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:14 2022] POST /identity/v3/users => generated 298 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:14.240093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241738c-5d8f-4f35-811b-1330506e9be8 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.254340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8241738c-5d8f-4f35-811b-1330506e9be8 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.260051 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d19baf5d-0dc9-4fe7-a1a4-81745e3cf252 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:14.260464 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fe46a-ddbe-4df4-be2d-368505100d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.261392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d19baf5d-0dc9-4fe7-a1a4-81745e3cf252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:14.261529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fe46a-ddbe-4df4-be2d-368505100d9b admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.261993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fe46a-ddbe-4df4-be2d-368505100d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.262411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0fe46a-ddbe-4df4-be2d-368505100d9b admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.263472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fe46a-ddbe-4df4-be2d-368505100d9b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.266335 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0fe46a-ddbe-4df4-be2d-368505100d9b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.276086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 816/1621] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:14.276086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19baf5d-0dc9-4fe7-a1a4-81745e3cf252 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.286434 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19baf5d-0dc9-4fe7-a1a4-81745e3cf252 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.292121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68012da-cc7b-4d16-a80e-52360e493996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.292928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68012da-cc7b-4d16-a80e-52360e493996 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.293270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68012da-cc7b-4d16-a80e-52360e493996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.293561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68012da-cc7b-4d16-a80e-52360e493996 admin admin] PATH_INFO: `/v3/projects/2d5356c5a5b84b1c85b3d587b9083223/users/a6f87ad8aa064b7086cd5e4b9cc2d1eb/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.296062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68012da-cc7b-4d16-a80e-52360e493996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d5356c5a5b84b1c85b3d587b9083223, user_id=a6f87ad8aa064b7086cd5e4b9cc2d1eb, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.299315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68012da-cc7b-4d16-a80e-52360e493996 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.310951 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 806/1622] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:14 2022] POST /identity/v3/projects => generated 357 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:14.311174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fe46a-ddbe-4df4-be2d-368505100d9b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.332875 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 817/1623] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:14 2022] PUT /identity/v3/projects/2d5356c5a5b84b1c85b3d587b9083223/users/a6f87ad8aa064b7086cd5e4b9cc2d1eb/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:14.332875 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68012da-cc7b-4d16-a80e-52360e493996 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.390715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:14.398096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0fe46a-ddbe-4df4-be2d-368505100d9b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.423974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:14.430891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68012da-cc7b-4d16-a80e-52360e493996 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.439414 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b95e8e-33c6-458f-bda0-50cf5a12b1fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.442019 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b95e8e-33c6-458f-bda0-50cf5a12b1fa admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.443001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b95e8e-33c6-458f-bda0-50cf5a12b1fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.443687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b95e8e-33c6-458f-bda0-50cf5a12b1fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.444830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b95e8e-33c6-458f-bda0-50cf5a12b1fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.447970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b95e8e-33c6-458f-bda0-50cf5a12b1fa admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.463233 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 818/1624] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:14.464566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b95e8e-33c6-458f-bda0-50cf5a12b1fa admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.471482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dbf45-e86c-454b-9004-6136058ba947 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.472188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dbf45-e86c-454b-9004-6136058ba947 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.472676 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dbf45-e86c-454b-9004-6136058ba947 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.472976 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dbf45-e86c-454b-9004-6136058ba947 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.486112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b95e8e-33c6-458f-bda0-50cf5a12b1fa admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.490434 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1dbf45-e86c-454b-9004-6136058ba947 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.492821 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1dbf45-e86c-454b-9004-6136058ba947 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.496533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43c1c28-19c8-4c82-9eb9-01fc2097b035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.497597 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c1c28-19c8-4c82-9eb9-01fc2097b035 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.498141 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c1c28-19c8-4c82-9eb9-01fc2097b035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.499307 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43c1c28-19c8-4c82-9eb9-01fc2097b035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.504917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 807/1625] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:14.505915 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dbf45-e86c-454b-9004-6136058ba947 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.513488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c1c28-19c8-4c82-9eb9-01fc2097b035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.515757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43c1c28-19c8-4c82-9eb9-01fc2097b035 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.517481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1dbf45-e86c-454b-9004-6136058ba947 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.524798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1f1e1-c768-4584-8cde-75dc0e832b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.525504 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1f1e1-c768-4584-8cde-75dc0e832b96 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.525887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1f1e1-c768-4584-8cde-75dc0e832b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.526262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f1f1e1-c768-4584-8cde-75dc0e832b96 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.527090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1f1e1-c768-4584-8cde-75dc0e832b96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.531582 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f1f1e1-c768-4584-8cde-75dc0e832b96 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.552115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 819/1626] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:14.554108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91d1a7-c6ee-48b5-9d4b-ca7d41deb734 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.554657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91d1a7-c6ee-48b5-9d4b-ca7d41deb734 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.555081 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b91d1a7-c6ee-48b5-9d4b-ca7d41deb734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.566025 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 808/1627] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:14 2022] POST /identity/v3/users => generated 285 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:14.566025 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1f1e1-c768-4584-8cde-75dc0e832b96 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.579616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f1f1e1-c768-4584-8cde-75dc0e832b96 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.588366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71402ba3-0fb6-4030-b053-d6e2443d92ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.589102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71402ba3-0fb6-4030-b053-d6e2443d92ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.589380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71402ba3-0fb6-4030-b053-d6e2443d92ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.589654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71402ba3-0fb6-4030-b053-d6e2443d92ee admin admin] PATH_INFO: `/v3/projects/d8c51c679576437da0ce779ab19486e1/users/dc49a0dc408b45aba4aa62f557a4f58b/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.601431 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9b91d1a7-c6ee-48b5-9d4b-ca7d41deb734 None None] MFA Rules not processed for user `a6f87ad8aa064b7086cd5e4b9cc2d1eb`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:14.602714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9b91d1a7-c6ee-48b5-9d4b-ca7d41deb734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:14.624113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71402ba3-0fb6-4030-b053-d6e2443d92ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c51c679576437da0ce779ab19486e1, user_id=dc49a0dc408b45aba4aa62f557a4f58b, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.629910 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71402ba3-0fb6-4030-b053-d6e2443d92ee admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.658937 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 809/1628] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:14 2022] PUT /identity/v3/projects/d8c51c679576437da0ce779ab19486e1/users/dc49a0dc408b45aba4aa62f557a4f58b/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:14.660854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71402ba3-0fb6-4030-b053-d6e2443d92ee admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.814864 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 820/1629] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:14 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:14.814864 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91d1a7-c6ee-48b5-9d4b-ca7d41deb734 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.815556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71402ba3-0fb6-4030-b053-d6e2443d92ee admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.827844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b91d1a7-c6ee-48b5-9d4b-ca7d41deb734 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.829334 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22371cd7-1927-4ccc-a761-09b8af5086e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.830038 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22371cd7-1927-4ccc-a761-09b8af5086e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.830657 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22371cd7-1927-4ccc-a761-09b8af5086e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.830953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22371cd7-1927-4ccc-a761-09b8af5086e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.832123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22371cd7-1927-4ccc-a761-09b8af5086e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.833779 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22371cd7-1927-4ccc-a761-09b8af5086e9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.841315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c402728-fd9c-46b4-8a88-8138a3c43f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.842435 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c402728-fd9c-46b4-8a88-8138a3c43f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.842814 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c402728-fd9c-46b4-8a88-8138a3c43f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.843161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c402728-fd9c-46b4-8a88-8138a3c43f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.844153 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c402728-fd9c-46b4-8a88-8138a3c43f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:14.850838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 810/1630] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:14.850838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22371cd7-1927-4ccc-a761-09b8af5086e9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.851095 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c402728-fd9c-46b4-8a88-8138a3c43f29 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:14.866393 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 821/1631] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:14 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:14.868041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c402728-fd9c-46b4-8a88-8138a3c43f29 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:14.927539 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c402728-fd9c-46b4-8a88-8138a3c43f29 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:14.943128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9a2b0-287f-43f2-9fef-79208d679c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:14.946498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a2b0-287f-43f2-9fef-79208d679c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:14.949459 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a2b0-287f-43f2-9fef-79208d679c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:14.949656 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d9a2b0-287f-43f2-9fef-79208d679c07 admin admin] PATH_INFO: `/v3/projects/d70626f1e91b46f1ae468352219a19d6/users/1c4eb20d8d2d4ba0bb990cede674d993/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:14.999418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9a2b0-287f-43f2-9fef-79208d679c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70626f1e91b46f1ae468352219a19d6, user_id=1c4eb20d8d2d4ba0bb990cede674d993, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:15.001288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22371cd7-1927-4ccc-a761-09b8af5086e9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:15.007099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d9a2b0-287f-43f2-9fef-79208d679c07 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:15.007212 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2dd619-923e-43a3-851e-dc89657a939a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:15.007212 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dd619-923e-43a3-851e-dc89657a939a service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:15.007409 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dd619-923e-43a3-851e-dc89657a939a service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:15.007696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d2dd619-923e-43a3-851e-dc89657a939a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:15.033363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 822/1632] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:14 2022] PUT /identity/v3/projects/d70626f1e91b46f1ae468352219a19d6/users/1c4eb20d8d2d4ba0bb990cede674d993/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:15.038395 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9a2b0-287f-43f2-9fef-79208d679c07 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:15.102476 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:15.161730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2dd619-923e-43a3-851e-dc89657a939a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:15.164081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d2dd619-923e-43a3-851e-dc89657a939a service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:15.176940 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 811/1633] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:14 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:15.177793 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2dd619-923e-43a3-851e-dc89657a939a service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:15.187584 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d9a2b0-287f-43f2-9fef-79208d679c07 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:15.189979 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d2dd619-923e-43a3-851e-dc89657a939a service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:15.196438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bfae8-ee19-41ce-ad38-51b485a86eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:15.197592 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bfae8-ee19-41ce-ad38-51b485a86eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:15.197830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bfae8-ee19-41ce-ad38-51b485a86eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:15.198340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51bfae8-ee19-41ce-ad38-51b485a86eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:15.199829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bfae8-ee19-41ce-ad38-51b485a86eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:15.202038 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51bfae8-ee19-41ce-ad38-51b485a86eb8 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:15.203253 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3def8637-fc24-4ee5-81de-c9d7611f5050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:15.204138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def8637-fc24-4ee5-81de-c9d7611f5050 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:15.204428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def8637-fc24-4ee5-81de-c9d7611f5050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:15.204708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3def8637-fc24-4ee5-81de-c9d7611f5050 admin admin] PATH_INFO: `/v3/projects/d8c51c679576437da0ce779ab19486e1/users/dc49a0dc408b45aba4aa62f557a4f58b/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:15.208557 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def8637-fc24-4ee5-81de-c9d7611f5050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8c51c679576437da0ce779ab19486e1, user_id=dc49a0dc408b45aba4aa62f557a4f58b, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:15.214161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3def8637-fc24-4ee5-81de-c9d7611f5050 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:15.218693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 812/1634] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:15.223270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bfae8-ee19-41ce-ad38-51b485a86eb8 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:15.240015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51bfae8-ee19-41ce-ad38-51b485a86eb8 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:15.241713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 823/1635] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:15 2022] PUT /identity/v3/projects/d8c51c679576437da0ce779ab19486e1/users/dc49a0dc408b45aba4aa62f557a4f58b/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:15.258048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b86d-8d86-46c6-a1a0-b8f86c008633 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:15.258658 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b86d-8d86-46c6-a1a0-b8f86c008633 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:15.259007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0026b86d-8d86-46c6-a1a0-b8f86c008633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:15.297856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:15.352783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b906e9-3f16-4ea0-9277-fc645fc98f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:15.353623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b906e9-3f16-4ea0-9277-fc645fc98f06 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:15.354012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b906e9-3f16-4ea0-9277-fc645fc98f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:15.354562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b906e9-3f16-4ea0-9277-fc645fc98f06 admin admin] PATH_INFO: `/v3/projects/d70626f1e91b46f1ae468352219a19d6/users/1c4eb20d8d2d4ba0bb990cede674d993/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:15.356897 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0026b86d-8d86-46c6-a1a0-b8f86c008633 None None] MFA Rules not processed for user `dc49a0dc408b45aba4aa62f557a4f58b`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:15.358165 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0026b86d-8d86-46c6-a1a0-b8f86c008633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:15.359139 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b906e9-3f16-4ea0-9277-fc645fc98f06 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d70626f1e91b46f1ae468352219a19d6, user_id=1c4eb20d8d2d4ba0bb990cede674d993, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:15.361961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b906e9-3f16-4ea0-9277-fc645fc98f06 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:15.399030 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 813/1636] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:15 2022] PUT /identity/v3/projects/d70626f1e91b46f1ae468352219a19d6/users/1c4eb20d8d2d4ba0bb990cede674d993/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:15.410014 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9e818-7c73-490c-a9e0-958db13ac0ef None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:15.410495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9e818-7c73-490c-a9e0-958db13ac0ef None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:15.410905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b9e818-7c73-490c-a9e0-958db13ac0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:15.466660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-04b9e818-7c73-490c-a9e0-958db13ac0ef None None] MFA Rules not processed for user `1c4eb20d8d2d4ba0bb990cede674d993`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:15.467411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 824/1637] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:15 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:15.472377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-04b9e818-7c73-490c-a9e0-958db13ac0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:15.481725 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026b86d-8d86-46c6-a1a0-b8f86c008633 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:15.567466 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 814/1638] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:15 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:15.598155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9e818-7c73-490c-a9e0-958db13ac0ef None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:15.651963 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0026b86d-8d86-46c6-a1a0-b8f86c008633 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:15.682383 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:15.707618 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b9e818-7c73-490c-a9e0-958db13ac0ef None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:15.713503 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0dbab-13bb-4f45-9b0c-87fadddb2b15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:15.714217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0dbab-13bb-4f45-9b0c-87fadddb2b15 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:15.714563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0dbab-13bb-4f45-9b0c-87fadddb2b15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:15.714949 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be0dbab-13bb-4f45-9b0c-87fadddb2b15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:15.725682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0dbab-13bb-4f45-9b0c-87fadddb2b15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:15.727445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2be0dbab-13bb-4f45-9b0c-87fadddb2b15 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:15.739708 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 815/1639] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:15 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:15.761964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48599b2-6afe-4fc1-aa90-9e26de27a1ab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:15.762812 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48599b2-6afe-4fc1-aa90-9e26de27a1ab service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:15.763198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48599b2-6afe-4fc1-aa90-9e26de27a1ab service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:15.763534 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48599b2-6afe-4fc1-aa90-9e26de27a1ab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:15.845868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:15.852614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48599b2-6afe-4fc1-aa90-9e26de27a1ab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:15.854218 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48599b2-6afe-4fc1-aa90-9e26de27a1ab service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:15.878906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 825/1640] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:15 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:15.973088 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0dbab-13bb-4f45-9b0c-87fadddb2b15 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:15.990103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be0dbab-13bb-4f45-9b0c-87fadddb2b15 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:16.002553 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1153ed76-2f5b-4d34-a6b5-1c7d51d9d4a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:16.003070 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153ed76-2f5b-4d34-a6b5-1c7d51d9d4a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:16.004174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153ed76-2f5b-4d34-a6b5-1c7d51d9d4a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:16.004454 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1153ed76-2f5b-4d34-a6b5-1c7d51d9d4a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:16.184944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153ed76-2f5b-4d34-a6b5-1c7d51d9d4a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:16.186555 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1153ed76-2f5b-4d34-a6b5-1c7d51d9d4a7 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:16.234710 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 816/1641] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:15 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:16.379821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48599b2-6afe-4fc1-aa90-9e26de27a1ab service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:16.395561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48599b2-6afe-4fc1-aa90-9e26de27a1ab service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:16.407274 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc122acf-fda2-4bdf-b71b-c80016ed3e38 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:16.407274 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc122acf-fda2-4bdf-b71b-c80016ed3e38 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:16.407274 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc122acf-fda2-4bdf-b71b-c80016ed3e38 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:16.408294 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc122acf-fda2-4bdf-b71b-c80016ed3e38 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:16.635616 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc122acf-fda2-4bdf-b71b-c80016ed3e38 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:16.642244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc122acf-fda2-4bdf-b71b-c80016ed3e38 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:16.671301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 826/1642] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:16 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:16.891180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c1ade-f702-45de-aaff-d3b26d0a2c68 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:16.891180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c1ade-f702-45de-aaff-d3b26d0a2c68 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:16.891706 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622c1ade-f702-45de-aaff-d3b26d0a2c68 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:16.892776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 817/1643] 10.222.0.70 () {54 vars in 962 bytes} [Mon Aug 1 14:22:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:22:16.901808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931921eb-e7c4-477a-96e0-dc8b1cf6e6f4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:16.902755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931921eb-e7c4-477a-96e0-dc8b1cf6e6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:16.902755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-931921eb-e7c4-477a-96e0-dc8b1cf6e6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:17.000891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-931921eb-e7c4-477a-96e0-dc8b1cf6e6f4 None None] MFA Rules not processed for user `e856fd5aff914cfb8b8dd86b39c89bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:17.002132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-931921eb-e7c4-477a-96e0-dc8b1cf6e6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:17.162541 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce890e-f17b-4cbe-a1c2-eb93609c99eb None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:17.162885 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce890e-f17b-4cbe-a1c2-eb93609c99eb None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:17.163123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbce890e-f17b-4cbe-a1c2-eb93609c99eb None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:17.164523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 818/1644] 10.222.0.70 () {54 vars in 912 bytes} [Mon Aug 1 14:22:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:22:17.171093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8bf4b-cd15-46ef-889e-0f30b141c776 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:17.171378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8bf4b-cd15-46ef-889e-0f30b141c776 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:17.171660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8bf4b-cd15-46ef-889e-0f30b141c776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:17.174393 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 827/1645] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Aug 1 14:22:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:17.214465 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8ad8bf4b-cd15-46ef-889e-0f30b141c776 None None] MFA Rules not processed for user `e856fd5aff914cfb8b8dd86b39c89bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:17.224179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8ad8bf4b-cd15-46ef-889e-0f30b141c776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:17.251411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 819/1646] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 1 14:22:17 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:17.307850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931921eb-e7c4-477a-96e0-dc8b1cf6e6f4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:17.326519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-931921eb-e7c4-477a-96e0-dc8b1cf6e6f4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:17.332301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4a600-1ac4-4d51-8af2-a35a082e8ca3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:17.332933 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4a600-1ac4-4d51-8af2-a35a082e8ca3 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:17.333261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4a600-1ac4-4d51-8af2-a35a082e8ca3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:17.333532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4a600-1ac4-4d51-8af2-a35a082e8ca3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:17.363826 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4a600-1ac4-4d51-8af2-a35a082e8ca3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:17.365527 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd4a600-1ac4-4d51-8af2-a35a082e8ca3 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:17.382198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 828/1647] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:19.428166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8bf4b-cd15-46ef-889e-0f30b141c776 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:19.587945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8bf4b-cd15-46ef-889e-0f30b141c776 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:19.601942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f05a82-6275-47d8-819f-18555aa84495 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:19.602811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f05a82-6275-47d8-819f-18555aa84495 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:19.603377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f05a82-6275-47d8-819f-18555aa84495 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:19.603799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f05a82-6275-47d8-819f-18555aa84495 admin admin] PATH_INFO: `/v3/users/6635f24728384effb9fc590ebed52487` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:19.607077 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f05a82-6275-47d8-819f-18555aa84495 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6635f24728384effb9fc590ebed52487)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:19.608526 dv-cinder-845990-5-smb devstack@keystone.service[80142]: WARNING py.warnings [None req-45f05a82-6275-47d8-819f-18555aa84495 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:22:19.608526 dv-cinder-845990-5-smb devstack@keystone.service[80142]: warnings.warn(msg) Aug 01 14:22:19.608526 dv-cinder-845990-5-smb devstack@keystone.service[80142]: Aug 01 14:22:19.613113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f05a82-6275-47d8-819f-18555aa84495 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:19.786359 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-45f05a82-6275-47d8-819f-18555aa84495 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6635f24728384effb9fc590ebed52487'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:19.826381 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-45f05a82-6275-47d8-819f-18555aa84495 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6635f24728384effb9fc590ebed52487'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:19.871005 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf49045-bf06-4bc2-a74f-8bcaca0d38eb None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:19.871624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf49045-bf06-4bc2-a74f-8bcaca0d38eb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:19.871624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf49045-bf06-4bc2-a74f-8bcaca0d38eb None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:19.873445 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 829/1648] 10.222.0.70 () {54 vars in 962 bytes} [Mon Aug 1 14:22:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:22:19.880439 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-45f05a82-6275-47d8-819f-18555aa84495 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6635f24728384effb9fc590ebed52487'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:19.881425 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-45f05a82-6275-47d8-819f-18555aa84495 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6635f24728384effb9fc590ebed52487'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:19.887796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0cdf2-7425-43e0-ad30-a63551ec7701 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:19.888237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0cdf2-7425-43e0-ad30-a63551ec7701 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:19.888623 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d0cdf2-7425-43e0-ad30-a63551ec7701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:19.890324 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:19.900033 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-45f05a82-6275-47d8-819f-18555aa84495 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6635f24728384effb9fc590ebed52487'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:19.914445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 820/1649] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:19 2022] DELETE /identity/v3/users/6635f24728384effb9fc590ebed52487 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:19.919581 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbb073-443a-4f14-bfcc-ab11ac969ec2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:19.919581 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbb073-443a-4f14-bfcc-ab11ac969ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:19.919962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbb073-443a-4f14-bfcc-ab11ac969ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:19.937683 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-57d0cdf2-7425-43e0-ad30-a63551ec7701 None None] MFA Rules not processed for user `e856fd5aff914cfb8b8dd86b39c89bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:19.940000 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-57d0cdf2-7425-43e0-ad30-a63551ec7701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:19.972449 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-27cbb073-443a-4f14-bfcc-ab11ac969ec2 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:19.975699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-27cbb073-443a-4f14-bfcc-ab11ac969ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:20.106540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:20.150543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 830/1650] 10.222.0.70 () {58 vars in 1059 bytes} [Mon Aug 1 14:22:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:20.162816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0cdf2-7425-43e0-ad30-a63551ec7701 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:20.162816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-57d0cdf2-7425-43e0-ad30-a63551ec7701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:20.208461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 821/1651] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:20.209792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d15d15-09b5-4f91-9b84-f0f6366145ee None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:20.210083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d15d15-09b5-4f91-9b84-f0f6366145ee None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:20.210361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d15d15-09b5-4f91-9b84-f0f6366145ee None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:20.211790 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 822/1652] 10.222.0.70 () {54 vars in 912 bytes} [Mon Aug 1 14:22:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:22:20.225035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16054e6f-5938-46e5-aa01-9ae471402938 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:20.225332 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16054e6f-5938-46e5-aa01-9ae471402938 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:20.225616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16054e6f-5938-46e5-aa01-9ae471402938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:20.259691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-16054e6f-5938-46e5-aa01-9ae471402938 None None] MFA Rules not processed for user `e856fd5aff914cfb8b8dd86b39c89bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:20.260935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-16054e6f-5938-46e5-aa01-9ae471402938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:20.297840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 823/1653] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 1 14:22:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:20.298883 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16054e6f-5938-46e5-aa01-9ae471402938 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:20.302570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-16054e6f-5938-46e5-aa01-9ae471402938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:20.331924 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d0cdf2-7425-43e0-ad30-a63551ec7701 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:20.348352 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110839a-8f74-4bd8-a9f9-57bb479e0213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:20.349265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110839a-8f74-4bd8-a9f9-57bb479e0213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:20.349643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110839a-8f74-4bd8-a9f9-57bb479e0213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:20.350015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110839a-8f74-4bd8-a9f9-57bb479e0213 admin admin] PATH_INFO: `/v3/users/bb10455b85f94e8cbf3aeb660fefa9d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:20.351377 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110839a-8f74-4bd8-a9f9-57bb479e0213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb10455b85f94e8cbf3aeb660fefa9d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:20.353647 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f110839a-8f74-4bd8-a9f9-57bb479e0213 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:20.406602 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16054e6f-5938-46e5-aa01-9ae471402938 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:20.411610 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb92af4-dbb5-4660-abfb-c2ea11904bde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:20.412933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb92af4-dbb5-4660-abfb-c2ea11904bde service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:20.413231 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb92af4-dbb5-4660-abfb-c2ea11904bde service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:20.413594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb92af4-dbb5-4660-abfb-c2ea11904bde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:20.428327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb92af4-dbb5-4660-abfb-c2ea11904bde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:20.430814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb92af4-dbb5-4660-abfb-c2ea11904bde service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:20.448801 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 824/1654] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:20.450106 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f110839a-8f74-4bd8-a9f9-57bb479e0213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb10455b85f94e8cbf3aeb660fefa9d4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:20.450254 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb92af4-dbb5-4660-abfb-c2ea11904bde service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:20.452155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fbb92af4-dbb5-4660-abfb-c2ea11904bde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:20.481019 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f110839a-8f74-4bd8-a9f9-57bb479e0213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb10455b85f94e8cbf3aeb660fefa9d4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:20.496847 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f110839a-8f74-4bd8-a9f9-57bb479e0213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb10455b85f94e8cbf3aeb660fefa9d4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:20.498304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f110839a-8f74-4bd8-a9f9-57bb479e0213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb10455b85f94e8cbf3aeb660fefa9d4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:20.519590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f110839a-8f74-4bd8-a9f9-57bb479e0213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb10455b85f94e8cbf3aeb660fefa9d4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:20.537664 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 831/1655] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:20 2022] DELETE /identity/v3/users/bb10455b85f94e8cbf3aeb660fefa9d4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:20.538311 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdabc4-2cd2-4580-9bad-012ab860394b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:20.538719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdabc4-2cd2-4580-9bad-012ab860394b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:20.539284 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05cdabc4-2cd2-4580-9bad-012ab860394b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:20.567763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb92af4-dbb5-4660-abfb-c2ea11904bde service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:20.577114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-05cdabc4-2cd2-4580-9bad-012ab860394b None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:20.579812 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-05cdabc4-2cd2-4580-9bad-012ab860394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:20.666806 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:20.680806 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc46376-e46f-44d3-95a5-02b2c6cd500c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:20.684888 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc46376-e46f-44d3-95a5-02b2c6cd500c service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:20.685324 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc46376-e46f-44d3-95a5-02b2c6cd500c service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:20.685604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc46376-e46f-44d3-95a5-02b2c6cd500c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:20.692341 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6cc46376-e46f-44d3-95a5-02b2c6cd500c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:20.732220 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 832/1656] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:20.782457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdabc4-2cd2-4580-9bad-012ab860394b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:20.785284 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-05cdabc4-2cd2-4580-9bad-012ab860394b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:20.804510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:20.838461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc46376-e46f-44d3-95a5-02b2c6cd500c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:20.842556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc46376-e46f-44d3-95a5-02b2c6cd500c service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:20.864563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 825/1657] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:20.904085 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05cdabc4-2cd2-4580-9bad-012ab860394b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:20.914715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b52658-0529-4995-9c3e-d4e78e38acad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:20.915732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b52658-0529-4995-9c3e-d4e78e38acad service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:20.916642 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b52658-0529-4995-9c3e-d4e78e38acad service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:20.917818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b52658-0529-4995-9c3e-d4e78e38acad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:20.933798 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b52658-0529-4995-9c3e-d4e78e38acad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:20.936158 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b52658-0529-4995-9c3e-d4e78e38acad service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:20.953406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 833/1658] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:21.469443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc46376-e46f-44d3-95a5-02b2c6cd500c service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:21.471042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6cc46376-e46f-44d3-95a5-02b2c6cd500c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:21.501796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc46376-e46f-44d3-95a5-02b2c6cd500c service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:21.519391 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437274a0-caad-4a9b-a06a-07fff4097d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:21.521014 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437274a0-caad-4a9b-a06a-07fff4097d02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:21.521310 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437274a0-caad-4a9b-a06a-07fff4097d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:21.521611 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437274a0-caad-4a9b-a06a-07fff4097d02 admin admin] PATH_INFO: `/v3/projects/aa6c54d2ec23462c846a0414d7c0234d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:21.525551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437274a0-caad-4a9b-a06a-07fff4097d02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa6c54d2ec23462c846a0414d7c0234d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:21.531602 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437274a0-caad-4a9b-a06a-07fff4097d02 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:21.780644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-437274a0-caad-4a9b-a06a-07fff4097d02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa6c54d2ec23462c846a0414d7c0234d', 'request_id': 'req-437274a0-caad-4a9b-a06a-07fff4097d02'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:21.797684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-437274a0-caad-4a9b-a06a-07fff4097d02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa6c54d2ec23462c846a0414d7c0234d', 'request_id': 'req-437274a0-caad-4a9b-a06a-07fff4097d02'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:21.830521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-437274a0-caad-4a9b-a06a-07fff4097d02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa6c54d2ec23462c846a0414d7c0234d', 'request_id': 'req-437274a0-caad-4a9b-a06a-07fff4097d02'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:21.889723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-437274a0-caad-4a9b-a06a-07fff4097d02 admin admin] The token cache is being invalidate because project aa6c54d2ec23462c846a0414d7c0234d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:21.895800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-437274a0-caad-4a9b-a06a-07fff4097d02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:21.901355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-437274a0-caad-4a9b-a06a-07fff4097d02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:21.908593 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b52658-0529-4995-9c3e-d4e78e38acad service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:21.909880 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 826/1659] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:21 2022] DELETE /identity/v3/projects/aa6c54d2ec23462c846a0414d7c0234d => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:21.932756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b52658-0529-4995-9c3e-d4e78e38acad service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:22.120710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79be480-5164-4c76-b61c-c5cdb6f49d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:22.121795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79be480-5164-4c76-b61c-c5cdb6f49d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:22.122085 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79be480-5164-4c76-b61c-c5cdb6f49d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:22.122361 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79be480-5164-4c76-b61c-c5cdb6f49d29 admin admin] PATH_INFO: `/v3/users/a6f87ad8aa064b7086cd5e4b9cc2d1eb` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:22.123631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79be480-5164-4c76-b61c-c5cdb6f49d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6f87ad8aa064b7086cd5e4b9cc2d1eb)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:22.126298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79be480-5164-4c76-b61c-c5cdb6f49d29 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:22.255981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a79be480-5164-4c76-b61c-c5cdb6f49d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6f87ad8aa064b7086cd5e4b9cc2d1eb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.289973 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a79be480-5164-4c76-b61c-c5cdb6f49d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6f87ad8aa064b7086cd5e4b9cc2d1eb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.305657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a79be480-5164-4c76-b61c-c5cdb6f49d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6f87ad8aa064b7086cd5e4b9cc2d1eb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.308697 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a79be480-5164-4c76-b61c-c5cdb6f49d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6f87ad8aa064b7086cd5e4b9cc2d1eb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.324860 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a79be480-5164-4c76-b61c-c5cdb6f49d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6f87ad8aa064b7086cd5e4b9cc2d1eb'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:22.343548 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 834/1660] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:21 2022] DELETE /identity/v3/users/a6f87ad8aa064b7086cd5e4b9cc2d1eb => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:24.137242 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437274a0-caad-4a9b-a06a-07fff4097d02 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:24.142904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-437274a0-caad-4a9b-a06a-07fff4097d02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:24.285645 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437274a0-caad-4a9b-a06a-07fff4097d02 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:24.409673 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbfc99-5f93-4040-9f91-ac6825d527ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:24.410496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbfc99-5f93-4040-9f91-ac6825d527ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.411050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbfc99-5f93-4040-9f91-ac6825d527ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.411553 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efbfc99-5f93-4040-9f91-ac6825d527ce admin admin] PATH_INFO: `/v3/projects/836e0fdc361f47cc80b2020b45f07d44` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.413135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbfc99-5f93-4040-9f91-ac6825d527ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=836e0fdc361f47cc80b2020b45f07d44)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:24.416786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efbfc99-5f93-4040-9f91-ac6825d527ce admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:24.446806 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:24.496102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79be480-5164-4c76-b61c-c5cdb6f49d29 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:24.497635 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a79be480-5164-4c76-b61c-c5cdb6f49d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:24.523675 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79be480-5164-4c76-b61c-c5cdb6f49d29 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:24.557027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3efbfc99-5f93-4040-9f91-ac6825d527ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '836e0fdc361f47cc80b2020b45f07d44', 'request_id': 'req-3efbfc99-5f93-4040-9f91-ac6825d527ce'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:24.585423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3efbfc99-5f93-4040-9f91-ac6825d527ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '836e0fdc361f47cc80b2020b45f07d44', 'request_id': 'req-3efbfc99-5f93-4040-9f91-ac6825d527ce'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:24.604613 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3efbfc99-5f93-4040-9f91-ac6825d527ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '836e0fdc361f47cc80b2020b45f07d44', 'request_id': 'req-3efbfc99-5f93-4040-9f91-ac6825d527ce'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:24.639484 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3efbfc99-5f93-4040-9f91-ac6825d527ce admin admin] The token cache is being invalidate because project 836e0fdc361f47cc80b2020b45f07d44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:24.639852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3efbfc99-5f93-4040-9f91-ac6825d527ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:24.646703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3efbfc99-5f93-4040-9f91-ac6825d527ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:24.649695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:24.656260 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 827/1661] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:24 2022] DELETE /identity/v3/projects/836e0fdc361f47cc80b2020b45f07d44 => generated 0 bytes in 527 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:24.660237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbfc99-5f93-4040-9f91-ac6825d527ce admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:24.661746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3efbfc99-5f93-4040-9f91-ac6825d527ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:24.698765 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:24.699412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.699806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.700089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae admin admin] PATH_INFO: `/v3/projects/2d5356c5a5b84b1c85b3d587b9083223` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:24.703910 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d5356c5a5b84b1c85b3d587b9083223)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:24.705082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: WARNING py.warnings [None req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 01 14:22:24.705082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: warnings.warn(msg) Aug 01 14:22:24.705082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: Aug 01 14:22:24.710840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:24.844057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d5356c5a5b84b1c85b3d587b9083223', 'request_id': 'req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:24.880410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efbfc99-5f93-4040-9f91-ac6825d527ce admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:24.883156 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d5356c5a5b84b1c85b3d587b9083223', 'request_id': 'req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:24.904407 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d5356c5a5b84b1c85b3d587b9083223', 'request_id': 'req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:24.933382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae admin admin] The token cache is being invalidate because project 2d5356c5a5b84b1c85b3d587b9083223 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:24.933867 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:24.939636 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a7bb2e22-9d4f-43c0-8e04-d06f8ff623ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:24.943889 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 835/1662] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:24 2022] DELETE /identity/v3/projects/2d5356c5a5b84b1c85b3d587b9083223 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:24.950015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cda720-4438-465e-a1de-71034cacc6a8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:24.950295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cda720-4438-465e-a1de-71034cacc6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:24.950572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cda720-4438-465e-a1de-71034cacc6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:25.031769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-01cda720-4438-465e-a1de-71034cacc6a8 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:25.036177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-01cda720-4438-465e-a1de-71034cacc6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:25.053346 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4332ab-9540-4766-9f24-0928d16b3f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:25.054185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4332ab-9540-4766-9f24-0928d16b3f75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:25.054564 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4332ab-9540-4766-9f24-0928d16b3f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:25.054963 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4332ab-9540-4766-9f24-0928d16b3f75 admin admin] PATH_INFO: `/v3/users/dc49a0dc408b45aba4aa62f557a4f58b` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:25.059433 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4332ab-9540-4766-9f24-0928d16b3f75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc49a0dc408b45aba4aa62f557a4f58b)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:25.061840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4332ab-9540-4766-9f24-0928d16b3f75 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:25.194497 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5e4332ab-9540-4766-9f24-0928d16b3f75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc49a0dc408b45aba4aa62f557a4f58b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:25.198884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:25.212175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5e4332ab-9540-4766-9f24-0928d16b3f75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc49a0dc408b45aba4aa62f557a4f58b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:25.268740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5e4332ab-9540-4766-9f24-0928d16b3f75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc49a0dc408b45aba4aa62f557a4f58b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:25.270396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5e4332ab-9540-4766-9f24-0928d16b3f75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc49a0dc408b45aba4aa62f557a4f58b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:25.280360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 836/1663] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:25.287783 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769f250-5ecd-4af9-9aea-ae29c5ba4a15 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:25.288074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769f250-5ecd-4af9-9aea-ae29c5ba4a15 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:25.288353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2769f250-5ecd-4af9-9aea-ae29c5ba4a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:25.292653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-5e4332ab-9540-4766-9f24-0928d16b3f75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc49a0dc408b45aba4aa62f557a4f58b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:25.316272 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 828/1664] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:24 2022] DELETE /identity/v3/users/dc49a0dc408b45aba4aa62f557a4f58b => generated 0 bytes in 653 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:25.387195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2769f250-5ecd-4af9-9aea-ae29c5ba4a15 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:25.389408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2769f250-5ecd-4af9-9aea-ae29c5ba4a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:25.556021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4332ab-9540-4766-9f24-0928d16b3f75 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:25.562890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 837/1665] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:25.576378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4332ab-9540-4766-9f24-0928d16b3f75 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:25.601906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55835743-5f30-4269-9f0e-05bb4827e729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:25.602554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55835743-5f30-4269-9f0e-05bb4827e729 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:25.602878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55835743-5f30-4269-9f0e-05bb4827e729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:25.603142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55835743-5f30-4269-9f0e-05bb4827e729 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:25.603853 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55835743-5f30-4269-9f0e-05bb4827e729 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:25.610052 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55835743-5f30-4269-9f0e-05bb4827e729 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:25.611870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55835743-5f30-4269-9f0e-05bb4827e729 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:25.640445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 829/1666] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:25.642335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769f250-5ecd-4af9-9aea-ae29c5ba4a15 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:25.649536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:25.662498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2769f250-5ecd-4af9-9aea-ae29c5ba4a15 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:25.679083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3951e8-6b2f-4ba3-81d8-5dd1f0f7d235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:25.681233 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3951e8-6b2f-4ba3-81d8-5dd1f0f7d235 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:25.683875 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3951e8-6b2f-4ba3-81d8-5dd1f0f7d235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:25.684173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3951e8-6b2f-4ba3-81d8-5dd1f0f7d235 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:25.687047 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3951e8-6b2f-4ba3-81d8-5dd1f0f7d235 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:25.692369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3951e8-6b2f-4ba3-81d8-5dd1f0f7d235 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:25.773597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55835743-5f30-4269-9f0e-05bb4827e729 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:25.773968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 838/1667] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:25 2022] POST /identity/v3/projects => generated 379 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:25.801009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55835743-5f30-4269-9f0e-05bb4827e729 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:26.032723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76837ee6-ea61-47c5-9d71-b80fdc80aa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:26.033387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76837ee6-ea61-47c5-9d71-b80fdc80aa5d admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:26.033671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76837ee6-ea61-47c5-9d71-b80fdc80aa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:26.034487 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76837ee6-ea61-47c5-9d71-b80fdc80aa5d admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:26.040908 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76837ee6-ea61-47c5-9d71-b80fdc80aa5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:26.043261 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76837ee6-ea61-47c5-9d71-b80fdc80aa5d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:26.106033 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 830/1668] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:25 2022] POST /identity/v3/users => generated 290 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:26.113697 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3951e8-6b2f-4ba3-81d8-5dd1f0f7d235 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:26.145301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3951e8-6b2f-4ba3-81d8-5dd1f0f7d235 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:26.170299 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d499e96-a9c2-4744-9844-f85d1f2aee6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:26.171108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d499e96-a9c2-4744-9844-f85d1f2aee6a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:26.171903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d499e96-a9c2-4744-9844-f85d1f2aee6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:26.173155 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d499e96-a9c2-4744-9844-f85d1f2aee6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:26.174236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d499e96-a9c2-4744-9844-f85d1f2aee6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:26.181660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d499e96-a9c2-4744-9844-f85d1f2aee6a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:26.224818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 839/1669] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:26.226771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76837ee6-ea61-47c5-9d71-b80fdc80aa5d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:26.247881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76837ee6-ea61-47c5-9d71-b80fdc80aa5d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:26.265645 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e161fab-5c04-4732-99bf-6e33f30b3939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:26.266346 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e161fab-5c04-4732-99bf-6e33f30b3939 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:26.266666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e161fab-5c04-4732-99bf-6e33f30b3939 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:26.267092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e161fab-5c04-4732-99bf-6e33f30b3939 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:26.267836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e161fab-5c04-4732-99bf-6e33f30b3939 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:26.270028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e161fab-5c04-4732-99bf-6e33f30b3939 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:26.325708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d499e96-a9c2-4744-9844-f85d1f2aee6a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:26.329996 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 831/1670] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:26.353681 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d499e96-a9c2-4744-9844-f85d1f2aee6a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:26.379124 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a239e-8e45-45c1-a51a-ac5ce1cfa530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:26.383777 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a239e-8e45-45c1-a51a-ac5ce1cfa530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:26.384180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a239e-8e45-45c1-a51a-ac5ce1cfa530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:26.384651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76a239e-8e45-45c1-a51a-ac5ce1cfa530 admin admin] PATH_INFO: `/v3/projects/5f1bb58c6a88424e9fb1e5f5bb7c48c9/users/330baecf130a415bb5f4d6254e53c342/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:26.434682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a239e-8e45-45c1-a51a-ac5ce1cfa530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f1bb58c6a88424e9fb1e5f5bb7c48c9, user_id=330baecf130a415bb5f4d6254e53c342, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:26.437802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76a239e-8e45-45c1-a51a-ac5ce1cfa530 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:26.477721 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 840/1671] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:26 2022] PUT /identity/v3/projects/5f1bb58c6a88424e9fb1e5f5bb7c48c9/users/330baecf130a415bb5f4d6254e53c342/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:26.490823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a772b4-a351-4759-a26c-87eb885375b4 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:26.491339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a772b4-a351-4759-a26c-87eb885375b4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:26.491755 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a772b4-a351-4759-a26c-87eb885375b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:26.546408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-73a772b4-a351-4759-a26c-87eb885375b4 None None] MFA Rules not processed for user `330baecf130a415bb5f4d6254e53c342`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:26.547966 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-73a772b4-a351-4759-a26c-87eb885375b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:26.720627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 832/1672] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:26 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:26.725752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a239e-8e45-45c1-a51a-ac5ce1cfa530 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:26.851820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76a239e-8e45-45c1-a51a-ac5ce1cfa530 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:26.861358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be874bf-3667-434e-b654-adf6bf89faea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:26.862184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be874bf-3667-434e-b654-adf6bf89faea admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:26.862794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be874bf-3667-434e-b654-adf6bf89faea admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:26.863129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be874bf-3667-434e-b654-adf6bf89faea admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:26.863802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be874bf-3667-434e-b654-adf6bf89faea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:26.865729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be874bf-3667-434e-b654-adf6bf89faea admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:26.928758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a772b4-a351-4759-a26c-87eb885375b4 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:26.930635 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-73a772b4-a351-4759-a26c-87eb885375b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:26.935729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 841/1673] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:26 2022] POST /identity/v3/projects => generated 377 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:26.940689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be874bf-3667-434e-b654-adf6bf89faea admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:26.958470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a772b4-a351-4759-a26c-87eb885375b4 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.019586 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:27.086289 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be874bf-3667-434e-b654-adf6bf89faea admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.089755 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70bd19-0831-4a1d-8c98-cefe696a6078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.090671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70bd19-0831-4a1d-8c98-cefe696a6078 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.091210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70bd19-0831-4a1d-8c98-cefe696a6078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.091687 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70bd19-0831-4a1d-8c98-cefe696a6078 admin admin] PATH_INFO: `/v3/projects/d8c51c679576437da0ce779ab19486e1` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.093753 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70bd19-0831-4a1d-8c98-cefe696a6078 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8c51c679576437da0ce779ab19486e1)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.095249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d7320-9be6-4299-bf72-a9b87ffddde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.095848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d7320-9be6-4299-bf72-a9b87ffddde9 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.096128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d7320-9be6-4299-bf72-a9b87ffddde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.096433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613d7320-9be6-4299-bf72-a9b87ffddde9 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.097106 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d7320-9be6-4299-bf72-a9b87ffddde9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.097624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70bd19-0831-4a1d-8c98-cefe696a6078 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:27.099229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613d7320-9be6-4299-bf72-a9b87ffddde9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:27.181334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 842/1674] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:26 2022] POST /identity/v3/users => generated 289 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:27.187430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d7320-9be6-4299-bf72-a9b87ffddde9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:27.207845 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613d7320-9be6-4299-bf72-a9b87ffddde9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.218381 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8e70bd19-0831-4a1d-8c98-cefe696a6078 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8c51c679576437da0ce779ab19486e1', 'request_id': 'req-8e70bd19-0831-4a1d-8c98-cefe696a6078'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:27.229582 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8e70bd19-0831-4a1d-8c98-cefe696a6078 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8c51c679576437da0ce779ab19486e1', 'request_id': 'req-8e70bd19-0831-4a1d-8c98-cefe696a6078'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:27.254707 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8e70bd19-0831-4a1d-8c98-cefe696a6078 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8c51c679576437da0ce779ab19486e1', 'request_id': 'req-8e70bd19-0831-4a1d-8c98-cefe696a6078'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:27.255220 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:27.275639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8e70bd19-0831-4a1d-8c98-cefe696a6078 admin admin] The token cache is being invalidate because project d8c51c679576437da0ce779ab19486e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:27.275936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8e70bd19-0831-4a1d-8c98-cefe696a6078 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:27.277719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8e70bd19-0831-4a1d-8c98-cefe696a6078 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:27.280576 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 833/1675] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:26 2022] DELETE /identity/v3/projects/d8c51c679576437da0ce779ab19486e1 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:27.287062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae9bf0-ee2c-4edd-84d2-d63052b74217 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.287062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae9bf0-ee2c-4edd-84d2-d63052b74217 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.287062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aae9bf0-ee2c-4edd-84d2-d63052b74217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.328632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4aae9bf0-ee2c-4edd-84d2-d63052b74217 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:27.330521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4aae9bf0-ee2c-4edd-84d2-d63052b74217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:27.338732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589278d-7dd2-4045-b6d8-91d0b2249548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.339446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589278d-7dd2-4045-b6d8-91d0b2249548 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.339663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589278d-7dd2-4045-b6d8-91d0b2249548 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.340502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3589278d-7dd2-4045-b6d8-91d0b2249548 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.340660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589278d-7dd2-4045-b6d8-91d0b2249548 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.342306 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3589278d-7dd2-4045-b6d8-91d0b2249548 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:27.355072 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 834/1676] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:27.360887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 843/1677] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:27.367572 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca0192-eb25-48a6-a0cb-396a769bce5e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.367939 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca0192-eb25-48a6-a0cb-396a769bce5e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.368279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca0192-eb25-48a6-a0cb-396a769bce5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.377310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589278d-7dd2-4045-b6d8-91d0b2249548 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:27.383424 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3589278d-7dd2-4045-b6d8-91d0b2249548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:27.429507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3589278d-7dd2-4045-b6d8-91d0b2249548 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.430464 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-dfca0192-eb25-48a6-a0cb-396a769bce5e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:27.433195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dfca0192-eb25-48a6-a0cb-396a769bce5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:27.453744 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dc996-d37e-4018-9e2f-01322105359b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.459231 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dc996-d37e-4018-9e2f-01322105359b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.459231 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dc996-d37e-4018-9e2f-01322105359b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.459231 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879dc996-d37e-4018-9e2f-01322105359b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.461784 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879dc996-d37e-4018-9e2f-01322105359b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.467924 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 835/1678] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:27.469685 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879dc996-d37e-4018-9e2f-01322105359b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:27.477540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca0192-eb25-48a6-a0cb-396a769bce5e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:27.516463 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfca0192-eb25-48a6-a0cb-396a769bce5e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.544005 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 844/1679] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:27.544005 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dc996-d37e-4018-9e2f-01322105359b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:27.547698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29f9f4-16a4-4258-8055-e75c53b8916c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.548565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29f9f4-16a4-4258-8055-e75c53b8916c admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.548852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29f9f4-16a4-4258-8055-e75c53b8916c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.549133 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da29f9f4-16a4-4258-8055-e75c53b8916c admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.558824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29f9f4-16a4-4258-8055-e75c53b8916c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:27.559622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29f9f4-16a4-4258-8055-e75c53b8916c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.561642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da29f9f4-16a4-4258-8055-e75c53b8916c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:27.595490 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879dc996-d37e-4018-9e2f-01322105359b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.610780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 836/1680] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:22:27.612097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29f9f4-16a4-4258-8055-e75c53b8916c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:27.621705 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249967cd-e3ca-4964-98e4-71449ce4c6ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.623791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249967cd-e3ca-4964-98e4-71449ce4c6ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.626332 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da29f9f4-16a4-4258-8055-e75c53b8916c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.628306 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249967cd-e3ca-4964-98e4-71449ce4c6ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.632607 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249967cd-e3ca-4964-98e4-71449ce4c6ea admin admin] PATH_INFO: `/v3/projects/4dc1ebec6c83469b88a648a2208ef5ca/users/8193241ae15a4aba84c824387bf0a97d/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.642773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba91e46-d514-4766-af9d-b4b600c5c6b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:27.643778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba91e46-d514-4766-af9d-b4b600c5c6b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.644187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba91e46-d514-4766-af9d-b4b600c5c6b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.644548 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba91e46-d514-4766-af9d-b4b600c5c6b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.645660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba91e46-d514-4766-af9d-b4b600c5c6b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.649166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba91e46-d514-4766-af9d-b4b600c5c6b5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:27.695160 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249967cd-e3ca-4964-98e4-71449ce4c6ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=4dc1ebec6c83469b88a648a2208ef5ca, user_id=8193241ae15a4aba84c824387bf0a97d, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:27.697895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249967cd-e3ca-4964-98e4-71449ce4c6ea admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:27.729929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 837/1681] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:27 2022] POST /identity/v3/projects => generated 367 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:27.734752 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba91e46-d514-4766-af9d-b4b600c5c6b5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:27.742682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 845/1682] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:27 2022] PUT /identity/v3/projects/4dc1ebec6c83469b88a648a2208ef5ca/users/8193241ae15a4aba84c824387bf0a97d/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:27.752118 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f731f4-30d0-46bb-93b2-40afd89c3846 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:27.752534 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f731f4-30d0-46bb-93b2-40afd89c3846 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:27.752908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f731f4-30d0-46bb-93b2-40afd89c3846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:27.821706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c7f731f4-30d0-46bb-93b2-40afd89c3846 None None] MFA Rules not processed for user `8193241ae15a4aba84c824387bf0a97d`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:27.824922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c7f731f4-30d0-46bb-93b2-40afd89c3846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:27.930360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba91e46-d514-4766-af9d-b4b600c5c6b5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:27.956257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:28.048038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 846/1683] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:28.051364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f731f4-30d0-46bb-93b2-40afd89c3846 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:28.113171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9455f7f-729a-4e08-a81d-5c1797b477ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:28.114042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9455f7f-729a-4e08-a81d-5c1797b477ee admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.114465 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9455f7f-729a-4e08-a81d-5c1797b477ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.114893 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9455f7f-729a-4e08-a81d-5c1797b477ee admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.115699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9455f7f-729a-4e08-a81d-5c1797b477ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:28.117812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9455f7f-729a-4e08-a81d-5c1797b477ee admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:28.180535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 838/1684] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:27 2022] POST /identity/v3/users => generated 284 bytes in 443 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:28.181723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9455f7f-729a-4e08-a81d-5c1797b477ee admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:28.196647 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9455f7f-729a-4e08-a81d-5c1797b477ee admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:28.212140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad70a2d-f4d0-4236-bf92-bc45a43d4121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:28.212790 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad70a2d-f4d0-4236-bf92-bc45a43d4121 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.213060 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad70a2d-f4d0-4236-bf92-bc45a43d4121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.213333 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad70a2d-f4d0-4236-bf92-bc45a43d4121 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.214042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad70a2d-f4d0-4236-bf92-bc45a43d4121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:28.215812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad70a2d-f4d0-4236-bf92-bc45a43d4121 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:28.245355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 839/1685] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:28.251337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad70a2d-f4d0-4236-bf92-bc45a43d4121 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:28.273340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad70a2d-f4d0-4236-bf92-bc45a43d4121 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:28.279782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f731f4-30d0-46bb-93b2-40afd89c3846 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:28.291978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c58634-76fa-47c8-b819-c748a69f213c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:28.292846 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c58634-76fa-47c8-b819-c748a69f213c admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.293164 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c58634-76fa-47c8-b819-c748a69f213c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.293269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb1642-4703-4878-9580-5d33c3f5e648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:28.293647 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c58634-76fa-47c8-b819-c748a69f213c admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.293954 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb1642-4703-4878-9580-5d33c3f5e648 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.294257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb1642-4703-4878-9580-5d33c3f5e648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.294433 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29eb1642-4703-4878-9580-5d33c3f5e648 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.295166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb1642-4703-4878-9580-5d33c3f5e648 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:28.296792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29eb1642-4703-4878-9580-5d33c3f5e648 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:28.301106 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c58634-76fa-47c8-b819-c748a69f213c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:28.303625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c58634-76fa-47c8-b819-c748a69f213c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:28.334148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 840/1686] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:28.338318 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb1642-4703-4878-9580-5d33c3f5e648 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:28.349142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29eb1642-4703-4878-9580-5d33c3f5e648 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:28.367613 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0eb4e4-1f1c-4106-974e-fc1bdc44c5fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:28.368311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0eb4e4-1f1c-4106-974e-fc1bdc44c5fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.368594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0eb4e4-1f1c-4106-974e-fc1bdc44c5fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.368871 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0eb4e4-1f1c-4106-974e-fc1bdc44c5fc admin admin] PATH_INFO: `/v3/projects/2923f8c7f67c4df8b7a13b6967cdcd5d/users/e9e5c1aba670427392a3ab099c9c39a7/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.374353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:28.400973 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 847/1687] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:28 2022] POST /identity/v3/projects => generated 375 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:28.402053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c58634-76fa-47c8-b819-c748a69f213c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:28.415762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0eb4e4-1f1c-4106-974e-fc1bdc44c5fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=2923f8c7f67c4df8b7a13b6967cdcd5d, user_id=e9e5c1aba670427392a3ab099c9c39a7, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:28.424150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0eb4e4-1f1c-4106-974e-fc1bdc44c5fc admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:28.472820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 841/1688] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:28 2022] PUT /identity/v3/projects/2923f8c7f67c4df8b7a13b6967cdcd5d/users/e9e5c1aba670427392a3ab099c9c39a7/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:28.483107 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6f6a5-3a6a-42c9-9314-1dededee936d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.483396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6f6a5-3a6a-42c9-9314-1dededee936d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.483675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e6f6a5-3a6a-42c9-9314-1dededee936d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.572472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-94e6f6a5-3a6a-42c9-9314-1dededee936d None None] MFA Rules not processed for user `e9e5c1aba670427392a3ab099c9c39a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:28.574221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-94e6f6a5-3a6a-42c9-9314-1dededee936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:28.638971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c58634-76fa-47c8-b819-c748a69f213c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:28.728438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 842/1689] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:28 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:28.729621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6f6a5-3a6a-42c9-9314-1dededee936d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:28.798128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effa47c-8635-406c-8881-99761cdc6406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:28.798949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effa47c-8635-406c-8881-99761cdc6406 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.799531 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effa47c-8635-406c-8881-99761cdc6406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.801297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0effa47c-8635-406c-8881-99761cdc6406 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.802326 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effa47c-8635-406c-8881-99761cdc6406 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:28.809687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0effa47c-8635-406c-8881-99761cdc6406 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:28.822515 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:28.857004 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 848/1690] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:28 2022] POST /identity/v3/users => generated 294 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:28.858236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effa47c-8635-406c-8881-99761cdc6406 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:28.865182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e6f6a5-3a6a-42c9-9314-1dededee936d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:28.880463 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83183ae5-cc04-4e9d-b384-fafff2e0b013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:28.881112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83183ae5-cc04-4e9d-b384-fafff2e0b013 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.881592 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83183ae5-cc04-4e9d-b384-fafff2e0b013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.881860 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83183ae5-cc04-4e9d-b384-fafff2e0b013 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.882538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83183ae5-cc04-4e9d-b384-fafff2e0b013 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:28.882788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0effa47c-8635-406c-8881-99761cdc6406 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:28.884536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83183ae5-cc04-4e9d-b384-fafff2e0b013 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:28.895209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52978b-570f-479e-8057-346e1c0a5e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:28.895977 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52978b-570f-479e-8057-346e1c0a5e3c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.901109 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52978b-570f-479e-8057-346e1c0a5e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.901743 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52978b-570f-479e-8057-346e1c0a5e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:28.902608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52978b-570f-479e-8057-346e1c0a5e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:28.904379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52978b-570f-479e-8057-346e1c0a5e3c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:28.941043 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 849/1691] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:28.944336 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52978b-570f-479e-8057-346e1c0a5e3c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:28.948113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8e52978b-570f-479e-8057-346e1c0a5e3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:28.973433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52978b-570f-479e-8057-346e1c0a5e3c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:28.976551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 843/1692] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:28 2022] POST /identity/v3/projects => generated 367 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:28.978074 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa2f76-1975-4eec-9135-2fa4053b0ecd None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:28.978501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa2f76-1975-4eec-9135-2fa4053b0ecd None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:28.978940 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa2f76-1975-4eec-9135-2fa4053b0ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.047460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-31fa2f76-1975-4eec-9135-2fa4053b0ecd None None] MFA Rules not processed for user `3c069d8c991d482992951ba0eb7b3395`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:29.048956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-31fa2f76-1975-4eec-9135-2fa4053b0ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:29.174460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28f3e20-e048-4a3c-b5b3-ac580f4deacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:29.186792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f3e20-e048-4a3c-b5b3-ac580f4deacb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.186792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f3e20-e048-4a3c-b5b3-ac580f4deacb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.189119 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f3e20-e048-4a3c-b5b3-ac580f4deacb admin admin] PATH_INFO: `/v3/users/828f50086e7c4a43bc852dcf0c416374` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.192475 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f3e20-e048-4a3c-b5b3-ac580f4deacb admin admin] RBAC: Authorizing `identity:delete_user(user_id=828f50086e7c4a43bc852dcf0c416374)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:29.195784 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28f3e20-e048-4a3c-b5b3-ac580f4deacb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:29.227729 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 844/1693] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:28 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:29.227729 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa2f76-1975-4eec-9135-2fa4053b0ecd None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:29.244028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa2f76-1975-4eec-9135-2fa4053b0ecd None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:29.257934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad7cc8-3b3b-4cf2-bb7c-5dd840097b36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:29.258661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad7cc8-3b3b-4cf2-bb7c-5dd840097b36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.258940 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad7cc8-3b3b-4cf2-bb7c-5dd840097b36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.259374 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad7cc8-3b3b-4cf2-bb7c-5dd840097b36 admin admin] PATH_INFO: `/v3/projects/dfe87a9ef99e4651ae8eab45b46a8c8e/users/38f939802f494d5780d81858ed1379ea/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.296099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad7cc8-3b3b-4cf2-bb7c-5dd840097b36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe87a9ef99e4651ae8eab45b46a8c8e, user_id=38f939802f494d5780d81858ed1379ea, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:29.299121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad7cc8-3b3b-4cf2-bb7c-5dd840097b36 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:29.305013 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:29.339355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 845/1694] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:29 2022] PUT /identity/v3/projects/dfe87a9ef99e4651ae8eab45b46a8c8e/users/38f939802f494d5780d81858ed1379ea/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:29.342399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad7cc8-3b3b-4cf2-bb7c-5dd840097b36 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:29.362680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e28f3e20-e048-4a3c-b5b3-ac580f4deacb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '828f50086e7c4a43bc852dcf0c416374'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:29.396270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e28f3e20-e048-4a3c-b5b3-ac580f4deacb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '828f50086e7c4a43bc852dcf0c416374'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:29.415203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e28f3e20-e048-4a3c-b5b3-ac580f4deacb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '828f50086e7c4a43bc852dcf0c416374'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:29.416138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e28f3e20-e048-4a3c-b5b3-ac580f4deacb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '828f50086e7c4a43bc852dcf0c416374'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:29.450044 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e28f3e20-e048-4a3c-b5b3-ac580f4deacb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '828f50086e7c4a43bc852dcf0c416374'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:29.472337 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 850/1695] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:28 2022] DELETE /identity/v3/users/828f50086e7c4a43bc852dcf0c416374 => generated 0 bytes in 531 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:29.482152 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b4f1a-8986-4450-a376-9c3df32476d8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.484128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b4f1a-8986-4450-a376-9c3df32476d8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.484510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4b4f1a-8986-4450-a376-9c3df32476d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.555158 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7a4b4f1a-8986-4450-a376-9c3df32476d8 None None] MFA Rules not processed for user `3c069d8c991d482992951ba0eb7b3395`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:29.558102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7a4b4f1a-8986-4450-a376-9c3df32476d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:29.603688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad7cc8-3b3b-4cf2-bb7c-5dd840097b36 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:29.809305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 851/1696] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:29.809305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b4f1a-8986-4450-a376-9c3df32476d8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:29.814242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7a4b4f1a-8986-4450-a376-9c3df32476d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:29.821275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:29.899308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a6c87f-a20c-4f00-9da7-0fc16f2aad40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:29.899960 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6c87f-a20c-4f00-9da7-0fc16f2aad40 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.900240 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6c87f-a20c-4f00-9da7-0fc16f2aad40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.900514 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a6c87f-a20c-4f00-9da7-0fc16f2aad40 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:29.901181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6c87f-a20c-4f00-9da7-0fc16f2aad40 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:29.905886 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a6c87f-a20c-4f00-9da7-0fc16f2aad40 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:29.981217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 846/1697] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:29 2022] POST /identity/v3/users => generated 290 bytes in 641 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:29.987068 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bd23b-1dda-4823-8614-1d8cede27b9f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:29.987297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bd23b-1dda-4823-8614-1d8cede27b9f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:29.987577 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4bd23b-1dda-4823-8614-1d8cede27b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.078243 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9a4bd23b-1dda-4823-8614-1d8cede27b9f None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:30.079605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9a4bd23b-1dda-4823-8614-1d8cede27b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:30.089822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4b4f1a-8986-4450-a376-9c3df32476d8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:30.104585 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ab685-638f-4d01-a70a-a66055d43c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:30.105348 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab685-638f-4d01-a70a-a66055d43c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.105743 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab685-638f-4d01-a70a-a66055d43c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.106162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754ab685-638f-4d01-a70a-a66055d43c38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.107714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ab685-638f-4d01-a70a-a66055d43c38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:30.112651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754ab685-638f-4d01-a70a-a66055d43c38 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:30.121698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 847/1698] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:30.131069 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bd23b-1dda-4823-8614-1d8cede27b9f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:30.145857 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9a4bd23b-1dda-4823-8614-1d8cede27b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:30.158808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 852/1699] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:29 2022] GET /identity/v3/roles => generated 1420 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:30.159928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ab685-638f-4d01-a70a-a66055d43c38 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:30.166666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-754ab685-638f-4d01-a70a-a66055d43c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:30.191750 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754ab685-638f-4d01-a70a-a66055d43c38 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:30.224653 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d472e2f-2f62-43d8-90b3-962b14b9efb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:30.225468 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d472e2f-2f62-43d8-90b3-962b14b9efb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.225858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d472e2f-2f62-43d8-90b3-962b14b9efb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.226246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d472e2f-2f62-43d8-90b3-962b14b9efb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.227124 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d472e2f-2f62-43d8-90b3-962b14b9efb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:30.228869 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d472e2f-2f62-43d8-90b3-962b14b9efb9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:30.262317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 853/1700] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:30.265746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d472e2f-2f62-43d8-90b3-962b14b9efb9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:30.271992 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9d472e2f-2f62-43d8-90b3-962b14b9efb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:30.349676 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:30.379882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4bd23b-1dda-4823-8614-1d8cede27b9f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:30.399570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806e740-2c7f-404e-93c7-88a403bec143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:30.400496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806e740-2c7f-404e-93c7-88a403bec143 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.400919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806e740-2c7f-404e-93c7-88a403bec143 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.401240 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d472e2f-2f62-43d8-90b3-962b14b9efb9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:30.401521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3806e740-2c7f-404e-93c7-88a403bec143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.408141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3806e740-2c7f-404e-93c7-88a403bec143 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:30.410436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139108e-f475-41f0-86f9-ce9d65230f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:30.410436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139108e-f475-41f0-86f9-ce9d65230f1c service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.412882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139108e-f475-41f0-86f9-ce9d65230f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.413247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139108e-f475-41f0-86f9-ce9d65230f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.431917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806e740-2c7f-404e-93c7-88a403bec143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:30.440901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139108e-f475-41f0-86f9-ce9d65230f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:30.442049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3806e740-2c7f-404e-93c7-88a403bec143 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:30.445275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139108e-f475-41f0-86f9-ce9d65230f1c service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:30.463187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 848/1701] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:30 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:30.467388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806e740-2c7f-404e-93c7-88a403bec143 service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:30.492929 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 854/1702] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:30.494777 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139108e-f475-41f0-86f9-ce9d65230f1c service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:30.501717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3806e740-2c7f-404e-93c7-88a403bec143 service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:30.517803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfbf9e2-998a-4189-b39f-2a9c1f1a59ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:30.522269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbf9e2-998a-4189-b39f-2a9c1f1a59ca admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.522269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbf9e2-998a-4189-b39f-2a9c1f1a59ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.522269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfbf9e2-998a-4189-b39f-2a9c1f1a59ca admin admin] PATH_INFO: `/v3/projects/dfe87a9ef99e4651ae8eab45b46a8c8e/users/38f939802f494d5780d81858ed1379ea/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.528856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbf9e2-998a-4189-b39f-2a9c1f1a59ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfe87a9ef99e4651ae8eab45b46a8c8e, user_id=38f939802f494d5780d81858ed1379ea, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:30.531880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139108e-f475-41f0-86f9-ce9d65230f1c service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:30.538637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfbf9e2-998a-4189-b39f-2a9c1f1a59ca admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:30.554329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520fb7a-b35f-4c98-916a-415286f9fdcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:30.559412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520fb7a-b35f-4c98-916a-415286f9fdcb admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.560553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520fb7a-b35f-4c98-916a-415286f9fdcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.560843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520fb7a-b35f-4c98-916a-415286f9fdcb admin admin] PATH_INFO: `/v3/projects/1bf79071c7e243fc80c74ea52285ce73/users/9d61ad6546494f2085e03213806dda25/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.568280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 849/1703] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:30 2022] PUT /identity/v3/projects/dfe87a9ef99e4651ae8eab45b46a8c8e/users/38f939802f494d5780d81858ed1379ea/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:30.578306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044b1ce-4913-4924-ab46-91bcfe359e05 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.578646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044b1ce-4913-4924-ab46-91bcfe359e05 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.578903 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3044b1ce-4913-4924-ab46-91bcfe359e05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.626323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520fb7a-b35f-4c98-916a-415286f9fdcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf79071c7e243fc80c74ea52285ce73, user_id=9d61ad6546494f2085e03213806dda25, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:30.629881 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520fb7a-b35f-4c98-916a-415286f9fdcb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:30.632487 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-3044b1ce-4913-4924-ab46-91bcfe359e05 None None] MFA Rules not processed for user `38f939802f494d5780d81858ed1379ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:30.633720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3044b1ce-4913-4924-ab46-91bcfe359e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:30.669320 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 855/1704] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:30 2022] PUT /identity/v3/projects/1bf79071c7e243fc80c74ea52285ce73/users/9d61ad6546494f2085e03213806dda25/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:30.670728 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d874b9-fded-440e-b49f-478c7128b9d5 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:30.671019 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d874b9-fded-440e-b49f-478c7128b9d5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:30.682472 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d874b9-fded-440e-b49f-478c7128b9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:30.831657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-88d874b9-fded-440e-b49f-478c7128b9d5 None None] MFA Rules not processed for user `614de29f4fde415a9e858d82ebfffb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:30.833937 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 850/1705] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:30.846244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-88d874b9-fded-440e-b49f-478c7128b9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:30.852093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044b1ce-4913-4924-ab46-91bcfe359e05 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:30.896270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:30.970893 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3044b1ce-4913-4924-ab46-91bcfe359e05 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:31.066094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb5fd9-6f22-4924-9fee-edeb014ac79a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:31.066781 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb5fd9-6f22-4924-9fee-edeb014ac79a admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:31.067134 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb5fd9-6f22-4924-9fee-edeb014ac79a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:31.067420 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcb5fd9-6f22-4924-9fee-edeb014ac79a admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:31.068292 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb5fd9-6f22-4924-9fee-edeb014ac79a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:31.070506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcb5fd9-6f22-4924-9fee-edeb014ac79a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:31.088536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 851/1706] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:30 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:31.089541 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb5fd9-6f22-4924-9fee-edeb014ac79a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:31.092284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dfcb5fd9-6f22-4924-9fee-edeb014ac79a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:31.109027 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 856/1707] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 439 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:31.118101 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d874b9-fded-440e-b49f-478c7128b9d5 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:31.129518 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d874b9-fded-440e-b49f-478c7128b9d5 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:31.139333 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2caea-3210-402b-8b5e-ec147c039f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:31.140153 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2caea-3210-402b-8b5e-ec147c039f29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:31.140880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2caea-3210-402b-8b5e-ec147c039f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:31.140880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c2caea-3210-402b-8b5e-ec147c039f29 admin admin] PATH_INFO: `/v3/projects/1bf79071c7e243fc80c74ea52285ce73/users/9d61ad6546494f2085e03213806dda25/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:31.145222 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2caea-3210-402b-8b5e-ec147c039f29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bf79071c7e243fc80c74ea52285ce73, user_id=9d61ad6546494f2085e03213806dda25, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:31.148219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c2caea-3210-402b-8b5e-ec147c039f29 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:31.168655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 857/1708] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:31 2022] PUT /identity/v3/projects/1bf79071c7e243fc80c74ea52285ce73/users/9d61ad6546494f2085e03213806dda25/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:31.168655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2caea-3210-402b-8b5e-ec147c039f29 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:31.170446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-33c2caea-3210-402b-8b5e-ec147c039f29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:31.219413 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcb5fd9-6f22-4924-9fee-edeb014ac79a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:31.310616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70110d-a2b7-4408-8f7b-258f7a730dd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:31.310836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70110d-a2b7-4408-8f7b-258f7a730dd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:31.312304 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70110d-a2b7-4408-8f7b-258f7a730dd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:31.312304 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca70110d-a2b7-4408-8f7b-258f7a730dd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:31.358054 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c2caea-3210-402b-8b5e-ec147c039f29 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:31.381427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3154b88-18d3-4126-99c9-e00aaff27c28 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:31.381601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154b88-18d3-4126-99c9-e00aaff27c28 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:31.382194 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154b88-18d3-4126-99c9-e00aaff27c28 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:31.382497 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3154b88-18d3-4126-99c9-e00aaff27c28 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:31.430986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:31.478442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:31.531549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3154b88-18d3-4126-99c9-e00aaff27c28 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:31.533250 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3154b88-18d3-4126-99c9-e00aaff27c28 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:31.560861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 858/1709] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:31.562216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c2bc1-258d-41e8-ad23-e447e4c3fed3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:31.562506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c2bc1-258d-41e8-ad23-e447e4c3fed3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:31.562809 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c2bc1-258d-41e8-ad23-e447e4c3fed3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:31.638242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5b3c2bc1-258d-41e8-ad23-e447e4c3fed3 None None] MFA Rules not processed for user `9d61ad6546494f2085e03213806dda25`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:31.639509 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5b3c2bc1-258d-41e8-ad23-e447e4c3fed3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:31.647180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70110d-a2b7-4408-8f7b-258f7a730dd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:31.648620 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca70110d-a2b7-4408-8f7b-258f7a730dd7 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:31.680177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 852/1710] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 589 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:31.764489 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70110d-a2b7-4408-8f7b-258f7a730dd7 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:31.766289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ca70110d-a2b7-4408-8f7b-258f7a730dd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:31.791385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca70110d-a2b7-4408-8f7b-258f7a730dd7 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:31.805958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd5bdf-6b6a-4bd8-856c-3dedbff815b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:31.806898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd5bdf-6b6a-4bd8-856c-3dedbff815b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:31.806898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd5bdf-6b6a-4bd8-856c-3dedbff815b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:31.807201 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd5bdf-6b6a-4bd8-856c-3dedbff815b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:31.819574 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7dbd5bdf-6b6a-4bd8-856c-3dedbff815b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:31.853549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 859/1711] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:31 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:31.857175 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e718e8e-deff-42f6-ba9e-948426149ba8 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:31.857527 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e718e8e-deff-42f6-ba9e-948426149ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:31.857768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e718e8e-deff-42f6-ba9e-948426149ba8 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:31.873213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 860/1712] 10.222.0.70 () {54 vars in 912 bytes} [Mon Aug 1 14:22:31 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:22:31.877651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64ab66-e399-4408-a398-0c213af3668b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:31.878137 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64ab66-e399-4408-a398-0c213af3668b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:31.878558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64ab66-e399-4408-a398-0c213af3668b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:31.951944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8d64ab66-e399-4408-a398-0c213af3668b None None] MFA Rules not processed for user `33fcc673845943fc96bc18f011639716`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:31.953331 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8d64ab66-e399-4408-a398-0c213af3668b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:31.983260 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd5bdf-6b6a-4bd8-856c-3dedbff815b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:31.984753 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbd5bdf-6b6a-4bd8-856c-3dedbff815b3 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:32.014924 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 853/1713] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:31 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:32.052200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd5bdf-6b6a-4bd8-856c-3dedbff815b3 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:32.055764 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 861/1714] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 1 14:22:31 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:32.062646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd5bdf-6b6a-4bd8-856c-3dedbff815b3 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:32.081041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64ab66-e399-4408-a398-0c213af3668b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:32.081332 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f82714-0353-455e-b05a-c51a2ad26b2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:32.081977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f82714-0353-455e-b05a-c51a2ad26b2c service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:32.082255 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f82714-0353-455e-b05a-c51a2ad26b2c service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:32.082530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f82714-0353-455e-b05a-c51a2ad26b2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:32.090435 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64ab66-e399-4408-a398-0c213af3668b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:32.094330 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd062b4f-b2dd-4ebe-8de5-c9613b93f977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:32.095006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd062b4f-b2dd-4ebe-8de5-c9613b93f977 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:32.095348 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd062b4f-b2dd-4ebe-8de5-c9613b93f977 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:32.095638 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd062b4f-b2dd-4ebe-8de5-c9613b93f977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:32.105152 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd062b4f-b2dd-4ebe-8de5-c9613b93f977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:32.106504 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd062b4f-b2dd-4ebe-8de5-c9613b93f977 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:32.117109 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 862/1715] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:32 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:32.128038 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f82714-0353-455e-b05a-c51a2ad26b2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:32.130843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f82714-0353-455e-b05a-c51a2ad26b2c service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:32.145965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 854/1716] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:32 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:32.466273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd062b4f-b2dd-4ebe-8de5-c9613b93f977 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:32.477105 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd062b4f-b2dd-4ebe-8de5-c9613b93f977 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:32.490501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c2307-69dd-4fad-8c39-44351f78d86e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:32.491502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c2307-69dd-4fad-8c39-44351f78d86e service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:32.491502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c2307-69dd-4fad-8c39-44351f78d86e service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:32.491715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-429c2307-69dd-4fad-8c39-44351f78d86e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:32.493590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-429c2307-69dd-4fad-8c39-44351f78d86e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:32.531172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68924500-bd80-4238-9bf7-f2d847e65048 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:32.531913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68924500-bd80-4238-9bf7-f2d847e65048 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:32.532456 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68924500-bd80-4238-9bf7-f2d847e65048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:32.589164 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:32.609642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-68924500-bd80-4238-9bf7-f2d847e65048 None None] MFA Rules not processed for user `666b3c9d23604bf0aefc4f09374f92c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:32.611088 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-68924500-bd80-4238-9bf7-f2d847e65048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:32.649120 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c2307-69dd-4fad-8c39-44351f78d86e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:32.650763 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-429c2307-69dd-4fad-8c39-44351f78d86e service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:32.680344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 863/1717] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:32 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:32.681336 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c2307-69dd-4fad-8c39-44351f78d86e service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:32.685319 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-429c2307-69dd-4fad-8c39-44351f78d86e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:32.858438 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-429c2307-69dd-4fad-8c39-44351f78d86e service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:32.898130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 855/1718] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:32.906148 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce64a4e-e17b-419c-8e17-84869c627dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:32.907924 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4bd9c-c55b-46cc-82ce-1d308d98ab90 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:32.908423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4bd9c-c55b-46cc-82ce-1d308d98ab90 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:32.909475 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a4bd9c-c55b-46cc-82ce-1d308d98ab90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:32.911399 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce64a4e-e17b-419c-8e17-84869c627dba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:32.912970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce64a4e-e17b-419c-8e17-84869c627dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:32.914758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce64a4e-e17b-419c-8e17-84869c627dba admin admin] PATH_INFO: `/v3/projects/070f86aba1574bc48f204f3470e21124` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:32.917711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce64a4e-e17b-419c-8e17-84869c627dba admin admin] RBAC: Authorizing `identity:delete_project(project_id=070f86aba1574bc48f204f3470e21124)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:32.931299 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce64a4e-e17b-419c-8e17-84869c627dba admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:32.993481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-86a4bd9c-c55b-46cc-82ce-1d308d98ab90 None None] MFA Rules not processed for user `666b3c9d23604bf0aefc4f09374f92c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:32.998940 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-86a4bd9c-c55b-46cc-82ce-1d308d98ab90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:33.032385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 856/1719] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:32 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:33.045722 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4bd9c-c55b-46cc-82ce-1d308d98ab90 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:33.087818 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a4bd9c-c55b-46cc-82ce-1d308d98ab90 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:33.132263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ce64a4e-e17b-419c-8e17-84869c627dba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '070f86aba1574bc48f204f3470e21124', 'request_id': 'req-4ce64a4e-e17b-419c-8e17-84869c627dba'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:33.165467 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ce64a4e-e17b-419c-8e17-84869c627dba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '070f86aba1574bc48f204f3470e21124', 'request_id': 'req-4ce64a4e-e17b-419c-8e17-84869c627dba'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:33.191143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ce64a4e-e17b-419c-8e17-84869c627dba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '070f86aba1574bc48f204f3470e21124', 'request_id': 'req-4ce64a4e-e17b-419c-8e17-84869c627dba'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:33.221052 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ce64a4e-e17b-419c-8e17-84869c627dba admin admin] The token cache is being invalidate because project 070f86aba1574bc48f204f3470e21124 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:33.223048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ce64a4e-e17b-419c-8e17-84869c627dba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:33.224236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4ce64a4e-e17b-419c-8e17-84869c627dba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:33.231905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 864/1720] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:32 2022] DELETE /identity/v3/projects/070f86aba1574bc48f204f3470e21124 => generated 0 bytes in 551 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:33.236511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad431b-4e28-4d6c-844f-fb808b079051 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:33.237509 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad431b-4e28-4d6c-844f-fb808b079051 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:33.237967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ad431b-4e28-4d6c-844f-fb808b079051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:33.307148 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-46ad431b-4e28-4d6c-844f-fb808b079051 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:33.308664 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-46ad431b-4e28-4d6c-844f-fb808b079051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:33.335327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:33.478223 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa993b79-9201-4718-b7c8-4c42e29777bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:33.479153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa993b79-9201-4718-b7c8-4c42e29777bf service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:33.479874 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa993b79-9201-4718-b7c8-4c42e29777bf service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:33.480275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa993b79-9201-4718-b7c8-4c42e29777bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:33.499719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-aa993b79-9201-4718-b7c8-4c42e29777bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:33.534787 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:33.581145 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 865/1721] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:33.582489 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2691a-74b2-4ef2-b5d7-cd5130578963 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:33.582800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2691a-74b2-4ef2-b5d7-cd5130578963 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:33.583193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b2691a-74b2-4ef2-b5d7-cd5130578963 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:33.677930 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa993b79-9201-4718-b7c8-4c42e29777bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:33.679803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa993b79-9201-4718-b7c8-4c42e29777bf service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:33.691835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-76b2691a-74b2-4ef2-b5d7-cd5130578963 None None] MFA Rules not processed for user `246f0156a53e4931bc24158b06e85654`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:33.693360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-76b2691a-74b2-4ef2-b5d7-cd5130578963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:33.711218 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 857/1722] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:33 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 666 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:33.712535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b34ea8-1618-40a6-93ef-e069117bf81f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:33.712822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b34ea8-1618-40a6-93ef-e069117bf81f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:33.713092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b34ea8-1618-40a6-93ef-e069117bf81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:33.781260 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-55b34ea8-1618-40a6-93ef-e069117bf81f None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:33.789082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-55b34ea8-1618-40a6-93ef-e069117bf81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:33.823138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 858/1723] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:33.824427 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d36da7-b868-4de3-8396-2c964531393c None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:33.824742 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d36da7-b868-4de3-8396-2c964531393c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:33.827313 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d36da7-b868-4de3-8396-2c964531393c None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:33.835360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 859/1724] 10.222.0.70 () {54 vars in 961 bytes} [Mon Aug 1 14:22:33 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:22:33.841986 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d36da7-b868-4de3-8396-2c964531393c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:33.892816 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d36da7-b868-4de3-8396-2c964531393c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:33.909482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e81b4-b373-499d-9521-b7960f3f0a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:33.911327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e81b4-b373-499d-9521-b7960f3f0a25 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:33.911912 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e81b4-b373-499d-9521-b7960f3f0a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:33.913155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e81b4-b373-499d-9521-b7960f3f0a25 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:33.914799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e81b4-b373-499d-9521-b7960f3f0a25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:33.915349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e81b4-b373-499d-9521-b7960f3f0a25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:33.919748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e81b4-b373-499d-9521-b7960f3f0a25 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:33.944115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 866/1725] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:33.947553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f3898-d66f-4ff5-84c0-cc53c37bc096 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:33.947772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f3898-d66f-4ff5-84c0-cc53c37bc096 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:33.948232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48f3898-d66f-4ff5-84c0-cc53c37bc096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:33.964195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 860/1726] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:33.965092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e81b4-b373-499d-9521-b7960f3f0a25 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:33.974486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b69e81b4-b373-499d-9521-b7960f3f0a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:34.019180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e81b4-b373-499d-9521-b7960f3f0a25 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:34.023606 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c48f3898-d66f-4ff5-84c0-cc53c37bc096 None None] MFA Rules not processed for user `e210ee6c390849e7a630a677ec52e966`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:34.026275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c48f3898-d66f-4ff5-84c0-cc53c37bc096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:34.034717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cca1c3-f2d1-46d8-add7-376e7f9cd24e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:34.035410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cca1c3-f2d1-46d8-add7-376e7f9cd24e service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.035699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cca1c3-f2d1-46d8-add7-376e7f9cd24e service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.035978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42cca1c3-f2d1-46d8-add7-376e7f9cd24e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.058415 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cca1c3-f2d1-46d8-add7-376e7f9cd24e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:34.067198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42cca1c3-f2d1-46d8-add7-376e7f9cd24e service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:34.088796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 861/1727] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:33 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:34.088796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cca1c3-f2d1-46d8-add7-376e7f9cd24e service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:34.115297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42cca1c3-f2d1-46d8-add7-376e7f9cd24e service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:34.127415 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050710e-28ff-41ca-adfd-0fdf2319860e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:34.128078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050710e-28ff-41ca-adfd-0fdf2319860e admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.128359 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050710e-28ff-41ca-adfd-0fdf2319860e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.128643 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a050710e-28ff-41ca-adfd-0fdf2319860e admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.129614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050710e-28ff-41ca-adfd-0fdf2319860e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:34.139596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a050710e-28ff-41ca-adfd-0fdf2319860e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:34.194750 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 867/1728] 10.222.0.70 () {58 vars in 1058 bytes} [Mon Aug 1 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:34.200338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 862/1729] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:34 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:34.204656 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f3898-d66f-4ff5-84c0-cc53c37bc096 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:34.207787 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050710e-28ff-41ca-adfd-0fdf2319860e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:34.234006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48f3898-d66f-4ff5-84c0-cc53c37bc096 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:34.383633 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a050710e-28ff-41ca-adfd-0fdf2319860e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:34.402194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf78bc-d744-49fa-a166-17fbde01f418 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210ee6c390849e7a630a677ec52e966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:34.403295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf78bc-d744-49fa-a166-17fbde01f418 service placement] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.403598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf78bc-d744-49fa-a166-17fbde01f418 service placement] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.403867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cf78bc-d744-49fa-a166-17fbde01f418 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.407958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-63cf78bc-d744-49fa-a166-17fbde01f418 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:34.419324 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9b397-1e43-452a-ba66-0c7326c7c2c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:34.419963 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9b397-1e43-452a-ba66-0c7326c7c2c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.420409 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9b397-1e43-452a-ba66-0c7326c7c2c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.420893 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb9b397-1e43-452a-ba66-0c7326c7c2c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.421946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9b397-1e43-452a-ba66-0c7326c7c2c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:34.424329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb9b397-1e43-452a-ba66-0c7326c7c2c5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:34.463007 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf78bc-d744-49fa-a166-17fbde01f418 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:34.469599 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63cf78bc-d744-49fa-a166-17fbde01f418 service placement] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:34.476114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 868/1730] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:34 2022] POST /identity/v3/users => generated 287 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:34.480078 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9b397-1e43-452a-ba66-0c7326c7c2c5 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:34.492829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 863/1731] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 286 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:34.501783 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb9b397-1e43-452a-ba66-0c7326c7c2c5 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:34.508243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee9925-fe82-4862-a0a9-fdd4748d1b59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:34.509479 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee9925-fe82-4862-a0a9-fdd4748d1b59 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.509906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee9925-fe82-4862-a0a9-fdd4748d1b59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.510331 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ee9925-fe82-4862-a0a9-fdd4748d1b59 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.511366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee9925-fe82-4862-a0a9-fdd4748d1b59 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:34.516230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ee9925-fe82-4862-a0a9-fdd4748d1b59 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:34.534101 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 869/1732] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:34.539378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf78bc-d744-49fa-a166-17fbde01f418 service placement] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:34.588289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cf78bc-d744-49fa-a166-17fbde01f418 service placement] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:34.596598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c491d7ab-de62-4d9f-90f4-63dfbc19e148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:34.597712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491d7ab-de62-4d9f-90f4-63dfbc19e148 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.598265 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491d7ab-de62-4d9f-90f4-63dfbc19e148 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.598698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c491d7ab-de62-4d9f-90f4-63dfbc19e148 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.599566 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491d7ab-de62-4d9f-90f4-63dfbc19e148 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:34.602194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c491d7ab-de62-4d9f-90f4-63dfbc19e148 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:34.612697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:34.629319 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee9925-fe82-4862-a0a9-fdd4748d1b59 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:34.634682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 864/1733] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:34.647873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ee9925-fe82-4862-a0a9-fdd4748d1b59 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:34.649407 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:34.656212 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9189b-eaa6-4dc2-90fe-4e88dd6a6c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:34.657141 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9189b-eaa6-4dc2-90fe-4e88dd6a6c91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.657867 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9189b-eaa6-4dc2-90fe-4e88dd6a6c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.658295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9189b-eaa6-4dc2-90fe-4e88dd6a6c91 admin admin] PATH_INFO: `/v3/projects/88a28919b0574c08836c523c3a31ebd5/users/db07e9cd159542558cc78f0497c6bba7/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.713258 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9189b-eaa6-4dc2-90fe-4e88dd6a6c91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88a28919b0574c08836c523c3a31ebd5, user_id=db07e9cd159542558cc78f0497c6bba7, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:34.716231 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9189b-eaa6-4dc2-90fe-4e88dd6a6c91 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:34.751650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 870/1734] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:34 2022] PUT /identity/v3/projects/88a28919b0574c08836c523c3a31ebd5/users/db07e9cd159542558cc78f0497c6bba7/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:34.762660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a745f5-215c-4c85-a8a0-18c1c5c9e1f6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.763210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a745f5-215c-4c85-a8a0-18c1c5c9e1f6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.763538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a745f5-215c-4c85-a8a0-18c1c5c9e1f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.779230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b47517-5140-4d46-afb6-b1bef2b4b800 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.779519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b47517-5140-4d46-afb6-b1bef2b4b800 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.779797 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b47517-5140-4d46-afb6-b1bef2b4b800 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.782624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 871/1735] 10.222.0.70 () {54 vars in 912 bytes} [Mon Aug 1 14:22:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:22:34.790395 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc7d9a-d994-452e-94e3-da9d3e8f7bfc None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:34.790869 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc7d9a-d994-452e-94e3-da9d3e8f7bfc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:34.791444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdc7d9a-d994-452e-94e3-da9d3e8f7bfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:34.856431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d8a745f5-215c-4c85-a8a0-18c1c5c9e1f6 None None] MFA Rules not processed for user `db07e9cd159542558cc78f0497c6bba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:34.857681 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d8a745f5-215c-4c85-a8a0-18c1c5c9e1f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:34.867958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-dbdc7d9a-d994-452e-94e3-da9d3e8f7bfc None None] MFA Rules not processed for user `33fcc673845943fc96bc18f011639716`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:34.869203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dbdc7d9a-d994-452e-94e3-da9d3e8f7bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:35.088129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 872/1736] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 1 14:22:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:35.100884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc7d9a-d994-452e-94e3-da9d3e8f7bfc None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:35.103023 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dbdc7d9a-d994-452e-94e3-da9d3e8f7bfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:35.126806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdc7d9a-d994-452e-94e3-da9d3e8f7bfc None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:35.127390 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 865/1737] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:35.132978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caac180-7771-4e7e-8350-8d78ba950f1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:35.133820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac180-7771-4e7e-8350-8d78ba950f1c service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:35.134248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac180-7771-4e7e-8350-8d78ba950f1c service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:35.134709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caac180-7771-4e7e-8350-8d78ba950f1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:35.143986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caac180-7771-4e7e-8350-8d78ba950f1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:35.145881 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caac180-7771-4e7e-8350-8d78ba950f1c service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:35.157250 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 873/1738] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:35 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:35.476385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a745f5-215c-4c85-a8a0-18c1c5c9e1f6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:35.706241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a745f5-215c-4c85-a8a0-18c1c5c9e1f6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:35.732514 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce48b34-cc55-4741-b401-979c7357e4e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:35.733187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce48b34-cc55-4741-b401-979c7357e4e9 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:35.733465 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce48b34-cc55-4741-b401-979c7357e4e9 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:35.734185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce48b34-cc55-4741-b401-979c7357e4e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:35.752838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce48b34-cc55-4741-b401-979c7357e4e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:35.755387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce48b34-cc55-4741-b401-979c7357e4e9 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:35.777357 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 866/1739] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:35 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:36.348243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caac180-7771-4e7e-8350-8d78ba950f1c service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:36.711105 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caac180-7771-4e7e-8350-8d78ba950f1c service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:36.736850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b38ab-a646-4566-a195-60fbcb79dbe4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:36.743883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b38ab-a646-4566-a195-60fbcb79dbe4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:36.744209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b38ab-a646-4566-a195-60fbcb79dbe4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:36.744500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b38ab-a646-4566-a195-60fbcb79dbe4 admin admin] PATH_INFO: `/v3/users/db07e9cd159542558cc78f0497c6bba7` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:36.754550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b38ab-a646-4566-a195-60fbcb79dbe4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=db07e9cd159542558cc78f0497c6bba7)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:36.780246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b38ab-a646-4566-a195-60fbcb79dbe4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:36.800065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927a859-d01e-4c6e-b8eb-4fab41d60039 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:36.801352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927a859-d01e-4c6e-b8eb-4fab41d60039 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:36.801832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2927a859-d01e-4c6e-b8eb-4fab41d60039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:36.877768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2927a859-d01e-4c6e-b8eb-4fab41d60039 None None] MFA Rules not processed for user `666b3c9d23604bf0aefc4f09374f92c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:36.879027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2927a859-d01e-4c6e-b8eb-4fab41d60039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:37.043806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fe9b38ab-a646-4566-a195-60fbcb79dbe4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db07e9cd159542558cc78f0497c6bba7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:37.109063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fe9b38ab-a646-4566-a195-60fbcb79dbe4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db07e9cd159542558cc78f0497c6bba7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:37.137869 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 867/1740] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:37.164807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fe9b38ab-a646-4566-a195-60fbcb79dbe4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db07e9cd159542558cc78f0497c6bba7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:37.169170 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fe9b38ab-a646-4566-a195-60fbcb79dbe4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db07e9cd159542558cc78f0497c6bba7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:37.193771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:37.213868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fe9b38ab-a646-4566-a195-60fbcb79dbe4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db07e9cd159542558cc78f0497c6bba7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:37.228446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 874/1741] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:36 2022] DELETE /identity/v3/users/db07e9cd159542558cc78f0497c6bba7 => generated 0 bytes in 881 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:37.232998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4835d1e-6810-49b4-b368-7c7229ee4204 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:37.233547 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4835d1e-6810-49b4-b368-7c7229ee4204 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:37.234063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4835d1e-6810-49b4-b368-7c7229ee4204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:37.348967 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c4835d1e-6810-49b4-b368-7c7229ee4204 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:37.350431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c4835d1e-6810-49b4-b368-7c7229ee4204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:37.393211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b38ab-a646-4566-a195-60fbcb79dbe4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:37.397931 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fe9b38ab-a646-4566-a195-60fbcb79dbe4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:37.422773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:37.670309 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 868/1742] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:37.677791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b38ab-a646-4566-a195-60fbcb79dbe4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:37.696884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc6032-1740-4791-a6f2-3aca92050c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:37.707800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc6032-1740-4791-a6f2-3aca92050c2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:37.710394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc6032-1740-4791-a6f2-3aca92050c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:37.711244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc6032-1740-4791-a6f2-3aca92050c2f admin admin] PATH_INFO: `/v3/users/330baecf130a415bb5f4d6254e53c342` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:37.712876 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc6032-1740-4791-a6f2-3aca92050c2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=330baecf130a415bb5f4d6254e53c342)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:37.715763 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc6032-1740-4791-a6f2-3aca92050c2f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:37.718267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4835d1e-6810-49b4-b368-7c7229ee4204 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:37.721551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c4835d1e-6810-49b4-b368-7c7229ee4204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:37.934791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7ebc6032-1740-4791-a6f2-3aca92050c2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '330baecf130a415bb5f4d6254e53c342'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:37.987317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4835d1e-6810-49b4-b368-7c7229ee4204 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:37.988542 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7ebc6032-1740-4791-a6f2-3aca92050c2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '330baecf130a415bb5f4d6254e53c342'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:38.018441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7ebc6032-1740-4791-a6f2-3aca92050c2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '330baecf130a415bb5f4d6254e53c342'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:38.019351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a7b6b-2445-4ca3-bacc-c5e5a879d7e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:38.019944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7ebc6032-1740-4791-a6f2-3aca92050c2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '330baecf130a415bb5f4d6254e53c342'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:38.020746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a7b6b-2445-4ca3-bacc-c5e5a879d7e4 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:38.024072 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a7b6b-2445-4ca3-bacc-c5e5a879d7e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:38.026519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89a7b6b-2445-4ca3-bacc-c5e5a879d7e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:38.034178 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b89a7b6b-2445-4ca3-bacc-c5e5a879d7e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:38.043153 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7ebc6032-1740-4791-a6f2-3aca92050c2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '330baecf130a415bb5f4d6254e53c342'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:38.068665 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 875/1743] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:37 2022] DELETE /identity/v3/users/330baecf130a415bb5f4d6254e53c342 => generated 0 bytes in 678 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:38.074134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d7028-ccab-4178-99fa-8eaffccb1cce None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:38.074557 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d7028-ccab-4178-99fa-8eaffccb1cce None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:38.075011 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855d7028-ccab-4178-99fa-8eaffccb1cce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:38.109187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a7b6b-2445-4ca3-bacc-c5e5a879d7e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:38.110700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89a7b6b-2445-4ca3-bacc-c5e5a879d7e4 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:38.133410 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-855d7028-ccab-4178-99fa-8eaffccb1cce None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:38.138224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-855d7028-ccab-4178-99fa-8eaffccb1cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:38.153817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 869/1744] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:38.381444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 876/1745] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:38.404183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a7b6b-2445-4ca3-bacc-c5e5a879d7e4 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:38.405906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b89a7b6b-2445-4ca3-bacc-c5e5a879d7e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:38.427490 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d7028-ccab-4178-99fa-8eaffccb1cce None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:38.430193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-855d7028-ccab-4178-99fa-8eaffccb1cce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:38.438287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89a7b6b-2445-4ca3-bacc-c5e5a879d7e4 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:38.464981 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ca863-f5e6-472f-ab80-2829985fd362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:38.465813 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ca863-f5e6-472f-ab80-2829985fd362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:38.466202 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ca863-f5e6-472f-ab80-2829985fd362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:38.466563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ca863-f5e6-472f-ab80-2829985fd362 admin admin] PATH_INFO: `/v3/users/1ed0b61ac1ec447d9d65caf6c50619de` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:38.470378 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:38.472509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ca863-f5e6-472f-ab80-2829985fd362 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ed0b61ac1ec447d9d65caf6c50619de)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:38.482312 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ca863-f5e6-472f-ab80-2829985fd362 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:38.629178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855d7028-ccab-4178-99fa-8eaffccb1cce None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:38.635669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-165ca863-f5e6-472f-ab80-2829985fd362 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ed0b61ac1ec447d9d65caf6c50619de'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:38.641164 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7d5a1-e36b-44ce-a084-c9f5f52b9464 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:38.642214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d5a1-e36b-44ce-a084-c9f5f52b9464 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:38.643720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d5a1-e36b-44ce-a084-c9f5f52b9464 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:38.655683 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7d5a1-e36b-44ce-a084-c9f5f52b9464 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:38.657717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-165ca863-f5e6-472f-ab80-2829985fd362 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ed0b61ac1ec447d9d65caf6c50619de'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:38.681264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-165ca863-f5e6-472f-ab80-2829985fd362 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ed0b61ac1ec447d9d65caf6c50619de'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:38.682115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-165ca863-f5e6-472f-ab80-2829985fd362 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ed0b61ac1ec447d9d65caf6c50619de'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:38.683339 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7d5a1-e36b-44ce-a084-c9f5f52b9464 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:38.687407 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7d5a1-e36b-44ce-a084-c9f5f52b9464 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:38.700862 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-165ca863-f5e6-472f-ab80-2829985fd362 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ed0b61ac1ec447d9d65caf6c50619de'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:38.713962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 870/1746] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:38 2022] DELETE /identity/v3/users/1ed0b61ac1ec447d9d65caf6c50619de => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:38.717742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 877/1747] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:38.723976 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb0a3-caeb-4f7d-a974-53418dd58673 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:38.726644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb0a3-caeb-4f7d-a974-53418dd58673 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:38.727369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7cb0a3-caeb-4f7d-a974-53418dd58673 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:38.750055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ea3b-8d8a-456b-8acb-760259f24609 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:38.750488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ea3b-8d8a-456b-8acb-760259f24609 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:38.750901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23ea3b-8d8a-456b-8acb-760259f24609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:38.781204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-6a7cb0a3-caeb-4f7d-a974-53418dd58673 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:38.785983 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6a7cb0a3-caeb-4f7d-a974-53418dd58673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:38.794739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2d23ea3b-8d8a-456b-8acb-760259f24609 None None] MFA Rules not processed for user `614de29f4fde415a9e858d82ebfffb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:38.796608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2d23ea3b-8d8a-456b-8acb-760259f24609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:38.869122 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:38.915977 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 878/1748] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:38.924512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f181fc-faf3-4471-9bec-042186588a7d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:38.927719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f181fc-faf3-4471-9bec-042186588a7d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:38.928164 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f181fc-faf3-4471-9bec-042186588a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:38.958759 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 871/1749] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:39.007929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cb0a3-caeb-4f7d-a974-53418dd58673 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:39.012008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6a7cb0a3-caeb-4f7d-a974-53418dd58673 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:39.097701 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e5f181fc-faf3-4471-9bec-042186588a7d None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:39.100693 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e5f181fc-faf3-4471-9bec-042186588a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:39.205428 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7cb0a3-caeb-4f7d-a974-53418dd58673 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:39.224034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601c153-c804-4f48-8a24-f7022d74ea13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:39.228462 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601c153-c804-4f48-8a24-f7022d74ea13 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:39.230630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601c153-c804-4f48-8a24-f7022d74ea13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:39.231621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7601c153-c804-4f48-8a24-f7022d74ea13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:39.238331 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 879/1750] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 1 14:22:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:39.271520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601c153-c804-4f48-8a24-f7022d74ea13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:39.276723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7601c153-c804-4f48-8a24-f7022d74ea13 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:39.310029 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 872/1751] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:39.547648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f181fc-faf3-4471-9bec-042186588a7d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:39.552644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e5f181fc-faf3-4471-9bec-042186588a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:39.657701 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:39.812261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f181fc-faf3-4471-9bec-042186588a7d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:39.824009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c89dc-453f-496f-bcac-f320acc78cdd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:39.825049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c89dc-453f-496f-bcac-f320acc78cdd service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:39.836328 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c89dc-453f-496f-bcac-f320acc78cdd service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:39.837036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854c89dc-453f-496f-bcac-f320acc78cdd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:39.851467 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c89dc-453f-496f-bcac-f320acc78cdd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:39.854947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854c89dc-453f-496f-bcac-f320acc78cdd service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:39.872678 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 880/1752] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:22:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:22:40.166595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601c153-c804-4f48-8a24-f7022d74ea13 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:40.169036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7601c153-c804-4f48-8a24-f7022d74ea13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:40.264162 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7601c153-c804-4f48-8a24-f7022d74ea13 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:40.340956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:40.341733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:40.342019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:40.347359 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0 admin admin] PATH_INFO: `/v3/projects/5589c824a1fd454b90360b2f578197ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:40.356172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c89dc-453f-496f-bcac-f320acc78cdd service swift] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:40.357748 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-854c89dc-453f-496f-bcac-f320acc78cdd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:40.368554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5589c824a1fd454b90360b2f578197ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:40.385117 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:40.415904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854c89dc-453f-496f-bcac-f320acc78cdd service swift] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:40.450677 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a096b7-1fa7-46de-974e-f44243e23315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:40.458599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a096b7-1fa7-46de-974e-f44243e23315 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:40.461917 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a096b7-1fa7-46de-974e-f44243e23315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:40.466275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a096b7-1fa7-46de-974e-f44243e23315 admin admin] PATH_INFO: `/v3/projects/88a28919b0574c08836c523c3a31ebd5` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:40.472701 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a096b7-1fa7-46de-974e-f44243e23315 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88a28919b0574c08836c523c3a31ebd5)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:40.477349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a096b7-1fa7-46de-974e-f44243e23315 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:40.652415 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5589c824a1fd454b90360b2f578197ec', 'request_id': 'req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:40.670278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-75a096b7-1fa7-46de-974e-f44243e23315 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88a28919b0574c08836c523c3a31ebd5', 'request_id': 'req-75a096b7-1fa7-46de-974e-f44243e23315'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:40.681257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5589c824a1fd454b90360b2f578197ec', 'request_id': 'req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:40.697136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-75a096b7-1fa7-46de-974e-f44243e23315 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88a28919b0574c08836c523c3a31ebd5', 'request_id': 'req-75a096b7-1fa7-46de-974e-f44243e23315'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:40.707053 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5589c824a1fd454b90360b2f578197ec', 'request_id': 'req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:40.728620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-75a096b7-1fa7-46de-974e-f44243e23315 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88a28919b0574c08836c523c3a31ebd5', 'request_id': 'req-75a096b7-1fa7-46de-974e-f44243e23315'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:40.757543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-75a096b7-1fa7-46de-974e-f44243e23315 admin admin] The token cache is being invalidate because project 88a28919b0574c08836c523c3a31ebd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:40.765683 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0 admin admin] The token cache is being invalidate because project 5589c824a1fd454b90360b2f578197ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:40.765980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:40.770704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:40.771959 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 873/1753] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:40 2022] DELETE /identity/v3/projects/5589c824a1fd454b90360b2f578197ec => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:40.775955 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-75a096b7-1fa7-46de-974e-f44243e23315 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:40.781117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-75a096b7-1fa7-46de-974e-f44243e23315 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:40.784738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 881/1754] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:40 2022] DELETE /identity/v3/projects/88a28919b0574c08836c523c3a31ebd5 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:40.792495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82d7e8-3033-4024-9b0a-38f953175b91 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:40.796119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:40.796534 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82d7e8-3033-4024-9b0a-38f953175b91 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:40.799487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc82d7e8-3033-4024-9b0a-38f953175b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:40.807392 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:40.912340 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-dc82d7e8-3033-4024-9b0a-38f953175b91 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:40.920732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dc82d7e8-3033-4024-9b0a-38f953175b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:41.140035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770761a-e6dd-4a49-8bda-5a8d467ec5b0 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:41.152868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 882/1755] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 364 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:41.154018 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82d7e8-3033-4024-9b0a-38f953175b91 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:41.161650 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3713718a-237b-4338-8669-3d0c8ef70adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:41.162107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dc82d7e8-3033-4024-9b0a-38f953175b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:41.162718 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713718a-237b-4338-8669-3d0c8ef70adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:41.163305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713718a-237b-4338-8669-3d0c8ef70adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:41.163706 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3713718a-237b-4338-8669-3d0c8ef70adc admin admin] PATH_INFO: `/v3/users/1c4eb20d8d2d4ba0bb990cede674d993` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:41.166217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713718a-237b-4338-8669-3d0c8ef70adc admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c4eb20d8d2d4ba0bb990cede674d993)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:41.168377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3713718a-237b-4338-8669-3d0c8ef70adc admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:41.192162 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:41.207085 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc82d7e8-3033-4024-9b0a-38f953175b91 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:41.230344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52821243-6fed-494a-af81-f156d2e1d5c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:41.234841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52821243-6fed-494a-af81-f156d2e1d5c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:41.235645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52821243-6fed-494a-af81-f156d2e1d5c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:41.235645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52821243-6fed-494a-af81-f156d2e1d5c8 admin admin] PATH_INFO: `/v3/users/e9e5c1aba670427392a3ab099c9c39a7` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:41.241698 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52821243-6fed-494a-af81-f156d2e1d5c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e5c1aba670427392a3ab099c9c39a7)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:41.249100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52821243-6fed-494a-af81-f156d2e1d5c8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:41.327445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3713718a-237b-4338-8669-3d0c8ef70adc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c4eb20d8d2d4ba0bb990cede674d993'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:41.340431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3713718a-237b-4338-8669-3d0c8ef70adc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c4eb20d8d2d4ba0bb990cede674d993'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:41.341137 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:41.398874 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3713718a-237b-4338-8669-3d0c8ef70adc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c4eb20d8d2d4ba0bb990cede674d993'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:41.401070 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3713718a-237b-4338-8669-3d0c8ef70adc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c4eb20d8d2d4ba0bb990cede674d993'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:41.421038 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3713718a-237b-4338-8669-3d0c8ef70adc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c4eb20d8d2d4ba0bb990cede674d993'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:41.437963 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 874/1756] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:40 2022] DELETE /identity/v3/users/1c4eb20d8d2d4ba0bb990cede674d993 => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:41.439580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ddcfc-8afc-4122-ac0d-fd49510366bf None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:41.440141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ddcfc-8afc-4122-ac0d-fd49510366bf None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:41.441225 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882ddcfc-8afc-4122-ac0d-fd49510366bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:41.488086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-52821243-6fed-494a-af81-f156d2e1d5c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e5c1aba670427392a3ab099c9c39a7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:41.500370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-882ddcfc-8afc-4122-ac0d-fd49510366bf None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:41.502611 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-882ddcfc-8afc-4122-ac0d-fd49510366bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:41.560942 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-52821243-6fed-494a-af81-f156d2e1d5c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e5c1aba670427392a3ab099c9c39a7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:41.592622 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-52821243-6fed-494a-af81-f156d2e1d5c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e5c1aba670427392a3ab099c9c39a7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:41.597855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-52821243-6fed-494a-af81-f156d2e1d5c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e5c1aba670427392a3ab099c9c39a7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:41.643899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-52821243-6fed-494a-af81-f156d2e1d5c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e5c1aba670427392a3ab099c9c39a7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:41.699507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 883/1757] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:41 2022] DELETE /identity/v3/users/e9e5c1aba670427392a3ab099c9c39a7 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:41.703817 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69d9eb-0f0c-4a4d-b232-ff429a1f08bb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:41.704111 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69d9eb-0f0c-4a4d-b232-ff429a1f08bb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:41.706249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69d9eb-0f0c-4a4d-b232-ff429a1f08bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:41.709744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 875/1758] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:41.714314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ddcfc-8afc-4122-ac0d-fd49510366bf None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:41.764290 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882ddcfc-8afc-4122-ac0d-fd49510366bf None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:41.787339 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3a69d9eb-0f0c-4a4d-b232-ff429a1f08bb None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:41.789554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3a69d9eb-0f0c-4a4d-b232-ff429a1f08bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:42.079261 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cff98c-8c40-46b0-9e73-abf7469c8886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:42.091908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 884/1759] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:42.103214 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cff98c-8c40-46b0-9e73-abf7469c8886 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:42.103506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cff98c-8c40-46b0-9e73-abf7469c8886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:42.103787 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cff98c-8c40-46b0-9e73-abf7469c8886 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:42.114560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cff98c-8c40-46b0-9e73-abf7469c8886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:42.115210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cff98c-8c40-46b0-9e73-abf7469c8886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:42.123978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cff98c-8c40-46b0-9e73-abf7469c8886 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:42.157321 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69d9eb-0f0c-4a4d-b232-ff429a1f08bb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:42.181396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 876/1760] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:22:42.190144 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69d9eb-0f0c-4a4d-b232-ff429a1f08bb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:42.218457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a8096-fb97-47e7-ab07-ad5db333e5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:42.222961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a8096-fb97-47e7-ab07-ad5db333e5e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:42.224366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a8096-fb97-47e7-ab07-ad5db333e5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:42.224932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a8096-fb97-47e7-ab07-ad5db333e5e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:42.227141 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a8096-fb97-47e7-ab07-ad5db333e5e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:42.243004 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a8096-fb97-47e7-ab07-ad5db333e5e4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:42.428057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cff98c-8c40-46b0-9e73-abf7469c8886 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:42.452402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 885/1761] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:42 2022] POST /identity/v3/projects => generated 363 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:42.456780 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a8096-fb97-47e7-ab07-ad5db333e5e4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:42.476711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f40a8096-fb97-47e7-ab07-ad5db333e5e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:42.478043 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cff98c-8c40-46b0-9e73-abf7469c8886 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:42.528229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:42.718032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017c177-7c4c-4796-a906-7aeb84febdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:42.721657 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017c177-7c4c-4796-a906-7aeb84febdfb admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:42.721953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017c177-7c4c-4796-a906-7aeb84febdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:42.722232 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3017c177-7c4c-4796-a906-7aeb84febdfb admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:42.723152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017c177-7c4c-4796-a906-7aeb84febdfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:42.727419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3017c177-7c4c-4796-a906-7aeb84febdfb admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:42.731716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a8096-fb97-47e7-ab07-ad5db333e5e4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:42.738487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760ccad-0b8e-43a6-8f2c-3a5c7073af02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:42.739376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760ccad-0b8e-43a6-8f2c-3a5c7073af02 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:42.742004 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760ccad-0b8e-43a6-8f2c-3a5c7073af02 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:42.742312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4760ccad-0b8e-43a6-8f2c-3a5c7073af02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:42.796042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760ccad-0b8e-43a6-8f2c-3a5c7073af02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:42.804691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4760ccad-0b8e-43a6-8f2c-3a5c7073af02 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:42.827874 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 877/1762] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:42 2022] POST /identity/v3/users => generated 282 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:42.831123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017c177-7c4c-4796-a906-7aeb84febdfb admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:42.840094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3017c177-7c4c-4796-a906-7aeb84febdfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:42.854360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 886/1763] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:42.854360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760ccad-0b8e-43a6-8f2c-3a5c7073af02 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:42.915774 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3017c177-7c4c-4796-a906-7aeb84febdfb admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:42.924071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0782d9-4e07-41e9-b3e2-6b7def4b636e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:42.924736 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0782d9-4e07-41e9-b3e2-6b7def4b636e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:42.925016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0782d9-4e07-41e9-b3e2-6b7def4b636e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:42.925290 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0782d9-4e07-41e9-b3e2-6b7def4b636e admin admin] PATH_INFO: `/v3/projects/5f1bb58c6a88424e9fb1e5f5bb7c48c9` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:42.926474 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0782d9-4e07-41e9-b3e2-6b7def4b636e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f1bb58c6a88424e9fb1e5f5bb7c48c9)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:42.927401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4760ccad-0b8e-43a6-8f2c-3a5c7073af02 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:42.928616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0782d9-4e07-41e9-b3e2-6b7def4b636e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:42.973067 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d51bfc-2e7c-4eae-9846-96d88efbb21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:42.979810 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d51bfc-2e7c-4eae-9846-96d88efbb21b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:42.981334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d51bfc-2e7c-4eae-9846-96d88efbb21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:42.981807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d51bfc-2e7c-4eae-9846-96d88efbb21b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:42.983244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d51bfc-2e7c-4eae-9846-96d88efbb21b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:42.999210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d51bfc-2e7c-4eae-9846-96d88efbb21b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:43.118510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 887/1764] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:43.119468 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d51bfc-2e7c-4eae-9846-96d88efbb21b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:43.127944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6a0782d9-4e07-41e9-b3e2-6b7def4b636e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f1bb58c6a88424e9fb1e5f5bb7c48c9', 'request_id': 'req-6a0782d9-4e07-41e9-b3e2-6b7def4b636e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:43.169735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6a0782d9-4e07-41e9-b3e2-6b7def4b636e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f1bb58c6a88424e9fb1e5f5bb7c48c9', 'request_id': 'req-6a0782d9-4e07-41e9-b3e2-6b7def4b636e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:43.174742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d51bfc-2e7c-4eae-9846-96d88efbb21b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:43.184298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=6,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:43.202149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6a0782d9-4e07-41e9-b3e2-6b7def4b636e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f1bb58c6a88424e9fb1e5f5bb7c48c9', 'request_id': 'req-6a0782d9-4e07-41e9-b3e2-6b7def4b636e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:43.274595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6a0782d9-4e07-41e9-b3e2-6b7def4b636e admin admin] The token cache is being invalidate because project 5f1bb58c6a88424e9fb1e5f5bb7c48c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:43.274927 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6a0782d9-4e07-41e9-b3e2-6b7def4b636e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:43.283703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6a0782d9-4e07-41e9-b3e2-6b7def4b636e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:43.296270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 878/1765] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:42 2022] DELETE /identity/v3/projects/5f1bb58c6a88424e9fb1e5f5bb7c48c9 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:43.297862 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2f521-30d9-472d-8fe9-45b6d8804a22 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:43.298205 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2f521-30d9-472d-8fe9-45b6d8804a22 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:43.312083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e2f521-30d9-472d-8fe9-45b6d8804a22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:43.322775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6629ab-b086-4fe4-b4b0-d2202b61316d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:43.323787 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6629ab-b086-4fe4-b4b0-d2202b61316d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:43.324071 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6629ab-b086-4fe4-b4b0-d2202b61316d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:43.324346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6629ab-b086-4fe4-b4b0-d2202b61316d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:43.325314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6629ab-b086-4fe4-b4b0-d2202b61316d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:43.327396 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6629ab-b086-4fe4-b4b0-d2202b61316d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:43.354705 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 888/1766] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:43.355673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6629ab-b086-4fe4-b4b0-d2202b61316d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:43.361856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1d6629ab-b086-4fe4-b4b0-d2202b61316d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:43.381242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6629ab-b086-4fe4-b4b0-d2202b61316d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:43.387306 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea8348-7c9f-4446-8689-3ae868dd97f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:43.388402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea8348-7c9f-4446-8689-3ae868dd97f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:43.388567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea8348-7c9f-4446-8689-3ae868dd97f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:43.388848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea8348-7c9f-4446-8689-3ae868dd97f0 admin admin] PATH_INFO: `/v3/users/8193241ae15a4aba84c824387bf0a97d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:43.390129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea8348-7c9f-4446-8689-3ae868dd97f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8193241ae15a4aba84c824387bf0a97d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:43.392189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea8348-7c9f-4446-8689-3ae868dd97f0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:43.447374 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-05e2f521-30d9-472d-8fe9-45b6d8804a22 None None] MFA Rules not processed for user `33fcc673845943fc96bc18f011639716`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:43.454078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-05e2f521-30d9-472d-8fe9-45b6d8804a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:43.516942 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b4ea8348-7c9f-4446-8689-3ae868dd97f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8193241ae15a4aba84c824387bf0a97d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:43.559229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b4ea8348-7c9f-4446-8689-3ae868dd97f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8193241ae15a4aba84c824387bf0a97d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:43.581036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b4ea8348-7c9f-4446-8689-3ae868dd97f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8193241ae15a4aba84c824387bf0a97d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:43.582896 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b4ea8348-7c9f-4446-8689-3ae868dd97f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8193241ae15a4aba84c824387bf0a97d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:43.606801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b4ea8348-7c9f-4446-8689-3ae868dd97f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8193241ae15a4aba84c824387bf0a97d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:43.643804 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 889/1767] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:43 2022] DELETE /identity/v3/users/8193241ae15a4aba84c824387bf0a97d => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:43.647745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea8348-7c9f-4446-8689-3ae868dd97f0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:43.657798 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b4ea8348-7c9f-4446-8689-3ae868dd97f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:43.729271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 879/1768] 10.222.0.67 () {58 vars in 1015 bytes} [Mon Aug 1 14:22:43 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 432 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:43.983381 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea8348-7c9f-4446-8689-3ae868dd97f0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:43.987246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff9c60-f8b8-4e15-9a88-8f35c14c5f63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:43.988280 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff9c60-f8b8-4e15-9a88-8f35c14c5f63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:43.988673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff9c60-f8b8-4e15-9a88-8f35c14c5f63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:43.989055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ff9c60-f8b8-4e15-9a88-8f35c14c5f63 admin admin] PATH_INFO: `/v3/projects/4f0c20720fd842b6ba4fc4a171a03bdf/users/fb697dc8e3b44aab83ecada44522f719/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:44.022164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2f521-30d9-472d-8fe9-45b6d8804a22 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:44.023050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff9c60-f8b8-4e15-9a88-8f35c14c5f63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f0c20720fd842b6ba4fc4a171a03bdf, user_id=fb697dc8e3b44aab83ecada44522f719, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:44.023519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-05e2f521-30d9-472d-8fe9-45b6d8804a22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:44.026725 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ff9c60-f8b8-4e15-9a88-8f35c14c5f63 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:44.039637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e2f521-30d9-472d-8fe9-45b6d8804a22 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:44.087581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 890/1769] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:43 2022] PUT /identity/v3/projects/4f0c20720fd842b6ba4fc4a171a03bdf/users/fb697dc8e3b44aab83ecada44522f719/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:44.087814 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff9c60-f8b8-4e15-9a88-8f35c14c5f63 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:44.106218 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:44.207307 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:44.251400 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea8a6d5-e1cb-4d61-9f8c-8afba1b9b910 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:44.252361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8a6d5-e1cb-4d61-9f8c-8afba1b9b910 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:44.252798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8a6d5-e1cb-4d61-9f8c-8afba1b9b910 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:44.253227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea8a6d5-e1cb-4d61-9f8c-8afba1b9b910 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:44.267099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8a6d5-e1cb-4d61-9f8c-8afba1b9b910 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:44.269378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea8a6d5-e1cb-4d61-9f8c-8afba1b9b910 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:44.292651 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 880/1770] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:44.294221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2875a7-ab62-4932-b111-a6b06623010b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:44.294703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2875a7-ab62-4932-b111-a6b06623010b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:44.295138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2875a7-ab62-4932-b111-a6b06623010b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:44.321031 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ff9c60-f8b8-4e15-9a88-8f35c14c5f63 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:44.331506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdff79-ffca-473b-8140-8bda7efee450 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:44.332170 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdff79-ffca-473b-8140-8bda7efee450 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:44.332454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdff79-ffca-473b-8140-8bda7efee450 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:44.332783 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bdff79-ffca-473b-8140-8bda7efee450 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:44.355735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdff79-ffca-473b-8140-8bda7efee450 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:44.357239 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bdff79-ffca-473b-8140-8bda7efee450 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:44.363654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9b2875a7-ab62-4932-b111-a6b06623010b None None] MFA Rules not processed for user `fb697dc8e3b44aab83ecada44522f719`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:44.365285 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9b2875a7-ab62-4932-b111-a6b06623010b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:44.387502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 891/1771] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:44 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:44.460823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 881/1772] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:44 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:44.466161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdff79-ffca-473b-8140-8bda7efee450 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:44.649552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bdff79-ffca-473b-8140-8bda7efee450 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:44.655882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966276f0-628b-4a23-8bb8-3f13b9b112fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:44.656895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966276f0-628b-4a23-8bb8-3f13b9b112fb admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:44.657400 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966276f0-628b-4a23-8bb8-3f13b9b112fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:44.657885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966276f0-628b-4a23-8bb8-3f13b9b112fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:44.659668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966276f0-628b-4a23-8bb8-3f13b9b112fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:44.663791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966276f0-628b-4a23-8bb8-3f13b9b112fb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:44.704126 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bed481-3544-4a1a-9ab2-215cbb76946b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:44.704462 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bed481-3544-4a1a-9ab2-215cbb76946b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:44.704685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bed481-3544-4a1a-9ab2-215cbb76946b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:44.728239 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 892/1773] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:44 2022] POST /identity/v3/projects => generated 363 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:44.730461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966276f0-628b-4a23-8bb8-3f13b9b112fb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:44.756748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-89bed481-3544-4a1a-9ab2-215cbb76946b None None] MFA Rules not processed for user `246f0156a53e4931bc24158b06e85654`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:44.759420 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-89bed481-3544-4a1a-9ab2-215cbb76946b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:44.926549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966276f0-628b-4a23-8bb8-3f13b9b112fb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:44.938563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392635fd-51d6-473a-95b1-a858f56b8423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:44.941823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392635fd-51d6-473a-95b1-a858f56b8423 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:44.942872 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392635fd-51d6-473a-95b1-a858f56b8423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:44.943708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392635fd-51d6-473a-95b1-a858f56b8423 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:44.944985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392635fd-51d6-473a-95b1-a858f56b8423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:44.949154 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392635fd-51d6-473a-95b1-a858f56b8423 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:44.967919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 882/1774] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:44 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:45.024927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 893/1775] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:44 2022] POST /identity/v3/users => generated 288 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:45.027670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bed481-3544-4a1a-9ab2-215cbb76946b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:45.040786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bed481-3544-4a1a-9ab2-215cbb76946b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:45.056708 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac2321-a630-4c88-908b-7a9e7d729acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:45.057252 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac2321-a630-4c88-908b-7a9e7d729acb admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.057541 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac2321-a630-4c88-908b-7a9e7d729acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.057788 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ac2321-a630-4c88-908b-7a9e7d729acb admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:45.058498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac2321-a630-4c88-908b-7a9e7d729acb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:45.065581 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ac2321-a630-4c88-908b-7a9e7d729acb admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:45.092638 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 883/1776] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:45.098126 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392635fd-51d6-473a-95b1-a858f56b8423 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:45.115303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392635fd-51d6-473a-95b1-a858f56b8423 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:45.130346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8e0b8-525d-4866-b5e0-ceb4ef1fae0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:45.132646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e0b8-525d-4866-b5e0-ceb4ef1fae0c admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.133023 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e0b8-525d-4866-b5e0-ceb4ef1fae0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.133417 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e8e0b8-525d-4866-b5e0-ceb4ef1fae0c admin admin] PATH_INFO: `/v3/projects/c63eda13b7e34f099e70f2e8e8cfe767/users/944a8215d76b49deafdd1f06d8b12f4b/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:45.178870 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8e0b8-525d-4866-b5e0-ceb4ef1fae0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63eda13b7e34f099e70f2e8e8cfe767, user_id=944a8215d76b49deafdd1f06d8b12f4b, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:45.183968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e8e0b8-525d-4866-b5e0-ceb4ef1fae0c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:45.199562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:45.220443 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 894/1777] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:45 2022] PUT /identity/v3/projects/c63eda13b7e34f099e70f2e8e8cfe767/users/944a8215d76b49deafdd1f06d8b12f4b/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:45.224542 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac2321-a630-4c88-908b-7a9e7d729acb admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:45.238820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ac2321-a630-4c88-908b-7a9e7d729acb admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:45.363644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8e0b8-525d-4866-b5e0-ceb4ef1fae0c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:45.366662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-05e8e0b8-525d-4866-b5e0-ceb4ef1fae0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:45.458836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a031e-78f7-480c-8bed-e86e87ab08e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:45.459494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a031e-78f7-480c-8bed-e86e87ab08e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.459780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a031e-78f7-480c-8bed-e86e87ab08e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.460056 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978a031e-78f7-480c-8bed-e86e87ab08e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:45.460769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a031e-78f7-480c-8bed-e86e87ab08e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:45.462429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978a031e-78f7-480c-8bed-e86e87ab08e6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:45.479221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:45.505935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 884/1778] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:45 2022] GET /identity/v3/roles => generated 1420 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:45.513035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a031e-78f7-480c-8bed-e86e87ab08e6 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:45.531470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e8e0b8-525d-4866-b5e0-ceb4ef1fae0c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:45.539727 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978a031e-78f7-480c-8bed-e86e87ab08e6 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:45.546899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb4ed3-6156-47de-8413-300db8b05ed4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:45.553309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb4ed3-6156-47de-8413-300db8b05ed4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.553622 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb4ed3-6156-47de-8413-300db8b05ed4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.553952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadb4ed3-6156-47de-8413-300db8b05ed4 admin admin] PATH_INFO: `/v3/projects/2923f8c7f67c4df8b7a13b6967cdcd5d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:45.556407 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb4ed3-6156-47de-8413-300db8b05ed4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2923f8c7f67c4df8b7a13b6967cdcd5d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:45.558489 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadb4ed3-6156-47de-8413-300db8b05ed4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:45.579036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d653e4e-76f4-47c1-9b45-6937e66c176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:45.579733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d653e4e-76f4-47c1-9b45-6937e66c176c admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.580360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d653e4e-76f4-47c1-9b45-6937e66c176c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.580644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d653e4e-76f4-47c1-9b45-6937e66c176c admin admin] PATH_INFO: `/v3/projects/c63eda13b7e34f099e70f2e8e8cfe767/users/944a8215d76b49deafdd1f06d8b12f4b/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:45.588804 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d653e4e-76f4-47c1-9b45-6937e66c176c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63eda13b7e34f099e70f2e8e8cfe767, user_id=944a8215d76b49deafdd1f06d8b12f4b, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:45.591592 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d653e4e-76f4-47c1-9b45-6937e66c176c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:45.648594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 885/1779] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:45 2022] PUT /identity/v3/projects/c63eda13b7e34f099e70f2e8e8cfe767/users/944a8215d76b49deafdd1f06d8b12f4b/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:45.660467 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891363a3-0992-47ad-8947-04688b19c142 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.661508 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891363a3-0992-47ad-8947-04688b19c142 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.661947 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-891363a3-0992-47ad-8947-04688b19c142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:45.703023 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fadb4ed3-6156-47de-8413-300db8b05ed4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2923f8c7f67c4df8b7a13b6967cdcd5d', 'request_id': 'req-fadb4ed3-6156-47de-8413-300db8b05ed4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:45.720193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fadb4ed3-6156-47de-8413-300db8b05ed4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2923f8c7f67c4df8b7a13b6967cdcd5d', 'request_id': 'req-fadb4ed3-6156-47de-8413-300db8b05ed4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:45.739610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fadb4ed3-6156-47de-8413-300db8b05ed4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2923f8c7f67c4df8b7a13b6967cdcd5d', 'request_id': 'req-fadb4ed3-6156-47de-8413-300db8b05ed4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:45.742417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-891363a3-0992-47ad-8947-04688b19c142 None None] MFA Rules not processed for user `944a8215d76b49deafdd1f06d8b12f4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:45.746668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-891363a3-0992-47ad-8947-04688b19c142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:45.763207 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fadb4ed3-6156-47de-8413-300db8b05ed4 admin admin] The token cache is being invalidate because project 2923f8c7f67c4df8b7a13b6967cdcd5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:45.763518 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fadb4ed3-6156-47de-8413-300db8b05ed4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:45.764328 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fadb4ed3-6156-47de-8413-300db8b05ed4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:45.766618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 895/1780] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:45 2022] DELETE /identity/v3/projects/2923f8c7f67c4df8b7a13b6967cdcd5d => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:45.771166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb4ed3-6156-47de-8413-300db8b05ed4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:45.772975 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fadb4ed3-6156-47de-8413-300db8b05ed4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:45.856259 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadb4ed3-6156-47de-8413-300db8b05ed4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:45.864032 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5cd3e-0063-410b-89b8-3297852a9c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:45.864971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5cd3e-0063-410b-89b8-3297852a9c38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:45.865521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5cd3e-0063-410b-89b8-3297852a9c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:45.866042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c5cd3e-0063-410b-89b8-3297852a9c38 admin admin] PATH_INFO: `/v3/users/9d61ad6546494f2085e03213806dda25` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:45.868293 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5cd3e-0063-410b-89b8-3297852a9c38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d61ad6546494f2085e03213806dda25)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:45.870877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c5cd3e-0063-410b-89b8-3297852a9c38 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:45.928749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:45.965107 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 886/1781] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:45 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:45.972995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-24c5cd3e-0063-410b-89b8-3297852a9c38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d61ad6546494f2085e03213806dda25'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:45.974804 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891363a3-0992-47ad-8947-04688b19c142 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:45.977220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-891363a3-0992-47ad-8947-04688b19c142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:46.009051 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-24c5cd3e-0063-410b-89b8-3297852a9c38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d61ad6546494f2085e03213806dda25'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:46.029345 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-24c5cd3e-0063-410b-89b8-3297852a9c38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d61ad6546494f2085e03213806dda25'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:46.030503 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-24c5cd3e-0063-410b-89b8-3297852a9c38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d61ad6546494f2085e03213806dda25'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:46.046479 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-24c5cd3e-0063-410b-89b8-3297852a9c38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d61ad6546494f2085e03213806dda25'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:46.059146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 896/1782] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:45 2022] DELETE /identity/v3/users/9d61ad6546494f2085e03213806dda25 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:46.253780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-891363a3-0992-47ad-8947-04688b19c142 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:46.356668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d4ae1-1856-4b63-9fe0-a5bd30ed5171 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:46.357722 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d4ae1-1856-4b63-9fe0-a5bd30ed5171 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:46.358292 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d4ae1-1856-4b63-9fe0-a5bd30ed5171 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:46.358905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73d4ae1-1856-4b63-9fe0-a5bd30ed5171 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:46.363398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e73d4ae1-1856-4b63-9fe0-a5bd30ed5171 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:46.456180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:46.506250 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d4ae1-1856-4b63-9fe0-a5bd30ed5171 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:46.510949 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73d4ae1-1856-4b63-9fe0-a5bd30ed5171 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:46.542258 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 887/1783] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:45 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:46.680066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5cd3e-0063-410b-89b8-3297852a9c38 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:46.681920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-24c5cd3e-0063-410b-89b8-3297852a9c38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:46.719960 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c5cd3e-0063-410b-89b8-3297852a9c38 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:46.729851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506997d9-d816-47b1-a3b4-039160c0273e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:46.730735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506997d9-d816-47b1-a3b4-039160c0273e service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:46.731221 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506997d9-d816-47b1-a3b4-039160c0273e service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:46.731796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506997d9-d816-47b1-a3b4-039160c0273e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:46.741133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-506997d9-d816-47b1-a3b4-039160c0273e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:46.753716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d4ae1-1856-4b63-9fe0-a5bd30ed5171 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:46.755559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e73d4ae1-1856-4b63-9fe0-a5bd30ed5171 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:46.904589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506997d9-d816-47b1-a3b4-039160c0273e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:46.908840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506997d9-d816-47b1-a3b4-039160c0273e service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:46.911661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73d4ae1-1856-4b63-9fe0-a5bd30ed5171 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:46.925644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0fde7-4176-4ea7-b667-b34c5de8a629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:46.926289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0fde7-4176-4ea7-b667-b34c5de8a629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:46.926758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0fde7-4176-4ea7-b667-b34c5de8a629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:46.927082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0fde7-4176-4ea7-b667-b34c5de8a629 admin admin] PATH_INFO: `/v3/projects/d70626f1e91b46f1ae468352219a19d6` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:46.931750 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0fde7-4176-4ea7-b667-b34c5de8a629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d70626f1e91b46f1ae468352219a19d6)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:46.934683 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0fde7-4176-4ea7-b667-b34c5de8a629 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:46.947990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 897/1784] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:46 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:47.018865 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3bb0fde7-4176-4ea7-b667-b34c5de8a629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd70626f1e91b46f1ae468352219a19d6', 'request_id': 'req-3bb0fde7-4176-4ea7-b667-b34c5de8a629'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:47.025604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3bb0fde7-4176-4ea7-b667-b34c5de8a629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd70626f1e91b46f1ae468352219a19d6', 'request_id': 'req-3bb0fde7-4176-4ea7-b667-b34c5de8a629'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:47.038013 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3bb0fde7-4176-4ea7-b667-b34c5de8a629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd70626f1e91b46f1ae468352219a19d6', 'request_id': 'req-3bb0fde7-4176-4ea7-b667-b34c5de8a629'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:47.057000 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3bb0fde7-4176-4ea7-b667-b34c5de8a629 admin admin] The token cache is being invalidate because project d70626f1e91b46f1ae468352219a19d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:47.057297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3bb0fde7-4176-4ea7-b667-b34c5de8a629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:47.058494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3bb0fde7-4176-4ea7-b667-b34c5de8a629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:47.063936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 888/1785] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:46 2022] DELETE /identity/v3/projects/d70626f1e91b46f1ae468352219a19d6 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:47.066127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1edf6a-3fdd-4dde-b397-aa7cd27f4590 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:47.066645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1edf6a-3fdd-4dde-b397-aa7cd27f4590 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:47.067096 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1edf6a-3fdd-4dde-b397-aa7cd27f4590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:47.144773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2a1edf6a-3fdd-4dde-b397-aa7cd27f4590 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:47.149639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2a1edf6a-3fdd-4dde-b397-aa7cd27f4590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:47.370470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 898/1786] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:47.372180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e66ee-0285-4069-8c6f-5ec555eb27d7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:47.372870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e66ee-0285-4069-8c6f-5ec555eb27d7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:47.372870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55e66ee-0285-4069-8c6f-5ec555eb27d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:47.414411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c55e66ee-0285-4069-8c6f-5ec555eb27d7 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:47.415746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c55e66ee-0285-4069-8c6f-5ec555eb27d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:47.438626 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 889/1787] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:47.442934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1edf6a-3fdd-4dde-b397-aa7cd27f4590 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:47.453892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1edf6a-3fdd-4dde-b397-aa7cd27f4590 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:47.470996 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161dacbc-0927-4466-b58c-671820af43d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:47.471675 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161dacbc-0927-4466-b58c-671820af43d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:47.471898 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161dacbc-0927-4466-b58c-671820af43d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:47.472170 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161dacbc-0927-4466-b58c-671820af43d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:47.472887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161dacbc-0927-4466-b58c-671820af43d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:47.473189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161dacbc-0927-4466-b58c-671820af43d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:47.478152 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161dacbc-0927-4466-b58c-671820af43d1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:47.501674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 899/1788] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:47.504259 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e66ee-0285-4069-8c6f-5ec555eb27d7 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:47.516505 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55e66ee-0285-4069-8c6f-5ec555eb27d7 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:47.529792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1259d88-edd5-4d45-8819-12b57560da79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:47.532584 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1259d88-edd5-4d45-8819-12b57560da79 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:47.532711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1259d88-edd5-4d45-8819-12b57560da79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:47.533139 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1259d88-edd5-4d45-8819-12b57560da79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:47.533965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1259d88-edd5-4d45-8819-12b57560da79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:47.542952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1259d88-edd5-4d45-8819-12b57560da79 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:47.627633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161dacbc-0927-4466-b58c-671820af43d1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:47.631311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 890/1789] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:47 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:47.638492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161dacbc-0927-4466-b58c-671820af43d1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:47.721754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:47.762817 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0c738-c511-4379-8953-78a26b83b2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:47.763559 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0c738-c511-4379-8953-78a26b83b2c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:47.764089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0c738-c511-4379-8953-78a26b83b2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:47.764460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb0c738-c511-4379-8953-78a26b83b2c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:47.765462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0c738-c511-4379-8953-78a26b83b2c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:47.769202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb0c738-c511-4379-8953-78a26b83b2c0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:47.808087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 900/1790] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:47 2022] POST /identity/v3/users => generated 283 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:22:47.811888 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1259d88-edd5-4d45-8819-12b57560da79 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:47.823846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1259d88-edd5-4d45-8819-12b57560da79 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:47.853174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa728a1-9a3e-40fe-b46c-d99aba2e63be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:47.853791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0c738-c511-4379-8953-78a26b83b2c0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:47.853907 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa728a1-9a3e-40fe-b46c-d99aba2e63be admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:47.854144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa728a1-9a3e-40fe-b46c-d99aba2e63be admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:47.854345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa728a1-9a3e-40fe-b46c-d99aba2e63be admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:47.855097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa728a1-9a3e-40fe-b46c-d99aba2e63be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:47.856777 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa728a1-9a3e-40fe-b46c-d99aba2e63be admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:47.857354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-efb0c738-c511-4379-8953-78a26b83b2c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:47.905836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 891/1791] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:47.907038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb0c738-c511-4379-8953-78a26b83b2c0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:47.907534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa728a1-9a3e-40fe-b46c-d99aba2e63be admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:47.928154 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbf0d93-3b93-43fa-9216-fbba106e7135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:47.929447 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf0d93-3b93-43fa-9216-fbba106e7135 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:47.929750 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf0d93-3b93-43fa-9216-fbba106e7135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:47.930025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbf0d93-3b93-43fa-9216-fbba106e7135 admin admin] PATH_INFO: `/v3/projects/1bf79071c7e243fc80c74ea52285ce73` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:47.931489 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf0d93-3b93-43fa-9216-fbba106e7135 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bf79071c7e243fc80c74ea52285ce73)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:47.934804 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbf0d93-3b93-43fa-9216-fbba106e7135 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:47.957666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa728a1-9a3e-40fe-b46c-d99aba2e63be admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:47.978700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351b7c1-3006-4f1c-87d4-ad260d45d449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:47.979721 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351b7c1-3006-4f1c-87d4-ad260d45d449 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:47.980210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351b7c1-3006-4f1c-87d4-ad260d45d449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:47.980900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7351b7c1-3006-4f1c-87d4-ad260d45d449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:47.982152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351b7c1-3006-4f1c-87d4-ad260d45d449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:47.984116 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7351b7c1-3006-4f1c-87d4-ad260d45d449 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:48.030231 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 892/1792] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:48.032001 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351b7c1-3006-4f1c-87d4-ad260d45d449 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:48.051811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7351b7c1-3006-4f1c-87d4-ad260d45d449 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:48.083025 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:48.121094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-dcbf0d93-3b93-43fa-9216-fbba106e7135 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bf79071c7e243fc80c74ea52285ce73', 'request_id': 'req-dcbf0d93-3b93-43fa-9216-fbba106e7135'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:48.152987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-dcbf0d93-3b93-43fa-9216-fbba106e7135 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bf79071c7e243fc80c74ea52285ce73', 'request_id': 'req-dcbf0d93-3b93-43fa-9216-fbba106e7135'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:48.179981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-dcbf0d93-3b93-43fa-9216-fbba106e7135 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bf79071c7e243fc80c74ea52285ce73', 'request_id': 'req-dcbf0d93-3b93-43fa-9216-fbba106e7135'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:48.183209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2d6343-0a06-4f4b-babe-6313cc7ffa07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:48.184229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d6343-0a06-4f4b-babe-6313cc7ffa07 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:48.185574 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d6343-0a06-4f4b-babe-6313cc7ffa07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:48.186078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2d6343-0a06-4f4b-babe-6313cc7ffa07 admin admin] PATH_INFO: `/v3/projects/6255c4e3cdbc4cf59245e7dd74527638/users/1e469353d81e4163af849fa4a8d4a0c0/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:48.212644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-dcbf0d93-3b93-43fa-9216-fbba106e7135 admin admin] The token cache is being invalidate because project 1bf79071c7e243fc80c74ea52285ce73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:48.214314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-dcbf0d93-3b93-43fa-9216-fbba106e7135 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:48.215911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-dcbf0d93-3b93-43fa-9216-fbba106e7135 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:48.225791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 901/1793] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:47 2022] DELETE /identity/v3/projects/1bf79071c7e243fc80c74ea52285ce73 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:48.230817 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ed1df-dffd-4c4e-9714-ae70faded5af None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:48.231100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ed1df-dffd-4c4e-9714-ae70faded5af None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:48.231733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38ed1df-dffd-4c4e-9714-ae70faded5af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:48.244206 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d6343-0a06-4f4b-babe-6313cc7ffa07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6255c4e3cdbc4cf59245e7dd74527638, user_id=1e469353d81e4163af849fa4a8d4a0c0, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:48.252794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2d6343-0a06-4f4b-babe-6313cc7ffa07 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:48.287896 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e38ed1df-dffd-4c4e-9714-ae70faded5af None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:48.292520 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e38ed1df-dffd-4c4e-9714-ae70faded5af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:48.303071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 893/1794] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:48 2022] PUT /identity/v3/projects/6255c4e3cdbc4cf59245e7dd74527638/users/1e469353d81e4163af849fa4a8d4a0c0/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:48.304767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3b4d4-6a85-4cbf-a01d-58d21820a120 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:48.305160 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3b4d4-6a85-4cbf-a01d-58d21820a120 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:48.305566 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d3b4d4-6a85-4cbf-a01d-58d21820a120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:48.415696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-09d3b4d4-6a85-4cbf-a01d-58d21820a120 None None] MFA Rules not processed for user `1e469353d81e4163af849fa4a8d4a0c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:48.417241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-09d3b4d4-6a85-4cbf-a01d-58d21820a120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:48.451615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 902/1795] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:48.454243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ef63a-523d-466c-b98a-559e5e4f4e15 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:48.454542 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ef63a-523d-466c-b98a-559e5e4f4e15 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:48.456011 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6ef63a-523d-466c-b98a-559e5e4f4e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:48.478122 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9b6ef63a-523d-466c-b98a-559e5e4f4e15 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:48.479350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9b6ef63a-523d-466c-b98a-559e5e4f4e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:48.492522 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 903/1796] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:48.493465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ef63a-523d-466c-b98a-559e5e4f4e15 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:48.504856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6ef63a-523d-466c-b98a-559e5e4f4e15 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:48.510287 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e7b6c-2854-4d58-9b16-b9f708730968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:48.511124 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e7b6c-2854-4d58-9b16-b9f708730968 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:48.513036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e7b6c-2854-4d58-9b16-b9f708730968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:48.513350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e7b6c-2854-4d58-9b16-b9f708730968 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:48.514088 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e7b6c-2854-4d58-9b16-b9f708730968 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:48.514400 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e7b6c-2854-4d58-9b16-b9f708730968 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:48.519156 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e7b6c-2854-4d58-9b16-b9f708730968 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:48.551464 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 904/1797] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:48.551464 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e7b6c-2854-4d58-9b16-b9f708730968 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:48.606057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e7b6c-2854-4d58-9b16-b9f708730968 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:48.622034 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ac389-f85e-44c6-b963-4dc25d41c30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:48.623054 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac389-f85e-44c6-b963-4dc25d41c30b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:48.623574 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac389-f85e-44c6-b963-4dc25d41c30b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:48.623903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684ac389-f85e-44c6-b963-4dc25d41c30b admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:48.625623 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ac389-f85e-44c6-b963-4dc25d41c30b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:48.635033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-684ac389-f85e-44c6-b963-4dc25d41c30b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:48.644794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 894/1798] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:48.650329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3b4d4-6a85-4cbf-a01d-58d21820a120 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:48.652644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-09d3b4d4-6a85-4cbf-a01d-58d21820a120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:48.685090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d3b4d4-6a85-4cbf-a01d-58d21820a120 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:48.693244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73a2c4-65ac-4ec3-a53a-d709bbb27827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:48.694750 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73a2c4-65ac-4ec3-a53a-d709bbb27827 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:48.695222 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73a2c4-65ac-4ec3-a53a-d709bbb27827 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:48.695779 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73a2c4-65ac-4ec3-a53a-d709bbb27827 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:48.696308 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 905/1799] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:48 2022] POST /identity/v3/projects => generated 373 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:48.697424 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73a2c4-65ac-4ec3-a53a-d709bbb27827 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:48.699530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73a2c4-65ac-4ec3-a53a-d709bbb27827 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:48.707006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ac389-f85e-44c6-b963-4dc25d41c30b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:48.731500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:48.810502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 895/1800] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:48 2022] POST /identity/v3/projects => generated 363 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:48.814229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73a2c4-65ac-4ec3-a53a-d709bbb27827 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:48.888695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684ac389-f85e-44c6-b963-4dc25d41c30b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:48.977423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73a2c4-65ac-4ec3-a53a-d709bbb27827 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:48.991519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181f75b-5559-4884-86ac-db77dc3f5feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:48.992181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181f75b-5559-4884-86ac-db77dc3f5feb admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:48.995567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181f75b-5559-4884-86ac-db77dc3f5feb admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:48.995899 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0181f75b-5559-4884-86ac-db77dc3f5feb admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:48.996753 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181f75b-5559-4884-86ac-db77dc3f5feb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:48.998676 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0181f75b-5559-4884-86ac-db77dc3f5feb admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:49.027828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f849a1-2cf7-4a9e-ac0d-881cb4f8eb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:49.028801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f849a1-2cf7-4a9e-ac0d-881cb4f8eb45 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:49.029091 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f849a1-2cf7-4a9e-ac0d-881cb4f8eb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:49.029551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f849a1-2cf7-4a9e-ac0d-881cb4f8eb45 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:49.031480 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f849a1-2cf7-4a9e-ac0d-881cb4f8eb45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:49.032846 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f849a1-2cf7-4a9e-ac0d-881cb4f8eb45 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:49.078537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:49.086494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 906/1801] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:48 2022] POST /identity/v3/users => generated 287 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:49.088867 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f849a1-2cf7-4a9e-ac0d-881cb4f8eb45 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:49.097675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 896/1802] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:48 2022] POST /identity/v3/users => generated 288 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:49.102856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181f75b-5559-4884-86ac-db77dc3f5feb admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:49.136492 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0181f75b-5559-4884-86ac-db77dc3f5feb admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:49.159568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e277f3-20e9-4d53-93f0-4132e0bd7e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:49.160175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e277f3-20e9-4d53-93f0-4132e0bd7e61 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:49.163132 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e277f3-20e9-4d53-93f0-4132e0bd7e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:49.163437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e277f3-20e9-4d53-93f0-4132e0bd7e61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:49.164171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e277f3-20e9-4d53-93f0-4132e0bd7e61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:49.165838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e277f3-20e9-4d53-93f0-4132e0bd7e61 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:49.187288 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f849a1-2cf7-4a9e-ac0d-881cb4f8eb45 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:49.199127 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 897/1803] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:49.203470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e277f3-20e9-4d53-93f0-4132e0bd7e61 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:49.214964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e277f3-20e9-4d53-93f0-4132e0bd7e61 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:49.224249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a8856-0f90-4a46-a2c8-423e9a9ca581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:49.224595 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a8856-0f90-4a46-a2c8-423e9a9ca581 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:49.229600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a8856-0f90-4a46-a2c8-423e9a9ca581 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:49.231690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5a8856-0f90-4a46-a2c8-423e9a9ca581 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:49.232532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a8856-0f90-4a46-a2c8-423e9a9ca581 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:49.236715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff06ba4-bddb-4458-ba2c-19f4589b4390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:49.241777 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff06ba4-bddb-4458-ba2c-19f4589b4390 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:49.243780 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5a8856-0f90-4a46-a2c8-423e9a9ca581 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:49.244102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff06ba4-bddb-4458-ba2c-19f4589b4390 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:49.244494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff06ba4-bddb-4458-ba2c-19f4589b4390 admin admin] PATH_INFO: `/v3/projects/209a3c35dcff4095adf822003f8c4eb4/users/4be907bd58cb4ad1ac9c665b8df983b7/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:49.296680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff06ba4-bddb-4458-ba2c-19f4589b4390 admin admin] RBAC: Authorizing `identity:create_grant(project_id=209a3c35dcff4095adf822003f8c4eb4, user_id=4be907bd58cb4ad1ac9c665b8df983b7, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:49.297265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 907/1804] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:49.304532 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff06ba4-bddb-4458-ba2c-19f4589b4390 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:49.306423 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a8856-0f90-4a46-a2c8-423e9a9ca581 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:49.316063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fb5a8856-0f90-4a46-a2c8-423e9a9ca581 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:49.357230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 898/1805] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:49 2022] PUT /identity/v3/projects/209a3c35dcff4095adf822003f8c4eb4/users/4be907bd58cb4ad1ac9c665b8df983b7/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:49.358311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff06ba4-bddb-4458-ba2c-19f4589b4390 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:49.365922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5a8856-0f90-4a46-a2c8-423e9a9ca581 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:49.487968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f83df-f616-4e2a-8fe8-2981b77e905c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:49.488721 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f83df-f616-4e2a-8fe8-2981b77e905c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:49.489132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f83df-f616-4e2a-8fe8-2981b77e905c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:49.489343 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01f83df-f616-4e2a-8fe8-2981b77e905c admin admin] PATH_INFO: `/v3/projects/4dc1ebec6c83469b88a648a2208ef5ca` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:49.494768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f83df-f616-4e2a-8fe8-2981b77e905c admin admin] RBAC: Authorizing `identity:delete_project(project_id=4dc1ebec6c83469b88a648a2208ef5ca)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:49.497222 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01f83df-f616-4e2a-8fe8-2981b77e905c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:49.632431 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:49.650617 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff06ba4-bddb-4458-ba2c-19f4589b4390 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:49.669464 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c01f83df-f616-4e2a-8fe8-2981b77e905c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4dc1ebec6c83469b88a648a2208ef5ca', 'request_id': 'req-c01f83df-f616-4e2a-8fe8-2981b77e905c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:49.691471 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c01f83df-f616-4e2a-8fe8-2981b77e905c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4dc1ebec6c83469b88a648a2208ef5ca', 'request_id': 'req-c01f83df-f616-4e2a-8fe8-2981b77e905c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:49.716430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c01f83df-f616-4e2a-8fe8-2981b77e905c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4dc1ebec6c83469b88a648a2208ef5ca', 'request_id': 'req-c01f83df-f616-4e2a-8fe8-2981b77e905c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:49.755446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c01f83df-f616-4e2a-8fe8-2981b77e905c admin admin] The token cache is being invalidate because project 4dc1ebec6c83469b88a648a2208ef5ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:49.756335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c01f83df-f616-4e2a-8fe8-2981b77e905c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:49.759582 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c01f83df-f616-4e2a-8fe8-2981b77e905c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:49.766076 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 908/1806] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:49 2022] DELETE /identity/v3/projects/4dc1ebec6c83469b88a648a2208ef5ca => generated 0 bytes in 465 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:49.767360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f83df-f616-4e2a-8fe8-2981b77e905c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:49.771426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c01f83df-f616-4e2a-8fe8-2981b77e905c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:49.821997 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d3c11-965e-4bd7-82b4-26897543774a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:49.822708 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d3c11-965e-4bd7-82b4-26897543774a admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:49.822993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d3c11-965e-4bd7-82b4-26897543774a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:49.823267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d3c11-965e-4bd7-82b4-26897543774a admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:49.823978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d3c11-965e-4bd7-82b4-26897543774a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:49.826668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d3c11-965e-4bd7-82b4-26897543774a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:49.844565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 899/1807] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 487 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:49.849330 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d3c11-965e-4bd7-82b4-26897543774a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:49.853754 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-eb1d3c11-965e-4bd7-82b4-26897543774a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:49.924691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d3c11-965e-4bd7-82b4-26897543774a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:49.937566 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992e234-8227-4897-b0f9-3aec19bf3e64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:49.940485 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992e234-8227-4897-b0f9-3aec19bf3e64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:49.942187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992e234-8227-4897-b0f9-3aec19bf3e64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:49.942301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992e234-8227-4897-b0f9-3aec19bf3e64 admin admin] PATH_INFO: `/v3/users/38f939802f494d5780d81858ed1379ea` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:49.944294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992e234-8227-4897-b0f9-3aec19bf3e64 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38f939802f494d5780d81858ed1379ea)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:49.949831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2992e234-8227-4897-b0f9-3aec19bf3e64 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:49.997281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01f83df-f616-4e2a-8fe8-2981b77e905c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:50.024444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00676014-80d8-4863-8251-076db293d39b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:50.025111 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00676014-80d8-4863-8251-076db293d39b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:50.025693 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00676014-80d8-4863-8251-076db293d39b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:50.025937 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00676014-80d8-4863-8251-076db293d39b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:50.026710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00676014-80d8-4863-8251-076db293d39b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:50.028347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00676014-80d8-4863-8251-076db293d39b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:50.076767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 909/1808] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:50.078700 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00676014-80d8-4863-8251-076db293d39b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:50.083898 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-00676014-80d8-4863-8251-076db293d39b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:50.109365 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2992e234-8227-4897-b0f9-3aec19bf3e64 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38f939802f494d5780d81858ed1379ea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:50.112220 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00676014-80d8-4863-8251-076db293d39b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:50.119868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38790c3c-bf91-4974-9651-87bb127bbcf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:50.120871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38790c3c-bf91-4974-9651-87bb127bbcf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:50.122426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38790c3c-bf91-4974-9651-87bb127bbcf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:50.123056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38790c3c-bf91-4974-9651-87bb127bbcf2 admin admin] PATH_INFO: `/v3/projects/22adb0478ee24426a0d2a1cc9603d82b/users/36ca2336765b4d94be30fed443a83198/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:50.127558 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2992e234-8227-4897-b0f9-3aec19bf3e64 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38f939802f494d5780d81858ed1379ea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:50.142443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:50.182461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2992e234-8227-4897-b0f9-3aec19bf3e64 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38f939802f494d5780d81858ed1379ea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:50.185596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2992e234-8227-4897-b0f9-3aec19bf3e64 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38f939802f494d5780d81858ed1379ea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:50.194172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38790c3c-bf91-4974-9651-87bb127bbcf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22adb0478ee24426a0d2a1cc9603d82b, user_id=36ca2336765b4d94be30fed443a83198, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:50.205343 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38790c3c-bf91-4974-9651-87bb127bbcf2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:50.220170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2992e234-8227-4897-b0f9-3aec19bf3e64 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38f939802f494d5780d81858ed1379ea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:50.245527 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 910/1809] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:50 2022] PUT /identity/v3/projects/22adb0478ee24426a0d2a1cc9603d82b/users/36ca2336765b4d94be30fed443a83198/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:50.260129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 900/1810] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:49 2022] DELETE /identity/v3/users/38f939802f494d5780d81858ed1379ea => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:50.260312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38790c3c-bf91-4974-9651-87bb127bbcf2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:50.260825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9003-651d-4ef8-ae55-2b9d3bcb68e7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:50.261124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9003-651d-4ef8-ae55-2b9d3bcb68e7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:50.262475 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8c9003-651d-4ef8-ae55-2b9d3bcb68e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:50.264116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-38790c3c-bf91-4974-9651-87bb127bbcf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:50.329011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-cc8c9003-651d-4ef8-ae55-2b9d3bcb68e7 None None] MFA Rules not processed for user `36ca2336765b4d94be30fed443a83198`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:50.331347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cc8c9003-651d-4ef8-ae55-2b9d3bcb68e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:50.435755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38790c3c-bf91-4974-9651-87bb127bbcf2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:50.449364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d35baf-e4c0-42be-a71f-6b772d0db032 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:50.450190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d35baf-e4c0-42be-a71f-6b772d0db032 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:50.450357 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d35baf-e4c0-42be-a71f-6b772d0db032 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:50.450704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d35baf-e4c0-42be-a71f-6b772d0db032 admin admin] PATH_INFO: `/v3/projects/209a3c35dcff4095adf822003f8c4eb4/users/4be907bd58cb4ad1ac9c665b8df983b7/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:50.457266 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d35baf-e4c0-42be-a71f-6b772d0db032 admin admin] RBAC: Authorizing `identity:create_grant(project_id=209a3c35dcff4095adf822003f8c4eb4, user_id=4be907bd58cb4ad1ac9c665b8df983b7, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:50.462692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d35baf-e4c0-42be-a71f-6b772d0db032 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:50.502697 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 911/1811] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:50 2022] PUT /identity/v3/projects/209a3c35dcff4095adf822003f8c4eb4/users/4be907bd58cb4ad1ac9c665b8df983b7/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:50.504935 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6591bc-72df-4680-a3ca-17ec644cdd07 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:50.505301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6591bc-72df-4680-a3ca-17ec644cdd07 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:50.505611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6591bc-72df-4680-a3ca-17ec644cdd07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:50.506971 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 901/1812] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:50 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:50.520792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c9003-651d-4ef8-ae55-2b9d3bcb68e7 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:50.524625 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cc8c9003-651d-4ef8-ae55-2b9d3bcb68e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:50.587532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9d6591bc-72df-4680-a3ca-17ec644cdd07 None None] MFA Rules not processed for user `4be907bd58cb4ad1ac9c665b8df983b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:50.589380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9d6591bc-72df-4680-a3ca-17ec644cdd07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:50.634998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:50.665392 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8c9003-651d-4ef8-ae55-2b9d3bcb68e7 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:50.750175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355205c-4b0f-456a-83cb-57472e6796bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:50.751343 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355205c-4b0f-456a-83cb-57472e6796bf service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:50.759353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355205c-4b0f-456a-83cb-57472e6796bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:50.771272 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f355205c-4b0f-456a-83cb-57472e6796bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:50.810545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 912/1813] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:50 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:50.812443 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d9ae8-c192-4d57-b182-3d5a824d298a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:50.812644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d9ae8-c192-4d57-b182-3d5a824d298a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:50.812915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d9ae8-c192-4d57-b182-3d5a824d298a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:50.815072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 913/1814] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 1 14:22:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:22:50.824508 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d9ae8-c192-4d57-b182-3d5a824d298a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:50.826661 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-480d9ae8-c192-4d57-b182-3d5a824d298a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:50.853182 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d9ae8-c192-4d57-b182-3d5a824d298a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:50.864022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9e07f9-350d-4f08-8f90-fc0802d783c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:50.865385 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e07f9-350d-4f08-8f90-fc0802d783c5 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:50.866272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e07f9-350d-4f08-8f90-fc0802d783c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:50.866403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9e07f9-350d-4f08-8f90-fc0802d783c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:50.879330 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:50.892859 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e07f9-350d-4f08-8f90-fc0802d783c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:50.894240 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9e07f9-350d-4f08-8f90-fc0802d783c5 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:50.923190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 914/1815] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:50 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:50.991693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355205c-4b0f-456a-83cb-57472e6796bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:51.006779 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f355205c-4b0f-456a-83cb-57472e6796bf service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:51.044159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 902/1816] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:50 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:51.057006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c67a8-feca-4b4b-b5ef-c934ecc524aa None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:51.057515 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c67a8-feca-4b4b-b5ef-c934ecc524aa None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:51.057989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464c67a8-feca-4b4b-b5ef-c934ecc524aa None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:51.059791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 915/1817] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 1 14:22:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:22:51.069643 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355205c-4b0f-456a-83cb-57472e6796bf service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:51.071217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f355205c-4b0f-456a-83cb-57472e6796bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:51.120862 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82df775-15f9-4110-b067-abda9dc87b76 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:51.121502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82df775-15f9-4110-b067-abda9dc87b76 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:51.122104 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82df775-15f9-4110-b067-abda9dc87b76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:51.217230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e82df775-15f9-4110-b067-abda9dc87b76 None None] MFA Rules not processed for user `e856fd5aff914cfb8b8dd86b39c89bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:51.218555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e82df775-15f9-4110-b067-abda9dc87b76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:51.429107 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f355205c-4b0f-456a-83cb-57472e6796bf service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:51.441421 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40228446-f5e9-4932-bd65-3b3452a6116d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:51.442258 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40228446-f5e9-4932-bd65-3b3452a6116d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:51.442898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40228446-f5e9-4932-bd65-3b3452a6116d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:51.443236 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40228446-f5e9-4932-bd65-3b3452a6116d admin admin] PATH_INFO: `/v3/users/36ca2336765b4d94be30fed443a83198` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:51.446163 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40228446-f5e9-4932-bd65-3b3452a6116d admin admin] RBAC: Authorizing `identity:delete_user(user_id=36ca2336765b4d94be30fed443a83198)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:51.451982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40228446-f5e9-4932-bd65-3b3452a6116d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:51.484935 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 916/1818] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 1 14:22:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 365 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:51.485899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82df775-15f9-4110-b067-abda9dc87b76 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:51.508380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82df775-15f9-4110-b067-abda9dc87b76 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:51.524475 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b506dd4-5d98-4b07-b03f-8094b98a9802 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:51.525120 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b506dd4-5d98-4b07-b03f-8094b98a9802 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:51.525407 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b506dd4-5d98-4b07-b03f-8094b98a9802 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:51.525682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b506dd4-5d98-4b07-b03f-8094b98a9802 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:51.527716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2b506dd4-5d98-4b07-b03f-8094b98a9802 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:51.611603 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-40228446-f5e9-4932-bd65-3b3452a6116d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36ca2336765b4d94be30fed443a83198'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.632622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-40228446-f5e9-4932-bd65-3b3452a6116d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36ca2336765b4d94be30fed443a83198'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.639800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b506dd4-5d98-4b07-b03f-8094b98a9802 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:51.641262 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b506dd4-5d98-4b07-b03f-8094b98a9802 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:51.652482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 917/1819] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:51.653355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b506dd4-5d98-4b07-b03f-8094b98a9802 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:51.654924 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2b506dd4-5d98-4b07-b03f-8094b98a9802 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:51.663286 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-40228446-f5e9-4932-bd65-3b3452a6116d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36ca2336765b4d94be30fed443a83198'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.664558 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-40228446-f5e9-4932-bd65-3b3452a6116d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36ca2336765b4d94be30fed443a83198'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.670037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b506dd4-5d98-4b07-b03f-8094b98a9802 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:51.675136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a32dab9-d2c8-44d0-aecd-56d9f1e05b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:51.675794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32dab9-d2c8-44d0-aecd-56d9f1e05b1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:51.676078 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32dab9-d2c8-44d0-aecd-56d9f1e05b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:51.676355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a32dab9-d2c8-44d0-aecd-56d9f1e05b1a admin admin] PATH_INFO: `/v3/users/fb697dc8e3b44aab83ecada44522f719` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:51.677568 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32dab9-d2c8-44d0-aecd-56d9f1e05b1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb697dc8e3b44aab83ecada44522f719)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:51.679826 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a32dab9-d2c8-44d0-aecd-56d9f1e05b1a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:51.682468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-40228446-f5e9-4932-bd65-3b3452a6116d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36ca2336765b4d94be30fed443a83198'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.699867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 903/1820] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:51 2022] DELETE /identity/v3/users/36ca2336765b4d94be30fed443a83198 => generated 0 bytes in 631 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:51.702975 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f20fe-1e35-470f-b473-6dc340212ec6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:51.703285 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f20fe-1e35-470f-b473-6dc340212ec6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:51.703571 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5f20fe-1e35-470f-b473-6dc340212ec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:51.708285 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:51.770711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4a32dab9-d2c8-44d0-aecd-56d9f1e05b1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb697dc8e3b44aab83ecada44522f719'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.785210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9a5f20fe-1e35-470f-b473-6dc340212ec6 None None] MFA Rules not processed for user `e856fd5aff914cfb8b8dd86b39c89bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:51.789511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9a5f20fe-1e35-470f-b473-6dc340212ec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:51.806336 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4a32dab9-d2c8-44d0-aecd-56d9f1e05b1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb697dc8e3b44aab83ecada44522f719'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.836788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4a32dab9-d2c8-44d0-aecd-56d9f1e05b1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb697dc8e3b44aab83ecada44522f719'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.838224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4a32dab9-d2c8-44d0-aecd-56d9f1e05b1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb697dc8e3b44aab83ecada44522f719'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.857477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4a32dab9-d2c8-44d0-aecd-56d9f1e05b1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb697dc8e3b44aab83ecada44522f719'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:51.881657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 918/1821] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:51 2022] DELETE /identity/v3/users/fb697dc8e3b44aab83ecada44522f719 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:51.885364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df9d10-0195-4fba-b8c0-c8b66d40e72d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:51.886244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df9d10-0195-4fba-b8c0-c8b66d40e72d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:51.886553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82df9d10-0195-4fba-b8c0-c8b66d40e72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:51.925835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-82df9d10-0195-4fba-b8c0-c8b66d40e72d None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:51.927171 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-82df9d10-0195-4fba-b8c0-c8b66d40e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:51.976186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:52.016937 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 904/1822] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 1 14:22:51 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:52.018421 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47babb1f-b20e-4c69-81d8-3769ac329640 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:52.018903 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47babb1f-b20e-4c69-81d8-3769ac329640 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:52.019422 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47babb1f-b20e-4c69-81d8-3769ac329640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:52.030186 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 919/1823] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:52.074346 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-47babb1f-b20e-4c69-81d8-3769ac329640 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:52.078070 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-47babb1f-b20e-4c69-81d8-3769ac329640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:52.102929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 905/1824] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:52.210057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df9d10-0195-4fba-b8c0-c8b66d40e72d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:52.211665 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-82df9d10-0195-4fba-b8c0-c8b66d40e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:52.362955 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47babb1f-b20e-4c69-81d8-3769ac329640 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:52.377483 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47babb1f-b20e-4c69-81d8-3769ac329640 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:52.388209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac2bc3-2433-4f15-b7ba-32161254647b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:52.389118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac2bc3-2433-4f15-b7ba-32161254647b service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:52.389557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac2bc3-2433-4f15-b7ba-32161254647b service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:52.390036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac2bc3-2433-4f15-b7ba-32161254647b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:52.390390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82df9d10-0195-4fba-b8c0-c8b66d40e72d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:52.420900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efab84-3ee1-46ab-bd20-a1755c773353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:52.421349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac2bc3-2433-4f15-b7ba-32161254647b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:52.421640 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efab84-3ee1-46ab-bd20-a1755c773353 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:52.421920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efab84-3ee1-46ab-bd20-a1755c773353 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:52.422200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08efab84-3ee1-46ab-bd20-a1755c773353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:52.424458 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ac2bc3-2433-4f15-b7ba-32161254647b service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:52.444869 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 906/1825] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:52.461651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efab84-3ee1-46ab-bd20-a1755c773353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:52.463184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08efab84-3ee1-46ab-bd20-a1755c773353 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:52.514930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 920/1826] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:52.597538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac2bc3-2433-4f15-b7ba-32161254647b service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:52.599210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-64ac2bc3-2433-4f15-b7ba-32161254647b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:52.619356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac2bc3-2433-4f15-b7ba-32161254647b service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:52.637196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86d8027-a464-4ad0-8c9a-c1c87069a6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:52.638106 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d8027-a464-4ad0-8c9a-c1c87069a6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:52.638900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d8027-a464-4ad0-8c9a-c1c87069a6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:52.638900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86d8027-a464-4ad0-8c9a-c1c87069a6fb admin admin] PATH_INFO: `/v3/projects/dfe87a9ef99e4651ae8eab45b46a8c8e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:52.640275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d8027-a464-4ad0-8c9a-c1c87069a6fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfe87a9ef99e4651ae8eab45b46a8c8e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:52.643431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86d8027-a464-4ad0-8c9a-c1c87069a6fb admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:52.792626 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c86d8027-a464-4ad0-8c9a-c1c87069a6fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfe87a9ef99e4651ae8eab45b46a8c8e', 'request_id': 'req-c86d8027-a464-4ad0-8c9a-c1c87069a6fb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:52.820483 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c86d8027-a464-4ad0-8c9a-c1c87069a6fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfe87a9ef99e4651ae8eab45b46a8c8e', 'request_id': 'req-c86d8027-a464-4ad0-8c9a-c1c87069a6fb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:52.833150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c86d8027-a464-4ad0-8c9a-c1c87069a6fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfe87a9ef99e4651ae8eab45b46a8c8e', 'request_id': 'req-c86d8027-a464-4ad0-8c9a-c1c87069a6fb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:52.882223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efab84-3ee1-46ab-bd20-a1755c773353 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:52.884764 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-08efab84-3ee1-46ab-bd20-a1755c773353 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:52.888636 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c86d8027-a464-4ad0-8c9a-c1c87069a6fb admin admin] The token cache is being invalidate because project dfe87a9ef99e4651ae8eab45b46a8c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:52.890107 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c86d8027-a464-4ad0-8c9a-c1c87069a6fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:52.890935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c86d8027-a464-4ad0-8c9a-c1c87069a6fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:52.899821 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 907/1827] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:52 2022] DELETE /identity/v3/projects/dfe87a9ef99e4651ae8eab45b46a8c8e => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:52.901132 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b370b-ddb4-4015-86d6-6cc784b684f5 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:52.901641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b370b-ddb4-4015-86d6-6cc784b684f5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:52.902026 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243b370b-ddb4-4015-86d6-6cc784b684f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:52.945169 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-243b370b-ddb4-4015-86d6-6cc784b684f5 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:52.946843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-243b370b-ddb4-4015-86d6-6cc784b684f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:53.033795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:53.084449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08efab84-3ee1-46ab-bd20-a1755c773353 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:53.109465 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 908/1828] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:53.111410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ebb25-137b-43b9-9c0c-1f06c1d4c2c4 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.111697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ebb25-137b-43b9-9c0c-1f06c1d4c2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.111974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88ebb25-137b-43b9-9c0c-1f06c1d4c2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.138984 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c88ebb25-137b-43b9-9c0c-1f06c1d4c2c4 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:53.140461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c88ebb25-137b-43b9-9c0c-1f06c1d4c2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:53.195770 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 909/1829] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:53.196840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ebb25-137b-43b9-9c0c-1f06c1d4c2c4 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:53.223054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88ebb25-137b-43b9-9c0c-1f06c1d4c2c4 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:53.240425 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374bba3-686f-4aca-967c-74acf34c05fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:53.241978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374bba3-686f-4aca-967c-74acf34c05fe admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.244003 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374bba3-686f-4aca-967c-74acf34c05fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.244385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374bba3-686f-4aca-967c-74acf34c05fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.246314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374bba3-686f-4aca-967c-74acf34c05fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:53.249133 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374bba3-686f-4aca-967c-74acf34c05fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:53.254130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374bba3-686f-4aca-967c-74acf34c05fe admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:53.299923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 910/1830] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:53.306114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374bba3-686f-4aca-967c-74acf34c05fe admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:53.309862 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fe5e1-bba0-4ea2-8cb7-6aa39c989d2d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:53.313588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fe5e1-bba0-4ea2-8cb7-6aa39c989d2d service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.314261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fe5e1-bba0-4ea2-8cb7-6aa39c989d2d service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.314555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136fe5e1-bba0-4ea2-8cb7-6aa39c989d2d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.322029 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374bba3-686f-4aca-967c-74acf34c05fe admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:53.323956 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-136fe5e1-bba0-4ea2-8cb7-6aa39c989d2d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:53.329165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d8705-c8f3-4c0a-80f6-609469cd4f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:53.330640 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d8705-c8f3-4c0a-80f6-609469cd4f45 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.331206 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d8705-c8f3-4c0a-80f6-609469cd4f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.332171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956d8705-c8f3-4c0a-80f6-609469cd4f45 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.332907 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d8705-c8f3-4c0a-80f6-609469cd4f45 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:53.336727 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956d8705-c8f3-4c0a-80f6-609469cd4f45 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:53.359160 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fe5e1-bba0-4ea2-8cb7-6aa39c989d2d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:53.361403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136fe5e1-bba0-4ea2-8cb7-6aa39c989d2d service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:53.385290 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 921/1831] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:53.413835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 911/1832] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:53 2022] POST /identity/v3/projects => generated 371 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:53.418272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fe5e1-bba0-4ea2-8cb7-6aa39c989d2d service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:53.437671 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136fe5e1-bba0-4ea2-8cb7-6aa39c989d2d service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:53.528851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d8705-c8f3-4c0a-80f6-609469cd4f45 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:53.531957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-956d8705-c8f3-4c0a-80f6-609469cd4f45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:53.598516 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:53.617602 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca69a2-7559-434f-a350-971dd7850817 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:53.618404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca69a2-7559-434f-a350-971dd7850817 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.618815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca69a2-7559-434f-a350-971dd7850817 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.619284 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ca69a2-7559-434f-a350-971dd7850817 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.620185 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca69a2-7559-434f-a350-971dd7850817 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:53.622346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ca69a2-7559-434f-a350-971dd7850817 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:53.697514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 922/1833] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:53 2022] POST /identity/v3/users => generated 286 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:53.700619 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca69a2-7559-434f-a350-971dd7850817 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:53.720078 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ca69a2-7559-434f-a350-971dd7850817 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:53.731389 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0970e7-fec4-4a4f-bc24-c9d6a54c1412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:53.735378 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0970e7-fec4-4a4f-bc24-c9d6a54c1412 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.735378 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0970e7-fec4-4a4f-bc24-c9d6a54c1412 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.735378 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0970e7-fec4-4a4f-bc24-c9d6a54c1412 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.737227 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0970e7-fec4-4a4f-bc24-c9d6a54c1412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:53.742971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0970e7-fec4-4a4f-bc24-c9d6a54c1412 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:53.760171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956d8705-c8f3-4c0a-80f6-609469cd4f45 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:53.765328 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 923/1834] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:53.772895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0970e7-fec4-4a4f-bc24-c9d6a54c1412 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:53.780370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617578a-400f-43d8-a309-81c98bf4ed21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:53.782267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617578a-400f-43d8-a309-81c98bf4ed21 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.782691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617578a-400f-43d8-a309-81c98bf4ed21 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.782984 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617578a-400f-43d8-a309-81c98bf4ed21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.791683 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0617578a-400f-43d8-a309-81c98bf4ed21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:53.807136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0970e7-fec4-4a4f-bc24-c9d6a54c1412 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:53.823982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957b8ca-9984-4973-a768-cfe70e8c055f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:53.824633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957b8ca-9984-4973-a768-cfe70e8c055f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.824921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957b8ca-9984-4973-a768-cfe70e8c055f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.826360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1957b8ca-9984-4973-a768-cfe70e8c055f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.839333 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957b8ca-9984-4973-a768-cfe70e8c055f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:53.839417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617578a-400f-43d8-a309-81c98bf4ed21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:53.839417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617578a-400f-43d8-a309-81c98bf4ed21 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:53.839944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1957b8ca-9984-4973-a768-cfe70e8c055f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:53.869689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 924/1835] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:53 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:53.870651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957b8ca-9984-4973-a768-cfe70e8c055f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:53.871898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 912/1836] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:53 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:53.884666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1957b8ca-9984-4973-a768-cfe70e8c055f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:53.890021 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adcec2-7f97-4a5a-98e6-ccfe81bf12dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:53.891039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adcec2-7f97-4a5a-98e6-ccfe81bf12dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.891393 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adcec2-7f97-4a5a-98e6-ccfe81bf12dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.891778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14adcec2-7f97-4a5a-98e6-ccfe81bf12dd admin admin] PATH_INFO: `/v3/projects/d29153d0f4d3429a9ea80364f11c0b90/users/ea1ddc41c94e4f789e0afe5d3ed3d419/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.916555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adcec2-7f97-4a5a-98e6-ccfe81bf12dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29153d0f4d3429a9ea80364f11c0b90, user_id=ea1ddc41c94e4f789e0afe5d3ed3d419, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:53.920216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14adcec2-7f97-4a5a-98e6-ccfe81bf12dd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:53.959581 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcc683-3a53-4f2e-8504-f90873ae962f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:53.961344 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcc683-3a53-4f2e-8504-f90873ae962f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:53.961849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bcc683-3a53-4f2e-8504-f90873ae962f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:53.965489 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 925/1837] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:53 2022] PUT /identity/v3/projects/d29153d0f4d3429a9ea80364f11c0b90/users/ea1ddc41c94e4f789e0afe5d3ed3d419/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:53.990989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-17bcc683-3a53-4f2e-8504-f90873ae962f None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:53.992529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-17bcc683-3a53-4f2e-8504-f90873ae962f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:54.078069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adcec2-7f97-4a5a-98e6-ccfe81bf12dd admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:54.080721 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-14adcec2-7f97-4a5a-98e6-ccfe81bf12dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:54.116884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:54.198027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 913/1838] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:54.324441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14adcec2-7f97-4a5a-98e6-ccfe81bf12dd admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:54.326929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcc683-3a53-4f2e-8504-f90873ae962f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:54.329161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-17bcc683-3a53-4f2e-8504-f90873ae962f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:54.333569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243a8fc-1cfc-486d-9141-09192f161ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:54.334714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243a8fc-1cfc-486d-9141-09192f161ac0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:54.335264 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243a8fc-1cfc-486d-9141-09192f161ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:54.335722 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8243a8fc-1cfc-486d-9141-09192f161ac0 admin admin] PATH_INFO: `/v3/projects/4f0c20720fd842b6ba4fc4a171a03bdf` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:54.339994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243a8fc-1cfc-486d-9141-09192f161ac0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f0c20720fd842b6ba4fc4a171a03bdf)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:54.342904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8243a8fc-1cfc-486d-9141-09192f161ac0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:54.441360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8243a8fc-1cfc-486d-9141-09192f161ac0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f0c20720fd842b6ba4fc4a171a03bdf', 'request_id': 'req-8243a8fc-1cfc-486d-9141-09192f161ac0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.454224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8243a8fc-1cfc-486d-9141-09192f161ac0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f0c20720fd842b6ba4fc4a171a03bdf', 'request_id': 'req-8243a8fc-1cfc-486d-9141-09192f161ac0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.477780 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8243a8fc-1cfc-486d-9141-09192f161ac0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f0c20720fd842b6ba4fc4a171a03bdf', 'request_id': 'req-8243a8fc-1cfc-486d-9141-09192f161ac0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.486829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bcc683-3a53-4f2e-8504-f90873ae962f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:54.513320 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8243a8fc-1cfc-486d-9141-09192f161ac0 admin admin] The token cache is being invalidate because project 4f0c20720fd842b6ba4fc4a171a03bdf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:54.513618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8243a8fc-1cfc-486d-9141-09192f161ac0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.514323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8243a8fc-1cfc-486d-9141-09192f161ac0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.516792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 926/1839] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:54 2022] DELETE /identity/v3/projects/4f0c20720fd842b6ba4fc4a171a03bdf => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:54.518021 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243a8fc-1cfc-486d-9141-09192f161ac0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:54.519452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8243a8fc-1cfc-486d-9141-09192f161ac0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:54.602976 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b16f6-647e-427a-a5ad-129afbcadfbe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:54.604688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b16f6-647e-427a-a5ad-129afbcadfbe service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:54.605084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b16f6-647e-427a-a5ad-129afbcadfbe service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:54.605547 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b16f6-647e-427a-a5ad-129afbcadfbe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:54.608583 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7d2b16f6-647e-427a-a5ad-129afbcadfbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:54.617482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:54.639853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8243a8fc-1cfc-486d-9141-09192f161ac0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:54.648288 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fc31ed-d964-45a6-a29a-288ce55db7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:54.649912 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc31ed-d964-45a6-a29a-288ce55db7d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:54.650351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc31ed-d964-45a6-a29a-288ce55db7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:54.650822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fc31ed-d964-45a6-a29a-288ce55db7d4 admin admin] PATH_INFO: `/v3/projects/22adb0478ee24426a0d2a1cc9603d82b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:54.652346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc31ed-d964-45a6-a29a-288ce55db7d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=22adb0478ee24426a0d2a1cc9603d82b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:54.655311 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fc31ed-d964-45a6-a29a-288ce55db7d4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:54.707811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b16f6-647e-427a-a5ad-129afbcadfbe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:54.709881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b16f6-647e-427a-a5ad-129afbcadfbe service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:54.733019 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:54.735700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 914/1840] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:54.738716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b16f6-647e-427a-a5ad-129afbcadfbe service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:54.740115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7d2b16f6-647e-427a-a5ad-129afbcadfbe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:54.741296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e1fc31ed-d964-45a6-a29a-288ce55db7d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22adb0478ee24426a0d2a1cc9603d82b', 'request_id': 'req-e1fc31ed-d964-45a6-a29a-288ce55db7d4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.749751 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e1fc31ed-d964-45a6-a29a-288ce55db7d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22adb0478ee24426a0d2a1cc9603d82b', 'request_id': 'req-e1fc31ed-d964-45a6-a29a-288ce55db7d4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.752784 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b16f6-647e-427a-a5ad-129afbcadfbe service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:54.758264 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e1fc31ed-d964-45a6-a29a-288ce55db7d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22adb0478ee24426a0d2a1cc9603d82b', 'request_id': 'req-e1fc31ed-d964-45a6-a29a-288ce55db7d4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.775937 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e1fc31ed-d964-45a6-a29a-288ce55db7d4 admin admin] The token cache is being invalidate because project 22adb0478ee24426a0d2a1cc9603d82b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:54.776284 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e1fc31ed-d964-45a6-a29a-288ce55db7d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.776946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e1fc31ed-d964-45a6-a29a-288ce55db7d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.779132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 927/1841] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:54 2022] DELETE /identity/v3/projects/22adb0478ee24426a0d2a1cc9603d82b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:54.785680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e3fd4-938d-42fb-9f8f-d1e4a5561b88 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:54.786222 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e3fd4-938d-42fb-9f8f-d1e4a5561b88 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:54.786728 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540e3fd4-938d-42fb-9f8f-d1e4a5561b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:54.815439 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-540e3fd4-938d-42fb-9f8f-d1e4a5561b88 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:54.816694 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-540e3fd4-938d-42fb-9f8f-d1e4a5561b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:54.830512 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c0edb-b535-449a-bf78-2d03d0425d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:54.831173 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c0edb-b535-449a-bf78-2d03d0425d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:54.831452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c0edb-b535-449a-bf78-2d03d0425d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:54.831723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32c0edb-b535-449a-bf78-2d03d0425d48 admin admin] PATH_INFO: `/v3/users/944a8215d76b49deafdd1f06d8b12f4b` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:54.832897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c0edb-b535-449a-bf78-2d03d0425d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=944a8215d76b49deafdd1f06d8b12f4b)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:54.834958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32c0edb-b535-449a-bf78-2d03d0425d48 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:54.891079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 928/1842] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:54.898694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a32c0edb-b535-449a-bf78-2d03d0425d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '944a8215d76b49deafdd1f06d8b12f4b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.900787 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e372a22-a04f-4a93-99ae-19e207fc7c05 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:54.901238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e372a22-a04f-4a93-99ae-19e207fc7c05 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:54.901679 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e372a22-a04f-4a93-99ae-19e207fc7c05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:54.913026 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a32c0edb-b535-449a-bf78-2d03d0425d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '944a8215d76b49deafdd1f06d8b12f4b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.926569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5e372a22-a04f-4a93-99ae-19e207fc7c05 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:54.927766 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5e372a22-a04f-4a93-99ae-19e207fc7c05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:54.929742 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a32c0edb-b535-449a-bf78-2d03d0425d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '944a8215d76b49deafdd1f06d8b12f4b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.930470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a32c0edb-b535-449a-bf78-2d03d0425d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '944a8215d76b49deafdd1f06d8b12f4b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.940099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 929/1843] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:54.940302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a32c0edb-b535-449a-bf78-2d03d0425d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '944a8215d76b49deafdd1f06d8b12f4b'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:54.940992 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e372a22-a04f-4a93-99ae-19e207fc7c05 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:54.950111 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e372a22-a04f-4a93-99ae-19e207fc7c05 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:54.961522 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 915/1844] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:54 2022] DELETE /identity/v3/users/944a8215d76b49deafdd1f06d8b12f4b => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:55.021354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fd8a3-b803-47dd-bfca-c91fd92db511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:55.022407 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd8a3-b803-47dd-bfca-c91fd92db511 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.022668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd8a3-b803-47dd-bfca-c91fd92db511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.023626 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77fd8a3-b803-47dd-bfca-c91fd92db511 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.023922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fd8a3-b803-47dd-bfca-c91fd92db511 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:55.024228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fd8a3-b803-47dd-bfca-c91fd92db511 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:55.025924 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77fd8a3-b803-47dd-bfca-c91fd92db511 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:55.046217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 930/1845] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:22:55.046535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c0edb-b535-449a-bf78-2d03d0425d48 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:55.059341 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32c0edb-b535-449a-bf78-2d03d0425d48 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:55.068094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24212e-64d1-4a96-9566-a93aeea23826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:55.068812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24212e-64d1-4a96-9566-a93aeea23826 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.069102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24212e-64d1-4a96-9566-a93aeea23826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.072434 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a24212e-64d1-4a96-9566-a93aeea23826 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.072434 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24212e-64d1-4a96-9566-a93aeea23826 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:55.073759 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a24212e-64d1-4a96-9566-a93aeea23826 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:55.108915 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:55.132971 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 916/1846] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:55 2022] POST /identity/v3/projects => generated 361 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:55.134396 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fd8a3-b803-47dd-bfca-c91fd92db511 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:55.150545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77fd8a3-b803-47dd-bfca-c91fd92db511 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:55.249316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:55.259506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec39b4-803d-4fea-9cbc-e15a678ff8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:55.261211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec39b4-803d-4fea-9cbc-e15a678ff8f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.263126 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec39b4-803d-4fea-9cbc-e15a678ff8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.263301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec39b4-803d-4fea-9cbc-e15a678ff8f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.265978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec39b4-803d-4fea-9cbc-e15a678ff8f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:55.269561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fec39b4-803d-4fea-9cbc-e15a678ff8f8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:55.299265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 931/1847] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:55 2022] POST /identity/v3/users => generated 281 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:55.302896 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24212e-64d1-4a96-9566-a93aeea23826 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:55.322149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a24212e-64d1-4a96-9566-a93aeea23826 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:55.336260 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5a37a-8c36-4214-b0f5-23e132c86fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:55.339932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5a37a-8c36-4214-b0f5-23e132c86fde admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.339932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5a37a-8c36-4214-b0f5-23e132c86fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.340745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5a37a-8c36-4214-b0f5-23e132c86fde admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.341744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5a37a-8c36-4214-b0f5-23e132c86fde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:55.343828 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5a37a-8c36-4214-b0f5-23e132c86fde admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:55.360332 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 917/1848] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:55.364026 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec39b4-803d-4fea-9cbc-e15a678ff8f8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:55.375404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec39b4-803d-4fea-9cbc-e15a678ff8f8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:55.382403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab8c7-5b5d-465f-9882-a054fe28ab6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:55.383109 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab8c7-5b5d-465f-9882-a054fe28ab6b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.383394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab8c7-5b5d-465f-9882-a054fe28ab6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.383717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806ab8c7-5b5d-465f-9882-a054fe28ab6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.384422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ab8c7-5b5d-465f-9882-a054fe28ab6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:55.386077 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806ab8c7-5b5d-465f-9882-a054fe28ab6b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:55.407502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 932/1849] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:55.408970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5a37a-8c36-4214-b0f5-23e132c86fde admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:55.421283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5a37a-8c36-4214-b0f5-23e132c86fde admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:55.426801 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3697aae8-9c11-46cd-8adc-749b0664b662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:55.427528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697aae8-9c11-46cd-8adc-749b0664b662 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.427811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697aae8-9c11-46cd-8adc-749b0664b662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.428090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3697aae8-9c11-46cd-8adc-749b0664b662 admin admin] PATH_INFO: `/v3/projects/3ecb8b0453e94b268c289e1776033a11/users/a5719841584843ab9d88cbca5a2f43ea/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.435697 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab8c7-5b5d-465f-9882-a054fe28ab6b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:55.437471 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-806ab8c7-5b5d-465f-9882-a054fe28ab6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:55.449202 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697aae8-9c11-46cd-8adc-749b0664b662 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ecb8b0453e94b268c289e1776033a11, user_id=a5719841584843ab9d88cbca5a2f43ea, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:55.452497 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3697aae8-9c11-46cd-8adc-749b0664b662 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:55.454226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806ab8c7-5b5d-465f-9882-a054fe28ab6b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:55.461849 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d335204d-b53d-4e93-b515-ba767bfa5331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:55.462657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335204d-b53d-4e93-b515-ba767bfa5331 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.463058 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335204d-b53d-4e93-b515-ba767bfa5331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.463383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d335204d-b53d-4e93-b515-ba767bfa5331 admin admin] PATH_INFO: `/v3/projects/c63eda13b7e34f099e70f2e8e8cfe767` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.464731 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335204d-b53d-4e93-b515-ba767bfa5331 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63eda13b7e34f099e70f2e8e8cfe767)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:55.469318 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d335204d-b53d-4e93-b515-ba767bfa5331 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:55.471965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 918/1850] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:55 2022] PUT /identity/v3/projects/3ecb8b0453e94b268c289e1776033a11/users/a5719841584843ab9d88cbca5a2f43ea/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:55.505058 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fa85e-c969-4777-b19d-de34bc1cec63 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.505396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fa85e-c969-4777-b19d-de34bc1cec63 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.505684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0fa85e-c969-4777-b19d-de34bc1cec63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.552149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d335204d-b53d-4e93-b515-ba767bfa5331 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63eda13b7e34f099e70f2e8e8cfe767', 'request_id': 'req-d335204d-b53d-4e93-b515-ba767bfa5331'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:55.561361 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d335204d-b53d-4e93-b515-ba767bfa5331 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63eda13b7e34f099e70f2e8e8cfe767', 'request_id': 'req-d335204d-b53d-4e93-b515-ba767bfa5331'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:55.571024 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d335204d-b53d-4e93-b515-ba767bfa5331 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63eda13b7e34f099e70f2e8e8cfe767', 'request_id': 'req-d335204d-b53d-4e93-b515-ba767bfa5331'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:55.592667 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d335204d-b53d-4e93-b515-ba767bfa5331 admin admin] The token cache is being invalidate because project c63eda13b7e34f099e70f2e8e8cfe767 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:55.593978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d335204d-b53d-4e93-b515-ba767bfa5331 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:55.595740 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d335204d-b53d-4e93-b515-ba767bfa5331 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:55.596570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-5a0fa85e-c969-4777-b19d-de34bc1cec63 None None] MFA Rules not processed for user `a5719841584843ab9d88cbca5a2f43ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:55.598625 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5a0fa85e-c969-4777-b19d-de34bc1cec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:55.600236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 933/1851] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:55 2022] DELETE /identity/v3/projects/c63eda13b7e34f099e70f2e8e8cfe767 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:55.605399 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdf930-b4a3-4612-8843-600d0b86a1af None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.606002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdf930-b4a3-4612-8843-600d0b86a1af None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.607153 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbdf930-b4a3-4612-8843-600d0b86a1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.635327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ecbdf930-b4a3-4612-8843-600d0b86a1af None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:55.637125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ecbdf930-b4a3-4612-8843-600d0b86a1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:55.748935 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 934/1852] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:55.756453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db610187-5f8f-43cc-86c4-6e0d41f0a6a5 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.756747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db610187-5f8f-43cc-86c4-6e0d41f0a6a5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.757595 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db610187-5f8f-43cc-86c4-6e0d41f0a6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.816616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 919/1853] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:55 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 318 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:55.830875 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-db610187-5f8f-43cc-86c4-6e0d41f0a6a5 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:55.832717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-db610187-5f8f-43cc-86c4-6e0d41f0a6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:55.852711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fa85e-c969-4777-b19d-de34bc1cec63 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:55.854285 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5a0fa85e-c969-4777-b19d-de34bc1cec63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:55.875426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 935/1854] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:55.879670 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db610187-5f8f-43cc-86c4-6e0d41f0a6a5 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:55.892890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db610187-5f8f-43cc-86c4-6e0d41f0a6a5 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:55.913859 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128b6a-ce18-4105-8965-8ab64c1f3695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:55.914489 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128b6a-ce18-4105-8965-8ab64c1f3695 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.915073 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128b6a-ce18-4105-8965-8ab64c1f3695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.915349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a128b6a-ce18-4105-8965-8ab64c1f3695 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.916055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a128b6a-ce18-4105-8965-8ab64c1f3695 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:55.916364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a128b6a-ce18-4105-8965-8ab64c1f3695 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:55.917981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a128b6a-ce18-4105-8965-8ab64c1f3695 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:55.933245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0fa85e-c969-4777-b19d-de34bc1cec63 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:55.938229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791a679-1f00-4e9b-bff4-f65e7a8b7b22 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:55.939653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791a679-1f00-4e9b-bff4-f65e7a8b7b22 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:55.940035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791a679-1f00-4e9b-bff4-f65e7a8b7b22 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:55.940598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a791a679-1f00-4e9b-bff4-f65e7a8b7b22 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:55.947414 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 936/1855] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:22:55.952514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128b6a-ce18-4105-8965-8ab64c1f3695 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:55.953582 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791a679-1f00-4e9b-bff4-f65e7a8b7b22 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:55.956188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a791a679-1f00-4e9b-bff4-f65e7a8b7b22 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:55.971731 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 920/1856] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:55 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:55.981093 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a128b6a-ce18-4105-8965-8ab64c1f3695 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:56.001934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791a679-1f00-4e9b-bff4-f65e7a8b7b22 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:56.003989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238245d-9b5e-49ee-bc75-31ef746c8692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:56.004630 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238245d-9b5e-49ee-bc75-31ef746c8692 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.004915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238245d-9b5e-49ee-bc75-31ef746c8692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.005192 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d238245d-9b5e-49ee-bc75-31ef746c8692 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.005863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238245d-9b5e-49ee-bc75-31ef746c8692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:56.007821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d238245d-9b5e-49ee-bc75-31ef746c8692 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:56.009615 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a791a679-1f00-4e9b-bff4-f65e7a8b7b22 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:56.032093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a791a679-1f00-4e9b-bff4-f65e7a8b7b22 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:56.039810 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4831952-af2c-48b6-ae3e-7b1ba85a6878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:56.040555 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831952-af2c-48b6-ae3e-7b1ba85a6878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.040915 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831952-af2c-48b6-ae3e-7b1ba85a6878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.041993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4831952-af2c-48b6-ae3e-7b1ba85a6878 admin admin] PATH_INFO: `/v3/users/a5719841584843ab9d88cbca5a2f43ea` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.043302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4831952-af2c-48b6-ae3e-7b1ba85a6878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5719841584843ab9d88cbca5a2f43ea)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:56.045223 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4831952-af2c-48b6-ae3e-7b1ba85a6878 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:56.056679 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 937/1857] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:55 2022] POST /identity/v3/projects => generated 367 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:56.061514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238245d-9b5e-49ee-bc75-31ef746c8692 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:56.111724 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:56.191427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d238245d-9b5e-49ee-bc75-31ef746c8692 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:56.199490 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8438f22-b6d4-4ea3-9d33-27b8306a747b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:56.200016 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8438f22-b6d4-4ea3-9d33-27b8306a747b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.200317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8438f22-b6d4-4ea3-9d33-27b8306a747b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.200949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8438f22-b6d4-4ea3-9d33-27b8306a747b admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.201517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8438f22-b6d4-4ea3-9d33-27b8306a747b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:56.203687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8438f22-b6d4-4ea3-9d33-27b8306a747b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:56.207030 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c4831952-af2c-48b6-ae3e-7b1ba85a6878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5719841584843ab9d88cbca5a2f43ea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:56.221316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:56.233033 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c4831952-af2c-48b6-ae3e-7b1ba85a6878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5719841584843ab9d88cbca5a2f43ea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:56.259922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 938/1858] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:56 2022] POST /identity/v3/users => generated 284 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:56.266479 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8438f22-b6d4-4ea3-9d33-27b8306a747b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:56.269908 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c4831952-af2c-48b6-ae3e-7b1ba85a6878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5719841584843ab9d88cbca5a2f43ea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:56.271744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c4831952-af2c-48b6-ae3e-7b1ba85a6878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5719841584843ab9d88cbca5a2f43ea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:56.285614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c4831952-af2c-48b6-ae3e-7b1ba85a6878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5719841584843ab9d88cbca5a2f43ea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:56.291366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8438f22-b6d4-4ea3-9d33-27b8306a747b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:56.302724 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06699d44-4eaf-4a39-b50a-48dd8b26eb80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:56.303357 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06699d44-4eaf-4a39-b50a-48dd8b26eb80 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.303639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06699d44-4eaf-4a39-b50a-48dd8b26eb80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.303922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06699d44-4eaf-4a39-b50a-48dd8b26eb80 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.304622 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06699d44-4eaf-4a39-b50a-48dd8b26eb80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:56.311765 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06699d44-4eaf-4a39-b50a-48dd8b26eb80 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:56.315098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 921/1859] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:55 2022] DELETE /identity/v3/users/a5719841584843ab9d88cbca5a2f43ea => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:56.319107 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c54b9-5e44-4eef-b062-8255365d1a26 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.319641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c54b9-5e44-4eef-b062-8255365d1a26 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.320156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8c54b9-5e44-4eef-b062-8255365d1a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.343945 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 939/1860] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:56.349028 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06699d44-4eaf-4a39-b50a-48dd8b26eb80 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:56.351478 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-06699d44-4eaf-4a39-b50a-48dd8b26eb80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:56.361006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0d8c54b9-5e44-4eef-b062-8255365d1a26 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:56.362473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0d8c54b9-5e44-4eef-b062-8255365d1a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:56.386764 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06699d44-4eaf-4a39-b50a-48dd8b26eb80 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:56.470530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 922/1861] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:56.471916 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fe6cb-b206-4911-b6b5-9fc917c94626 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.472111 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fe6cb-b206-4911-b6b5-9fc917c94626 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.472533 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76fe6cb-b206-4911-b6b5-9fc917c94626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.495007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398b40b-e200-40d2-b929-dc215223d66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:56.495878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b40b-e200-40d2-b929-dc215223d66a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.496233 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b40b-e200-40d2-b929-dc215223d66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.496815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b40b-e200-40d2-b929-dc215223d66a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.497601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398b40b-e200-40d2-b929-dc215223d66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:56.499710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398b40b-e200-40d2-b929-dc215223d66a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:56.519259 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 940/1862] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:56 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:56.520363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398b40b-e200-40d2-b929-dc215223d66a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:56.521440 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f76fe6cb-b206-4911-b6b5-9fc917c94626 None None] MFA Rules not processed for user `ea1ddc41c94e4f789e0afe5d3ed3d419`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:56.522588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d398b40b-e200-40d2-b929-dc215223d66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:56.522717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f76fe6cb-b206-4911-b6b5-9fc917c94626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:56.610815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398b40b-e200-40d2-b929-dc215223d66a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:56.620709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48222250-72a9-4b22-b759-1aac71bce8ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:56.620897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 923/1863] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:56 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:56.621015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48222250-72a9-4b22-b759-1aac71bce8ee service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.621124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fe6cb-b206-4911-b6b5-9fc917c94626 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:56.621219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48222250-72a9-4b22-b759-1aac71bce8ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.621219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48222250-72a9-4b22-b759-1aac71bce8ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.630443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76fe6cb-b206-4911-b6b5-9fc917c94626 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:56.634639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48222250-72a9-4b22-b759-1aac71bce8ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:56.636232 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098d133-e3bd-4a44-af96-1ddbd9c49d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:56.636644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48222250-72a9-4b22-b759-1aac71bce8ee service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:56.636912 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098d133-e3bd-4a44-af96-1ddbd9c49d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.637191 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098d133-e3bd-4a44-af96-1ddbd9c49d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.637462 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098d133-e3bd-4a44-af96-1ddbd9c49d3f admin admin] PATH_INFO: `/v3/projects/5791cb3a1731470d954567262c4f1cee/users/1d9fa3b384f94b5aa507ce5279fcb211/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.651270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 941/1864] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:56.661025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48222250-72a9-4b22-b759-1aac71bce8ee service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:56.661843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098d133-e3bd-4a44-af96-1ddbd9c49d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5791cb3a1731470d954567262c4f1cee, user_id=1d9fa3b384f94b5aa507ce5279fcb211, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:56.663625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-48222250-72a9-4b22-b759-1aac71bce8ee service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:56.664835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098d133-e3bd-4a44-af96-1ddbd9c49d3f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:56.685804 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 924/1865] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:56 2022] PUT /identity/v3/projects/5791cb3a1731470d954567262c4f1cee/users/1d9fa3b384f94b5aa507ce5279fcb211/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:56.699146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b60e2-6537-43be-9431-02b4d426a4e7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.699483 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b60e2-6537-43be-9431-02b4d426a4e7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.700514 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6b60e2-6537-43be-9431-02b4d426a4e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.705195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48222250-72a9-4b22-b759-1aac71bce8ee service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:56.777536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-fe6b60e2-6537-43be-9431-02b4d426a4e7 None None] MFA Rules not processed for user `1d9fa3b384f94b5aa507ce5279fcb211`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:56.778900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fe6b60e2-6537-43be-9431-02b4d426a4e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:56.779305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:56.816745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb47e96-bf61-4325-a0f1-88925daf942e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:56.817374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb47e96-bf61-4325-a0f1-88925daf942e admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.817724 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb47e96-bf61-4325-a0f1-88925daf942e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.818077 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb47e96-bf61-4325-a0f1-88925daf942e admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.819057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb47e96-bf61-4325-a0f1-88925daf942e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:56.821724 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb47e96-bf61-4325-a0f1-88925daf942e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:56.831500 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:56.870394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 942/1866] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:56 2022] POST /identity/v3/projects => generated 373 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:56.871686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb47e96-bf61-4325-a0f1-88925daf942e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:56.907046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 925/1867] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:56 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:22:56.911568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b60e2-6537-43be-9431-02b4d426a4e7 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:56.924685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6b60e2-6537-43be-9431-02b4d426a4e7 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:56.960396 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb47e96-bf61-4325-a0f1-88925daf942e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:56.967012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d9f33-9b2f-412d-8edd-4bd920b84d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:56.967752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9f33-9b2f-412d-8edd-4bd920b84d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:56.968075 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9f33-9b2f-412d-8edd-4bd920b84d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:56.969313 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45d9f33-9b2f-412d-8edd-4bd920b84d99 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:56.969313 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d9f33-9b2f-412d-8edd-4bd920b84d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:56.972480 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45d9f33-9b2f-412d-8edd-4bd920b84d99 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:57.021830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 943/1868] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:56 2022] POST /identity/v3/users => generated 293 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:57.024813 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc7146-14f5-4487-961f-e65e147bc12c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:57.025726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d9f33-9b2f-412d-8edd-4bd920b84d99 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:57.026545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc7146-14f5-4487-961f-e65e147bc12c admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.027094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc7146-14f5-4487-961f-e65e147bc12c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.027371 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bc7146-14f5-4487-961f-e65e147bc12c admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.028039 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc7146-14f5-4487-961f-e65e147bc12c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:57.030251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bc7146-14f5-4487-961f-e65e147bc12c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:57.044474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45d9f33-9b2f-412d-8edd-4bd920b84d99 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:57.052985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7660f-30bb-4833-b7d1-be0eff4947c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:57.054404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7660f-30bb-4833-b7d1-be0eff4947c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.055014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7660f-30bb-4833-b7d1-be0eff4947c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.055306 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e7660f-30bb-4833-b7d1-be0eff4947c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.056255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7660f-30bb-4833-b7d1-be0eff4947c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:57.058152 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e7660f-30bb-4833-b7d1-be0eff4947c7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:57.070612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 944/1869] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:57.070789 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 926/1870] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:56 2022] POST /identity/v3/projects => generated 367 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:57.074510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7660f-30bb-4833-b7d1-be0eff4947c7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:57.074851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc7146-14f5-4487-961f-e65e147bc12c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:57.086420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e7660f-30bb-4833-b7d1-be0eff4947c7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:57.150534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bc7146-14f5-4487-961f-e65e147bc12c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:57.155345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185666d-8aec-408d-ae16-f36872261b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:57.156024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185666d-8aec-408d-ae16-f36872261b2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.156304 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185666d-8aec-408d-ae16-f36872261b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.156579 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0185666d-8aec-408d-ae16-f36872261b2b admin admin] PATH_INFO: `/v3/projects/95cd143af9214116a9c8f47f836db570/users/9b2f968dd3b0459695bf280ef849c839/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.172119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185666d-8aec-408d-ae16-f36872261b2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cd143af9214116a9c8f47f836db570, user_id=9b2f968dd3b0459695bf280ef849c839, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:57.173037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7397f-c6aa-4373-a39d-afaaf50b7f6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:57.173657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7397f-c6aa-4373-a39d-afaaf50b7f6e admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.174096 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7397f-c6aa-4373-a39d-afaaf50b7f6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.174378 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e7397f-c6aa-4373-a39d-afaaf50b7f6e admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.174857 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0185666d-8aec-408d-ae16-f36872261b2b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:57.175069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7397f-c6aa-4373-a39d-afaaf50b7f6e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:57.176958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e7397f-c6aa-4373-a39d-afaaf50b7f6e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:57.188873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 927/1871] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:57 2022] PUT /identity/v3/projects/95cd143af9214116a9c8f47f836db570/users/9b2f968dd3b0459695bf280ef849c839/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:57.189686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185666d-8aec-408d-ae16-f36872261b2b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:57.191322 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0185666d-8aec-408d-ae16-f36872261b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:57.202807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 945/1872] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:57 2022] POST /identity/v3/users => generated 290 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:57.205071 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7397f-c6aa-4373-a39d-afaaf50b7f6e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:57.214983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e7397f-c6aa-4373-a39d-afaaf50b7f6e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:57.232918 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:57.241473 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:57.264628 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0185666d-8aec-408d-ae16-f36872261b2b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:57.270080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46467546-2fe5-43ae-86f9-6bf316274e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:57.270872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46467546-2fe5-43ae-86f9-6bf316274e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.271156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46467546-2fe5-43ae-86f9-6bf316274e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.271452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46467546-2fe5-43ae-86f9-6bf316274e6a admin admin] PATH_INFO: `/v3/projects/3ecb8b0453e94b268c289e1776033a11` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.272571 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46467546-2fe5-43ae-86f9-6bf316274e6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ecb8b0453e94b268c289e1776033a11)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:57.273016 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f87e0d-c577-486b-a67f-fd388137b9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:57.273633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f87e0d-c577-486b-a67f-fd388137b9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.273910 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f87e0d-c577-486b-a67f-fd388137b9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.274181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f87e0d-c577-486b-a67f-fd388137b9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.274494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46467546-2fe5-43ae-86f9-6bf316274e6a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:57.274921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f87e0d-c577-486b-a67f-fd388137b9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:57.276483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f87e0d-c577-486b-a67f-fd388137b9f5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:57.287772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 946/1873] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:57.288665 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f87e0d-c577-486b-a67f-fd388137b9f5 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:57.298249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f87e0d-c577-486b-a67f-fd388137b9f5 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:57.302988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68627b-d241-4b29-8e6a-51ed42ec936f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:57.303602 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68627b-d241-4b29-8e6a-51ed42ec936f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.303902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68627b-d241-4b29-8e6a-51ed42ec936f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.304235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad68627b-d241-4b29-8e6a-51ed42ec936f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.304936 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68627b-d241-4b29-8e6a-51ed42ec936f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:57.306646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad68627b-d241-4b29-8e6a-51ed42ec936f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:57.317333 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 947/1874] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:57.318129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68627b-d241-4b29-8e6a-51ed42ec936f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:57.324504 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-46467546-2fe5-43ae-86f9-6bf316274e6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ecb8b0453e94b268c289e1776033a11', 'request_id': 'req-46467546-2fe5-43ae-86f9-6bf316274e6a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:57.327629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad68627b-d241-4b29-8e6a-51ed42ec936f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:57.331038 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-46467546-2fe5-43ae-86f9-6bf316274e6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ecb8b0453e94b268c289e1776033a11', 'request_id': 'req-46467546-2fe5-43ae-86f9-6bf316274e6a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:57.339627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-46467546-2fe5-43ae-86f9-6bf316274e6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ecb8b0453e94b268c289e1776033a11', 'request_id': 'req-46467546-2fe5-43ae-86f9-6bf316274e6a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:57.351901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-46467546-2fe5-43ae-86f9-6bf316274e6a admin admin] The token cache is being invalidate because project 3ecb8b0453e94b268c289e1776033a11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:22:57.352192 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-46467546-2fe5-43ae-86f9-6bf316274e6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:57.352830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-46467546-2fe5-43ae-86f9-6bf316274e6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:57.354551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 928/1875] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:22:57 2022] DELETE /identity/v3/projects/3ecb8b0453e94b268c289e1776033a11 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:57.358455 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46467546-2fe5-43ae-86f9-6bf316274e6a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:57.360011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-46467546-2fe5-43ae-86f9-6bf316274e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:57.395048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22000351-0a54-4f4b-8fb0-b350c7897bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:57.395941 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22000351-0a54-4f4b-8fb0-b350c7897bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.396222 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22000351-0a54-4f4b-8fb0-b350c7897bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.396959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22000351-0a54-4f4b-8fb0-b350c7897bc5 admin admin] PATH_INFO: `/v3/projects/95cd143af9214116a9c8f47f836db570/users/9b2f968dd3b0459695bf280ef849c839/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.399772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22000351-0a54-4f4b-8fb0-b350c7897bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95cd143af9214116a9c8f47f836db570, user_id=9b2f968dd3b0459695bf280ef849c839, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:57.404455 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22000351-0a54-4f4b-8fb0-b350c7897bc5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:57.422732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 948/1876] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:57 2022] PUT /identity/v3/projects/95cd143af9214116a9c8f47f836db570/users/9b2f968dd3b0459695bf280ef849c839/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:57.424384 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d72500-42fd-4b1a-be79-f8e0e9ec99ba None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.424675 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d72500-42fd-4b1a-be79-f8e0e9ec99ba None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.424947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d72500-42fd-4b1a-be79-f8e0e9ec99ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.442720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46467546-2fe5-43ae-86f9-6bf316274e6a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:57.453000 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d8d72500-42fd-4b1a-be79-f8e0e9ec99ba None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:57.455235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d8d72500-42fd-4b1a-be79-f8e0e9ec99ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:57.524122 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb1e40-e81f-41c6-9ff8-600f05e3cc95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:57.525030 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb1e40-e81f-41c6-9ff8-600f05e3cc95 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.525446 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb1e40-e81f-41c6-9ff8-600f05e3cc95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.525728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2eb1e40-e81f-41c6-9ff8-600f05e3cc95 admin admin] PATH_INFO: `/v3/projects/78c3a63e5a4a4245a43e48df306d20d0/users/e74f787093d54fe0a81b0f108f268c00/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.531859 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 949/1877] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:57.540383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d77e2e-5ed7-4039-8d2e-979a4c3ea17d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.540671 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d77e2e-5ed7-4039-8d2e-979a4c3ea17d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.540945 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d77e2e-5ed7-4039-8d2e-979a4c3ea17d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.555471 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb1e40-e81f-41c6-9ff8-600f05e3cc95 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c3a63e5a4a4245a43e48df306d20d0, user_id=e74f787093d54fe0a81b0f108f268c00, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:57.557670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2eb1e40-e81f-41c6-9ff8-600f05e3cc95 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:57.560301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:57.568648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-92d77e2e-5ed7-4039-8d2e-979a4c3ea17d None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:57.569964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-92d77e2e-5ed7-4039-8d2e-979a4c3ea17d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:57.580458 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 929/1878] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:57 2022] PUT /identity/v3/projects/78c3a63e5a4a4245a43e48df306d20d0/users/e74f787093d54fe0a81b0f108f268c00/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:57.582571 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb1e40-e81f-41c6-9ff8-600f05e3cc95 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:57.629193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:57.647755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 950/1879] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:57.653230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d77e2e-5ed7-4039-8d2e-979a4c3ea17d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:57.665595 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d77e2e-5ed7-4039-8d2e-979a4c3ea17d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:57.674527 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72d6c1-8a3f-4dce-ae29-35e4cbefe516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:57.675304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72d6c1-8a3f-4dce-ae29-35e4cbefe516 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.675676 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72d6c1-8a3f-4dce-ae29-35e4cbefe516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.675952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a72d6c1-8a3f-4dce-ae29-35e4cbefe516 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.677343 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72d6c1-8a3f-4dce-ae29-35e4cbefe516 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:22:57.677734 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72d6c1-8a3f-4dce-ae29-35e4cbefe516 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:57.679572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a72d6c1-8a3f-4dce-ae29-35e4cbefe516 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:57.690181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2eb1e40-e81f-41c6-9ff8-600f05e3cc95 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:57.696614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 951/1880] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:22:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:22:57.697595 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72d6c1-8a3f-4dce-ae29-35e4cbefe516 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:57.698212 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac594b8-02f2-46be-85de-d6ae56bcf28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:57.699257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac594b8-02f2-46be-85de-d6ae56bcf28a admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.699937 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac594b8-02f2-46be-85de-d6ae56bcf28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.701063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac594b8-02f2-46be-85de-d6ae56bcf28a admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.701191 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac594b8-02f2-46be-85de-d6ae56bcf28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:57.703325 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac594b8-02f2-46be-85de-d6ae56bcf28a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:57.709795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a72d6c1-8a3f-4dce-ae29-35e4cbefe516 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:57.716249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e97e5-d33a-4ce5-a506-6f73cb291867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:57.717109 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e97e5-d33a-4ce5-a506-6f73cb291867 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.717359 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e97e5-d33a-4ce5-a506-6f73cb291867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.717815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e97e5-d33a-4ce5-a506-6f73cb291867 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.718519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e97e5-d33a-4ce5-a506-6f73cb291867 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:57.722809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 930/1881] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:57 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:57.722944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e97e5-d33a-4ce5-a506-6f73cb291867 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:57.724513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac594b8-02f2-46be-85de-d6ae56bcf28a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:57.737624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac594b8-02f2-46be-85de-d6ae56bcf28a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:57.743688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ceddbc-c7af-49a5-b055-5c81605023e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:57.744790 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceddbc-c7af-49a5-b055-5c81605023e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.745177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceddbc-c7af-49a5-b055-5c81605023e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.745457 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ceddbc-c7af-49a5-b055-5c81605023e1 admin admin] PATH_INFO: `/v3/projects/78c3a63e5a4a4245a43e48df306d20d0/users/e74f787093d54fe0a81b0f108f268c00/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.747740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ceddbc-c7af-49a5-b055-5c81605023e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=78c3a63e5a4a4245a43e48df306d20d0, user_id=e74f787093d54fe0a81b0f108f268c00, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:57.750701 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ceddbc-c7af-49a5-b055-5c81605023e1 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:57.758158 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 952/1882] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:22:57 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:57.759441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e97e5-d33a-4ce5-a506-6f73cb291867 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:57.767644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 931/1883] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:57 2022] PUT /identity/v3/projects/78c3a63e5a4a4245a43e48df306d20d0/users/e74f787093d54fe0a81b0f108f268c00/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:57.778348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb113f05-552e-4a03-a264-ac83b1642dc4 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.778348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb113f05-552e-4a03-a264-ac83b1642dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.778556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb113f05-552e-4a03-a264-ac83b1642dc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.815374 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-fb113f05-552e-4a03-a264-ac83b1642dc4 None None] MFA Rules not processed for user `e74f787093d54fe0a81b0f108f268c00`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:57.816699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fb113f05-552e-4a03-a264-ac83b1642dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:57.863550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e97e5-d33a-4ce5-a506-6f73cb291867 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:57.950389 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 932/1884] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:57 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:57.960999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb085787-9a4e-43f5-9e96-1aaa87d2d1af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:57.962550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb085787-9a4e-43f5-9e96-1aaa87d2d1af admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:57.963545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb113f05-552e-4a03-a264-ac83b1642dc4 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:57.964688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb085787-9a4e-43f5-9e96-1aaa87d2d1af admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:57.964984 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb085787-9a4e-43f5-9e96-1aaa87d2d1af admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:57.965089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fb113f05-552e-4a03-a264-ac83b1642dc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:57.966306 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb085787-9a4e-43f5-9e96-1aaa87d2d1af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:57.970343 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb085787-9a4e-43f5-9e96-1aaa87d2d1af admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:58.016266 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 953/1885] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:22:57 2022] POST /identity/v3/users => generated 288 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:22:58.020008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb085787-9a4e-43f5-9e96-1aaa87d2d1af admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:58.033070 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb085787-9a4e-43f5-9e96-1aaa87d2d1af admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:58.039618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98294d65-0980-4c65-9174-f8888835e717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:58.040488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98294d65-0980-4c65-9174-f8888835e717 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:58.040965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98294d65-0980-4c65-9174-f8888835e717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:58.041309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98294d65-0980-4c65-9174-f8888835e717 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:58.050125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98294d65-0980-4c65-9174-f8888835e717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:58.052011 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98294d65-0980-4c65-9174-f8888835e717 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:58.069930 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb113f05-552e-4a03-a264-ac83b1642dc4 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:58.074828 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf75bfe-8fff-4110-acab-3e9d22018a73 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:58.075872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf75bfe-8fff-4110-acab-3e9d22018a73 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:58.076376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf75bfe-8fff-4110-acab-3e9d22018a73 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:58.076847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf75bfe-8fff-4110-acab-3e9d22018a73 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:58.080114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 954/1886] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:22:58.081257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98294d65-0980-4c65-9174-f8888835e717 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:58.090722 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf75bfe-8fff-4110-acab-3e9d22018a73 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:58.092364 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdf75bfe-8fff-4110-acab-3e9d22018a73 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:58.094183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98294d65-0980-4c65-9174-f8888835e717 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:58.101680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b8c2d-6172-4c3d-bfeb-3d2822d1aa7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:58.102428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b8c2d-6172-4c3d-bfeb-3d2822d1aa7e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:58.103872 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b8c2d-6172-4c3d-bfeb-3d2822d1aa7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:58.104227 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1b8c2d-6172-4c3d-bfeb-3d2822d1aa7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:58.105085 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b8c2d-6172-4c3d-bfeb-3d2822d1aa7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:58.105335 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 933/1887] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:57 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:58.107151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1b8c2d-6172-4c3d-bfeb-3d2822d1aa7e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:58.127530 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 955/1888] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:22:58.128532 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf75bfe-8fff-4110-acab-3e9d22018a73 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:58.140516 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:58.149852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf75bfe-8fff-4110-acab-3e9d22018a73 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:58.171615 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64b3b5a-b7e1-4f15-ab01-405c2fd50d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:58.172440 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3b5a-b7e1-4f15-ab01-405c2fd50d1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:58.173987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3b5a-b7e1-4f15-ab01-405c2fd50d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:58.174121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64b3b5a-b7e1-4f15-ab01-405c2fd50d1d admin admin] PATH_INFO: `/v3/projects/67ccfc9bcd0b47c38070c6b2137a0731/users/3f6922147b2a4669a05ed8c00680a8f8/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:58.198269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b3b5a-b7e1-4f15-ab01-405c2fd50d1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=67ccfc9bcd0b47c38070c6b2137a0731, user_id=3f6922147b2a4669a05ed8c00680a8f8, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:58.202675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64b3b5a-b7e1-4f15-ab01-405c2fd50d1d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:58.206647 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b8c2d-6172-4c3d-bfeb-3d2822d1aa7e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:58.219035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1b8c2d-6172-4c3d-bfeb-3d2822d1aa7e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:58.240601 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 934/1889] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:22:58 2022] PUT /identity/v3/projects/67ccfc9bcd0b47c38070c6b2137a0731/users/3f6922147b2a4669a05ed8c00680a8f8/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:22:58.267328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72db8d-b7c6-45e8-82e6-f8e7272bbc3e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:58.268055 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72db8d-b7c6-45e8-82e6-f8e7272bbc3e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:58.268055 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72db8d-b7c6-45e8-82e6-f8e7272bbc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:58.277673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:58.327996 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-be72db8d-b7c6-45e8-82e6-f8e7272bbc3e None None] MFA Rules not processed for user `3f6922147b2a4669a05ed8c00680a8f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:58.332165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-be72db8d-b7c6-45e8-82e6-f8e7272bbc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:58.342688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd815799-7111-447e-ad5e-f014d9445e46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:58.343466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd815799-7111-447e-ad5e-f014d9445e46 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:58.343750 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd815799-7111-447e-ad5e-f014d9445e46 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:58.344035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd815799-7111-447e-ad5e-f014d9445e46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:58.347107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bd815799-7111-447e-ad5e-f014d9445e46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:58.453368 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd815799-7111-447e-ad5e-f014d9445e46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:58.454201 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 935/1890] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:58 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:58.455548 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd815799-7111-447e-ad5e-f014d9445e46 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:58.467367 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72db8d-b7c6-45e8-82e6-f8e7272bbc3e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:58.467550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 956/1891] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:58.468829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-be72db8d-b7c6-45e8-82e6-f8e7272bbc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:58.492968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72db8d-b7c6-45e8-82e6-f8e7272bbc3e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:58.498972 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e066a-e115-4a46-8859-b922487663c6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:58.499662 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e066a-e115-4a46-8859-b922487663c6 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:58.499949 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e066a-e115-4a46-8859-b922487663c6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:58.500367 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e066a-e115-4a46-8859-b922487663c6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:58.510719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e066a-e115-4a46-8859-b922487663c6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:58.512599 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e066a-e115-4a46-8859-b922487663c6 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:58.526891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 936/1892] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:22:58.593574 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd3725-b571-4db5-b341-44f45d797f29 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:58.594512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd3725-b571-4db5-b341-44f45d797f29 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:58.595137 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afd3725-b571-4db5-b341-44f45d797f29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:58.634199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9afd3725-b571-4db5-b341-44f45d797f29 None None] MFA Rules not processed for user `9b2f968dd3b0459695bf280ef849c839`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:58.635815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9afd3725-b571-4db5-b341-44f45d797f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:58.785527 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 957/1893] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:58.796393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3620f-2813-43e9-be8c-a5eb62abe581 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:58.796766 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3620f-2813-43e9-be8c-a5eb62abe581 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:58.797164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3620f-2813-43e9-be8c-a5eb62abe581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:58.835540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e5d3620f-2813-43e9-be8c-a5eb62abe581 None None] MFA Rules not processed for user `ea1ddc41c94e4f789e0afe5d3ed3d419`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:58.838249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e5d3620f-2813-43e9-be8c-a5eb62abe581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:58.973696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 937/1894] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:59.033830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd3725-b571-4db5-b341-44f45d797f29 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:59.035351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9afd3725-b571-4db5-b341-44f45d797f29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:59.155536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afd3725-b571-4db5-b341-44f45d797f29 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:59.162258 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54d1a4-c402-4d3b-ad3e-d5b1b7f2b95d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:59.162921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54d1a4-c402-4d3b-ad3e-d5b1b7f2b95d service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:59.163199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54d1a4-c402-4d3b-ad3e-d5b1b7f2b95d service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:59.163473 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54d1a4-c402-4d3b-ad3e-d5b1b7f2b95d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:59.165251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ee54d1a4-c402-4d3b-ad3e-d5b1b7f2b95d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:59.175591 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:59.180329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54d1a4-c402-4d3b-ad3e-d5b1b7f2b95d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:59.182362 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee54d1a4-c402-4d3b-ad3e-d5b1b7f2b95d service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:59.194665 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 958/1895] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:59 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:22:59.588795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3620f-2813-43e9-be8c-a5eb62abe581 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:59.590756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e5d3620f-2813-43e9-be8c-a5eb62abe581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:59.665556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3620f-2813-43e9-be8c-a5eb62abe581 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:59.670609 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4271a-7396-4180-a6f9-d20a9da09590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:59.671260 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4271a-7396-4180-a6f9-d20a9da09590 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:59.671699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4271a-7396-4180-a6f9-d20a9da09590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:59.671978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d4271a-7396-4180-a6f9-d20a9da09590 admin admin] PATH_INFO: `/v3/users/1e469353d81e4163af849fa4a8d4a0c0` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:59.673245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4271a-7396-4180-a6f9-d20a9da09590 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e469353d81e4163af849fa4a8d4a0c0)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:59.675204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d4271a-7396-4180-a6f9-d20a9da09590 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:59.678342 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:22:59.733426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-60d4271a-7396-4180-a6f9-d20a9da09590 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e469353d81e4163af849fa4a8d4a0c0'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:59.742412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-60d4271a-7396-4180-a6f9-d20a9da09590 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e469353d81e4163af849fa4a8d4a0c0'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:59.756630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-60d4271a-7396-4180-a6f9-d20a9da09590 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e469353d81e4163af849fa4a8d4a0c0'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:59.757376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-60d4271a-7396-4180-a6f9-d20a9da09590 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e469353d81e4163af849fa4a8d4a0c0'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:59.765166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-60d4271a-7396-4180-a6f9-d20a9da09590 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e469353d81e4163af849fa4a8d4a0c0'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:22:59.771686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 938/1896] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:22:59 2022] DELETE /identity/v3/users/1e469353d81e4163af849fa4a8d4a0c0 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:22:59.775971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3f21c-4f67-4c3f-bad1-7bac030bac20 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:59.776455 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3f21c-4f67-4c3f-bad1-7bac030bac20 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:59.776662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed3f21c-4f67-4c3f-bad1-7bac030bac20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:59.798792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fed3f21c-4f67-4c3f-bad1-7bac030bac20 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:22:59.799532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fed3f21c-4f67-4c3f-bad1-7bac030bac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:59.873039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 959/1897] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:22:59.882935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4271a-7396-4180-a6f9-d20a9da09590 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:22:59.884270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-60d4271a-7396-4180-a6f9-d20a9da09590 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:22:59.946186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d4271a-7396-4180-a6f9-d20a9da09590 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:22:59.950115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437f579-c74f-49b1-aa37-e699bf17f47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:22:59.950790 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437f579-c74f-49b1-aa37-e699bf17f47e service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:22:59.951103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437f579-c74f-49b1-aa37-e699bf17f47e service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:22:59.951350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437f579-c74f-49b1-aa37-e699bf17f47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:22:59.961418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437f579-c74f-49b1-aa37-e699bf17f47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:22:59.962913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437f579-c74f-49b1-aa37-e699bf17f47e service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:22:59.973295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 939/1898] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:00.496251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3f21c-4f67-4c3f-bad1-7bac030bac20 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:00.497771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fed3f21c-4f67-4c3f-bad1-7bac030bac20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:00.511489 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed3f21c-4f67-4c3f-bad1-7bac030bac20 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:00.523530 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:00.524288 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:00.524703 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:00.525018 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8 admin admin] PATH_INFO: `/v3/projects/6255c4e3cdbc4cf59245e7dd74527638` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:00.526607 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6255c4e3cdbc4cf59245e7dd74527638)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:00.529238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:00.602927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6255c4e3cdbc4cf59245e7dd74527638', 'request_id': 'req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:00.610511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6255c4e3cdbc4cf59245e7dd74527638', 'request_id': 'req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:00.619770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6255c4e3cdbc4cf59245e7dd74527638', 'request_id': 'req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:00.635949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8 admin admin] The token cache is being invalidate because project 6255c4e3cdbc4cf59245e7dd74527638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:00.636313 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:00.637043 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:00.638693 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 960/1899] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:00 2022] DELETE /identity/v3/projects/6255c4e3cdbc4cf59245e7dd74527638 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:00.643101 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437f579-c74f-49b1-aa37-e699bf17f47e service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:00.653089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437f579-c74f-49b1-aa37-e699bf17f47e service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:00.729553 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b260292-a6c9-4b71-8a74-11c6d7a185e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:00.730196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b260292-a6c9-4b71-8a74-11c6d7a185e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:00.730474 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b260292-a6c9-4b71-8a74-11c6d7a185e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:00.730794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b260292-a6c9-4b71-8a74-11c6d7a185e9 admin admin] PATH_INFO: `/v3/users/4be907bd58cb4ad1ac9c665b8df983b7` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:00.731962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b260292-a6c9-4b71-8a74-11c6d7a185e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4be907bd58cb4ad1ac9c665b8df983b7)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:00.734007 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b260292-a6c9-4b71-8a74-11c6d7a185e9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:00.762886 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:00.805892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4b260292-a6c9-4b71-8a74-11c6d7a185e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4be907bd58cb4ad1ac9c665b8df983b7'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:00.815731 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4b260292-a6c9-4b71-8a74-11c6d7a185e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4be907bd58cb4ad1ac9c665b8df983b7'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:00.830597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4b260292-a6c9-4b71-8a74-11c6d7a185e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4be907bd58cb4ad1ac9c665b8df983b7'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:00.831066 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4b260292-a6c9-4b71-8a74-11c6d7a185e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4be907bd58cb4ad1ac9c665b8df983b7'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:00.853275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4b260292-a6c9-4b71-8a74-11c6d7a185e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4be907bd58cb4ad1ac9c665b8df983b7'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:00.871236 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 940/1900] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:00 2022] DELETE /identity/v3/users/4be907bd58cb4ad1ac9c665b8df983b7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:01.186624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:01.188140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:01.201498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b5d5c88-c7cb-4d4c-b26a-fd9d288639d8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:01.257872 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06aad95-99c1-4c24-90e2-a07773197a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:01.258466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aad95-99c1-4c24-90e2-a07773197a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.258864 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aad95-99c1-4c24-90e2-a07773197a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.259331 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06aad95-99c1-4c24-90e2-a07773197a80 admin admin] PATH_INFO: `/v3/projects/209a3c35dcff4095adf822003f8c4eb4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.260542 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06aad95-99c1-4c24-90e2-a07773197a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=209a3c35dcff4095adf822003f8c4eb4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:01.262867 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06aad95-99c1-4c24-90e2-a07773197a80 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:01.290040 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:01.323575 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a06aad95-99c1-4c24-90e2-a07773197a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '209a3c35dcff4095adf822003f8c4eb4', 'request_id': 'req-a06aad95-99c1-4c24-90e2-a07773197a80'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:01.343346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a06aad95-99c1-4c24-90e2-a07773197a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '209a3c35dcff4095adf822003f8c4eb4', 'request_id': 'req-a06aad95-99c1-4c24-90e2-a07773197a80'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:01.352517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a06aad95-99c1-4c24-90e2-a07773197a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '209a3c35dcff4095adf822003f8c4eb4', 'request_id': 'req-a06aad95-99c1-4c24-90e2-a07773197a80'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:01.367928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a06aad95-99c1-4c24-90e2-a07773197a80 admin admin] The token cache is being invalidate because project 209a3c35dcff4095adf822003f8c4eb4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:01.368239 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a06aad95-99c1-4c24-90e2-a07773197a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:01.368891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a06aad95-99c1-4c24-90e2-a07773197a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:01.370434 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 961/1901] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:01 2022] DELETE /identity/v3/projects/209a3c35dcff4095adf822003f8c4eb4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:01.375263 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efeac59-7826-4eae-ac1e-9d34e8f1db17 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.375618 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efeac59-7826-4eae-ac1e-9d34e8f1db17 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.376529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efeac59-7826-4eae-ac1e-9d34e8f1db17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.398245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-6efeac59-7826-4eae-ac1e-9d34e8f1db17 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:01.399621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6efeac59-7826-4eae-ac1e-9d34e8f1db17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:01.465612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 941/1902] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:01.473839 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac121-263a-4317-b1f3-89d4e51c4586 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.474124 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac121-263a-4317-b1f3-89d4e51c4586 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.474501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10ac121-263a-4317-b1f3-89d4e51c4586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.498834 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e10ac121-263a-4317-b1f3-89d4e51c4586 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:01.500403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e10ac121-263a-4317-b1f3-89d4e51c4586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:01.509610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 962/1903] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:01.514084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efeac59-7826-4eae-ac1e-9d34e8f1db17 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:01.524885 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efeac59-7826-4eae-ac1e-9d34e8f1db17 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:01.531159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf686e-d81b-4ae1-ba01-17d27a63471b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:01.531485 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf686e-d81b-4ae1-ba01-17d27a63471b admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.531769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf686e-d81b-4ae1-ba01-17d27a63471b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.532039 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aecf686e-d81b-4ae1-ba01-17d27a63471b admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.532772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf686e-d81b-4ae1-ba01-17d27a63471b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:23:01.533134 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf686e-d81b-4ae1-ba01-17d27a63471b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:01.535091 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aecf686e-d81b-4ae1-ba01-17d27a63471b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:01.557613 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ac121-263a-4317-b1f3-89d4e51c4586 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:01.565249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 942/1904] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:23:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:23:01.569517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10ac121-263a-4317-b1f3-89d4e51c4586 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:01.574995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c4dda-a7b2-4b82-b8ff-81781c3c7be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:01.575733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c4dda-a7b2-4b82-b8ff-81781c3c7be2 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.576116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c4dda-a7b2-4b82-b8ff-81781c3c7be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.576459 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9c4dda-a7b2-4b82-b8ff-81781c3c7be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.577189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c4dda-a7b2-4b82-b8ff-81781c3c7be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:01.579384 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9c4dda-a7b2-4b82-b8ff-81781c3c7be2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:01.619960 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 963/1905] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:01 2022] POST /identity/v3/projects => generated 377 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:01.625024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf686e-d81b-4ae1-ba01-17d27a63471b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:01.636167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aecf686e-d81b-4ae1-ba01-17d27a63471b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:01.792425 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2d54d-fbc8-4c15-989d-2ccbd4f3464b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:01.794222 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2d54d-fbc8-4c15-989d-2ccbd4f3464b admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.795801 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2d54d-fbc8-4c15-989d-2ccbd4f3464b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.796090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc2d54d-fbc8-4c15-989d-2ccbd4f3464b admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.796800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2d54d-fbc8-4c15-989d-2ccbd4f3464b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:01.799555 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc2d54d-fbc8-4c15-989d-2ccbd4f3464b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:01.843164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 943/1906] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:01 2022] POST /identity/v3/users => generated 289 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:23:01.848181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c4dda-a7b2-4b82-b8ff-81781c3c7be2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:01.859132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9c4dda-a7b2-4b82-b8ff-81781c3c7be2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:01.865736 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dded5-2ccc-4447-beb2-0ec565344c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:01.866346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dded5-2ccc-4447-beb2-0ec565344c9d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.866659 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dded5-2ccc-4447-beb2-0ec565344c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.866933 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93dded5-2ccc-4447-beb2-0ec565344c9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.867720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dded5-2ccc-4447-beb2-0ec565344c9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:01.870074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93dded5-2ccc-4447-beb2-0ec565344c9d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:01.895824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 964/1907] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:01.904054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2d54d-fbc8-4c15-989d-2ccbd4f3464b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:01.919466 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc2d54d-fbc8-4c15-989d-2ccbd4f3464b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:01.927058 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9f9905-1ec4-4424-b281-7aa3d562d24d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:01.927860 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f9905-1ec4-4424-b281-7aa3d562d24d admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.928280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f9905-1ec4-4424-b281-7aa3d562d24d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.928717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9f9905-1ec4-4424-b281-7aa3d562d24d admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.929685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f9905-1ec4-4424-b281-7aa3d562d24d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:01.931832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9f9905-1ec4-4424-b281-7aa3d562d24d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:01.947242 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 944/1908] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:01.948654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dded5-2ccc-4447-beb2-0ec565344c9d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:01.959999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93dded5-2ccc-4447-beb2-0ec565344c9d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:01.964800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab5f45-8dca-47b6-a975-329151fac249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:01.965482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab5f45-8dca-47b6-a975-329151fac249 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:01.965738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab5f45-8dca-47b6-a975-329151fac249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:01.966010 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab5f45-8dca-47b6-a975-329151fac249 admin admin] PATH_INFO: `/v3/projects/6c20133e93fd48dfa4a90a88256fbbda/users/b52b2a4929ba48e0885aa94d14b17fce/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:01.991043 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab5f45-8dca-47b6-a975-329151fac249 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c20133e93fd48dfa4a90a88256fbbda, user_id=b52b2a4929ba48e0885aa94d14b17fce, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:01.996842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab5f45-8dca-47b6-a975-329151fac249 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:02.016146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 965/1909] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:01 2022] PUT /identity/v3/projects/6c20133e93fd48dfa4a90a88256fbbda/users/b52b2a4929ba48e0885aa94d14b17fce/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:02.028976 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48cec7-0c60-4536-b425-938a4a84b58f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:02.029270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48cec7-0c60-4536-b425-938a4a84b58f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:02.029550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48cec7-0c60-4536-b425-938a4a84b58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:02.051264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:02.072616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9c48cec7-0c60-4536-b425-938a4a84b58f None None] MFA Rules not processed for user `b52b2a4929ba48e0885aa94d14b17fce`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:02.075218 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9c48cec7-0c60-4536-b425-938a4a84b58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:02.181829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 945/1910] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:02 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:02.183924 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab5f45-8dca-47b6-a975-329151fac249 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:02.251886 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab5f45-8dca-47b6-a975-329151fac249 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:02.256564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778543d-1bfd-4c33-99fe-998c2da3a819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:02.257177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778543d-1bfd-4c33-99fe-998c2da3a819 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:02.257460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778543d-1bfd-4c33-99fe-998c2da3a819 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:02.257738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b778543d-1bfd-4c33-99fe-998c2da3a819 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:02.258405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778543d-1bfd-4c33-99fe-998c2da3a819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:02.260346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b778543d-1bfd-4c33-99fe-998c2da3a819 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:02.291652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 966/1911] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:02 2022] POST /identity/v3/projects => generated 377 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:23:02.292946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48cec7-0c60-4536-b425-938a4a84b58f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:02.304908 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48cec7-0c60-4536-b425-938a4a84b58f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:02.367512 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3120ebd-9b75-4b3f-a09c-868a6cefd40a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:02.368141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3120ebd-9b75-4b3f-a09c-868a6cefd40a admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:02.368424 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3120ebd-9b75-4b3f-a09c-868a6cefd40a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:02.368701 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3120ebd-9b75-4b3f-a09c-868a6cefd40a admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:02.369367 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3120ebd-9b75-4b3f-a09c-868a6cefd40a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:02.371408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3120ebd-9b75-4b3f-a09c-868a6cefd40a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:02.393926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 946/1912] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:02 2022] POST /identity/v3/users => generated 295 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:02.398131 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778543d-1bfd-4c33-99fe-998c2da3a819 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:02.412342 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b778543d-1bfd-4c33-99fe-998c2da3a819 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:02.417790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab0563-c5a8-4bc2-a67d-9bd09390bf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:02.419022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab0563-c5a8-4bc2-a67d-9bd09390bf4f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:02.419310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab0563-c5a8-4bc2-a67d-9bd09390bf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:02.419587 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dab0563-c5a8-4bc2-a67d-9bd09390bf4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:02.420397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab0563-c5a8-4bc2-a67d-9bd09390bf4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:02.422105 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dab0563-c5a8-4bc2-a67d-9bd09390bf4f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:02.427051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3120ebd-9b75-4b3f-a09c-868a6cefd40a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:02.432503 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b3120ebd-9b75-4b3f-a09c-868a6cefd40a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:02.434383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 967/1913] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:23:02.438249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab0563-c5a8-4bc2-a67d-9bd09390bf4f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:02.445999 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3120ebd-9b75-4b3f-a09c-868a6cefd40a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:02.451659 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dab0563-c5a8-4bc2-a67d-9bd09390bf4f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:02.451938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02640cf7-ac72-472a-b31a-8037b7502946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:02.452590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02640cf7-ac72-472a-b31a-8037b7502946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:02.452875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02640cf7-ac72-472a-b31a-8037b7502946 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:02.453153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02640cf7-ac72-472a-b31a-8037b7502946 admin admin] PATH_INFO: `/v3/users/1d9fa3b384f94b5aa507ce5279fcb211` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:02.454369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02640cf7-ac72-472a-b31a-8037b7502946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d9fa3b384f94b5aa507ce5279fcb211)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:02.456617 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02640cf7-ac72-472a-b31a-8037b7502946 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:02.456770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd78bf1-6ba7-4a26-a3a8-52ff3d714c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:02.457392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd78bf1-6ba7-4a26-a3a8-52ff3d714c92 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:02.457676 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd78bf1-6ba7-4a26-a3a8-52ff3d714c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:02.457944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd78bf1-6ba7-4a26-a3a8-52ff3d714c92 admin admin] PATH_INFO: `/v3/projects/675218b9731749cf9b4609aab5f40063/users/cdf9a3e1519b4a66bd91c1d9503b24a2/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:02.474067 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd78bf1-6ba7-4a26-a3a8-52ff3d714c92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=675218b9731749cf9b4609aab5f40063, user_id=cdf9a3e1519b4a66bd91c1d9503b24a2, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:02.476716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd78bf1-6ba7-4a26-a3a8-52ff3d714c92 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:02.480059 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:02.494385 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 968/1914] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:02 2022] PUT /identity/v3/projects/675218b9731749cf9b4609aab5f40063/users/cdf9a3e1519b4a66bd91c1d9503b24a2/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:02.498298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd78bf1-6ba7-4a26-a3a8-52ff3d714c92 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:02.507822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-02640cf7-ac72-472a-b31a-8037b7502946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d9fa3b384f94b5aa507ce5279fcb211'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:02.515488 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-02640cf7-ac72-472a-b31a-8037b7502946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d9fa3b384f94b5aa507ce5279fcb211'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:02.528349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-02640cf7-ac72-472a-b31a-8037b7502946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d9fa3b384f94b5aa507ce5279fcb211'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:02.529133 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-02640cf7-ac72-472a-b31a-8037b7502946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d9fa3b384f94b5aa507ce5279fcb211'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:02.536169 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-02640cf7-ac72-472a-b31a-8037b7502946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d9fa3b384f94b5aa507ce5279fcb211'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:02.538385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:02.544434 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 947/1915] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:02 2022] DELETE /identity/v3/users/1d9fa3b384f94b5aa507ce5279fcb211 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:02.549491 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeecd8-4b73-49fa-83b4-39b839d8a82b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:02.549776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeecd8-4b73-49fa-83b4-39b839d8a82b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:02.550048 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbeecd8-4b73-49fa-83b4-39b839d8a82b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:02.562388 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd78bf1-6ba7-4a26-a3a8-52ff3d714c92 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:02.569169 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-afbeecd8-4b73-49fa-83b4-39b839d8a82b None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:02.570414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-afbeecd8-4b73-49fa-83b4-39b839d8a82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:02.621500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec76f1b-4bc6-4b40-99b8-3aa2b1a850fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:02.622041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec76f1b-4bc6-4b40-99b8-3aa2b1a850fc admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:02.622323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec76f1b-4bc6-4b40-99b8-3aa2b1a850fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:02.622613 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec76f1b-4bc6-4b40-99b8-3aa2b1a850fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:02.623338 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec76f1b-4bc6-4b40-99b8-3aa2b1a850fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:02.624975 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec76f1b-4bc6-4b40-99b8-3aa2b1a850fc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:02.631803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 948/1916] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:02.638085 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 969/1917] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:02.639495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeecd8-4b73-49fa-83b4-39b839d8a82b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:02.640842 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-afbeecd8-4b73-49fa-83b4-39b839d8a82b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:02.641419 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec76f1b-4bc6-4b40-99b8-3aa2b1a850fc admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:02.643096 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8ec76f1b-4bc6-4b40-99b8-3aa2b1a850fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:02.653096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbeecd8-4b73-49fa-83b4-39b839d8a82b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:02.658352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586ca73e-f1e3-4ec0-8954-6f552b263a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:02.659062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ca73e-f1e3-4ec0-8954-6f552b263a79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:02.659344 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ca73e-f1e3-4ec0-8954-6f552b263a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:02.659621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586ca73e-f1e3-4ec0-8954-6f552b263a79 admin admin] PATH_INFO: `/v3/projects/675218b9731749cf9b4609aab5f40063/users/cdf9a3e1519b4a66bd91c1d9503b24a2/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:02.661687 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ca73e-f1e3-4ec0-8954-6f552b263a79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=675218b9731749cf9b4609aab5f40063, user_id=cdf9a3e1519b4a66bd91c1d9503b24a2, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:02.664411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586ca73e-f1e3-4ec0-8954-6f552b263a79 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:02.676295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 949/1918] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:02 2022] PUT /identity/v3/projects/675218b9731749cf9b4609aab5f40063/users/cdf9a3e1519b4a66bd91c1d9503b24a2/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:02.687624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247976eb-5baf-43f7-bc84-19787b8f37a4 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:02.687918 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247976eb-5baf-43f7-bc84-19787b8f37a4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:02.688263 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247976eb-5baf-43f7-bc84-19787b8f37a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:02.709085 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec76f1b-4bc6-4b40-99b8-3aa2b1a850fc admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:02.730766 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-247976eb-5baf-43f7-bc84-19787b8f37a4 None None] MFA Rules not processed for user `cdf9a3e1519b4a66bd91c1d9503b24a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:02.732116 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-247976eb-5baf-43f7-bc84-19787b8f37a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:02.768817 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa71af-739e-4e1f-a49f-b8007bf02877 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:02.769554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa71af-739e-4e1f-a49f-b8007bf02877 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:02.771776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa71af-739e-4e1f-a49f-b8007bf02877 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:02.771776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa71af-739e-4e1f-a49f-b8007bf02877 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:02.779372 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:02.851607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 950/1919] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:02 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:02.855661 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa71af-739e-4e1f-a49f-b8007bf02877 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:02.857376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eaa71af-739e-4e1f-a49f-b8007bf02877 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:02.863111 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247976eb-5baf-43f7-bc84-19787b8f37a4 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:02.864531 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-247976eb-5baf-43f7-bc84-19787b8f37a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:02.871319 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 970/1920] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:23:02.981211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247976eb-5baf-43f7-bc84-19787b8f37a4 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:02.996460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a2a3-e9e9-4e49-95d2-26531fbf3fd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:02.996460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a2a3-e9e9-4e49-95d2-26531fbf3fd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:02.996460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a2a3-e9e9-4e49-95d2-26531fbf3fd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:02.996460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f875a2a3-e9e9-4e49-95d2-26531fbf3fd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:02.997805 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f875a2a3-e9e9-4e49-95d2-26531fbf3fd4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:03.038406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:03.107146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875a2a3-e9e9-4e49-95d2-26531fbf3fd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:03.108844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f875a2a3-e9e9-4e49-95d2-26531fbf3fd4 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:03.120230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 951/1921] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:23:03.326619 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa71af-739e-4e1f-a49f-b8007bf02877 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:03.328749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6eaa71af-739e-4e1f-a49f-b8007bf02877 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:03.354691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa71af-739e-4e1f-a49f-b8007bf02877 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:03.361582 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f815831-8d2e-4998-8ce7-e682a5d18451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:03.363018 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f815831-8d2e-4998-8ce7-e682a5d18451 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:03.363443 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f815831-8d2e-4998-8ce7-e682a5d18451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:03.363794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f815831-8d2e-4998-8ce7-e682a5d18451 admin admin] PATH_INFO: `/v3/projects/5791cb3a1731470d954567262c4f1cee` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:03.365083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f815831-8d2e-4998-8ce7-e682a5d18451 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5791cb3a1731470d954567262c4f1cee)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:03.367896 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f815831-8d2e-4998-8ce7-e682a5d18451 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:03.438187 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1f815831-8d2e-4998-8ce7-e682a5d18451 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5791cb3a1731470d954567262c4f1cee', 'request_id': 'req-1f815831-8d2e-4998-8ce7-e682a5d18451'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:03.446222 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1f815831-8d2e-4998-8ce7-e682a5d18451 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5791cb3a1731470d954567262c4f1cee', 'request_id': 'req-1f815831-8d2e-4998-8ce7-e682a5d18451'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:03.452686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1f815831-8d2e-4998-8ce7-e682a5d18451 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5791cb3a1731470d954567262c4f1cee', 'request_id': 'req-1f815831-8d2e-4998-8ce7-e682a5d18451'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:03.469213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1f815831-8d2e-4998-8ce7-e682a5d18451 admin admin] The token cache is being invalidate because project 5791cb3a1731470d954567262c4f1cee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:03.470700 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1f815831-8d2e-4998-8ce7-e682a5d18451 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:03.471126 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1f815831-8d2e-4998-8ce7-e682a5d18451 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:03.472848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 971/1922] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:03 2022] DELETE /identity/v3/projects/5791cb3a1731470d954567262c4f1cee => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:03.476743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a2a3-e9e9-4e49-95d2-26531fbf3fd4 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:03.488777 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f875a2a3-e9e9-4e49-95d2-26531fbf3fd4 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:03.582482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1a58d-a740-4dd7-ae49-f553d2843f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:03.583315 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1a58d-a740-4dd7-ae49-f553d2843f2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:03.583661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1a58d-a740-4dd7-ae49-f553d2843f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:03.584002 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e1a58d-a740-4dd7-ae49-f553d2843f2d admin admin] PATH_INFO: `/v3/users/e74f787093d54fe0a81b0f108f268c00` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:03.585413 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1a58d-a740-4dd7-ae49-f553d2843f2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e74f787093d54fe0a81b0f108f268c00)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:03.587519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e1a58d-a740-4dd7-ae49-f553d2843f2d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:03.638871 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-52e1a58d-a740-4dd7-ae49-f553d2843f2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e74f787093d54fe0a81b0f108f268c00'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:03.642669 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170e36f-2668-414d-b98f-3c03eb755433 None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:03.643444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170e36f-2668-414d-b98f-3c03eb755433 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:03.644103 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7170e36f-2668-414d-b98f-3c03eb755433 None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:03.645554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 972/1923] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 1 14:23:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:23:03.648769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-52e1a58d-a740-4dd7-ae49-f553d2843f2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e74f787093d54fe0a81b0f108f268c00'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:03.654134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe0b26-e8b7-405c-aa0e-ed5c9410b9d1 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:03.654542 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe0b26-e8b7-405c-aa0e-ed5c9410b9d1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:03.654952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fe0b26-e8b7-405c-aa0e-ed5c9410b9d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:03.673620 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-52e1a58d-a740-4dd7-ae49-f553d2843f2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e74f787093d54fe0a81b0f108f268c00'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:03.674953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-52e1a58d-a740-4dd7-ae49-f553d2843f2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e74f787093d54fe0a81b0f108f268c00'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:03.683266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-52e1a58d-a740-4dd7-ae49-f553d2843f2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e74f787093d54fe0a81b0f108f268c00'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:03.696659 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d5fe0b26-e8b7-405c-aa0e-ed5c9410b9d1 None None] MFA Rules not processed for user `e856fd5aff914cfb8b8dd86b39c89bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:03.697588 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 952/1924] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:03 2022] DELETE /identity/v3/users/e74f787093d54fe0a81b0f108f268c00 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:03.698815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d5fe0b26-e8b7-405c-aa0e-ed5c9410b9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:03.808026 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 973/1925] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 1 14:23:03 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:03.823715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1a58d-a740-4dd7-ae49-f553d2843f2d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:03.825673 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-52e1a58d-a740-4dd7-ae49-f553d2843f2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:03.857346 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e1a58d-a740-4dd7-ae49-f553d2843f2d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:03.864984 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26351b74-ab00-4fe4-ace9-f1b829a51e25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:03.865726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26351b74-ab00-4fe4-ace9-f1b829a51e25 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:03.866008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26351b74-ab00-4fe4-ace9-f1b829a51e25 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:03.866327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26351b74-ab00-4fe4-ace9-f1b829a51e25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:03.877656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26351b74-ab00-4fe4-ace9-f1b829a51e25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:03.879316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26351b74-ab00-4fe4-ace9-f1b829a51e25 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:03.893638 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 953/1926] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:04.796800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe0b26-e8b7-405c-aa0e-ed5c9410b9d1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:04.799666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d5fe0b26-e8b7-405c-aa0e-ed5c9410b9d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:04.823338 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:04.874114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fe0b26-e8b7-405c-aa0e-ed5c9410b9d1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:04.879292 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c712398-544d-4c5e-af9d-1e7b3723137c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:04.879933 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c712398-544d-4c5e-af9d-1e7b3723137c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:04.880216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c712398-544d-4c5e-af9d-1e7b3723137c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:04.880497 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c712398-544d-4c5e-af9d-1e7b3723137c admin admin] PATH_INFO: `/v3/projects/78c3a63e5a4a4245a43e48df306d20d0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:04.881647 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c712398-544d-4c5e-af9d-1e7b3723137c admin admin] RBAC: Authorizing `identity:delete_project(project_id=78c3a63e5a4a4245a43e48df306d20d0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:04.883600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c712398-544d-4c5e-af9d-1e7b3723137c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:04.931101 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6c712398-544d-4c5e-af9d-1e7b3723137c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '78c3a63e5a4a4245a43e48df306d20d0', 'request_id': 'req-6c712398-544d-4c5e-af9d-1e7b3723137c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:04.937632 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6c712398-544d-4c5e-af9d-1e7b3723137c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '78c3a63e5a4a4245a43e48df306d20d0', 'request_id': 'req-6c712398-544d-4c5e-af9d-1e7b3723137c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:04.943689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6c712398-544d-4c5e-af9d-1e7b3723137c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '78c3a63e5a4a4245a43e48df306d20d0', 'request_id': 'req-6c712398-544d-4c5e-af9d-1e7b3723137c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:04.957752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6c712398-544d-4c5e-af9d-1e7b3723137c admin admin] The token cache is being invalidate because project 78c3a63e5a4a4245a43e48df306d20d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:04.958063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6c712398-544d-4c5e-af9d-1e7b3723137c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:04.958724 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6c712398-544d-4c5e-af9d-1e7b3723137c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:04.960244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 974/1927] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:04 2022] DELETE /identity/v3/projects/78c3a63e5a4a4245a43e48df306d20d0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:04.965105 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4da09-077c-4f8e-8d9f-1bc217e41858 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:04.965547 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4da09-077c-4f8e-8d9f-1bc217e41858 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:04.965652 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed4da09-077c-4f8e-8d9f-1bc217e41858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:04.984899 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0ed4da09-077c-4f8e-8d9f-1bc217e41858 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:04.986088 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0ed4da09-077c-4f8e-8d9f-1bc217e41858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:05.016371 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:05.047253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 954/1928] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:05.055581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45535b-b2a6-46b8-9e43-14c76bc52aeb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:05.055813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45535b-b2a6-46b8-9e43-14c76bc52aeb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:05.056088 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e45535b-b2a6-46b8-9e43-14c76bc52aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:05.081828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4e45535b-b2a6-46b8-9e43-14c76bc52aeb None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:05.083146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4e45535b-b2a6-46b8-9e43-14c76bc52aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:05.091756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 975/1929] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:05.096153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4da09-077c-4f8e-8d9f-1bc217e41858 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:05.106521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed4da09-077c-4f8e-8d9f-1bc217e41858 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:05.111181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26372ae-02a5-4fb1-b73d-272377530e4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:05.111825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26372ae-02a5-4fb1-b73d-272377530e4b admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:05.112101 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26372ae-02a5-4fb1-b73d-272377530e4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:05.112372 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26372ae-02a5-4fb1-b73d-272377530e4b admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:05.113065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26372ae-02a5-4fb1-b73d-272377530e4b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:23:05.113368 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26372ae-02a5-4fb1-b73d-272377530e4b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:05.115016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26372ae-02a5-4fb1-b73d-272377530e4b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:05.130466 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 955/1930] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:23:05.135835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45535b-b2a6-46b8-9e43-14c76bc52aeb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:05.154203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e45535b-b2a6-46b8-9e43-14c76bc52aeb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:05.161270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f18b2d-f0b8-4e26-97f2-7f9349d9ad15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:05.162203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18b2d-f0b8-4e26-97f2-7f9349d9ad15 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:05.162715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18b2d-f0b8-4e26-97f2-7f9349d9ad15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:05.163406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f18b2d-f0b8-4e26-97f2-7f9349d9ad15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:05.165705 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f18b2d-f0b8-4e26-97f2-7f9349d9ad15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:05.169811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f18b2d-f0b8-4e26-97f2-7f9349d9ad15 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:05.219291 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 976/1931] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:05 2022] POST /identity/v3/projects => generated 387 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:23:05.223186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26372ae-02a5-4fb1-b73d-272377530e4b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:05.233561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26372ae-02a5-4fb1-b73d-272377530e4b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:05.297385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ab5ff-1cd7-4d00-b96b-0147715f4f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:05.298773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ab5ff-1cd7-4d00-b96b-0147715f4f21 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:05.299173 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ab5ff-1cd7-4d00-b96b-0147715f4f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:05.299541 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1ab5ff-1cd7-4d00-b96b-0147715f4f21 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:05.300376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ab5ff-1cd7-4d00-b96b-0147715f4f21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:05.302441 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1ab5ff-1cd7-4d00-b96b-0147715f4f21 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:05.327347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 956/1932] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:05 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:23:05.328555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f18b2d-f0b8-4e26-97f2-7f9349d9ad15 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:05.339425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f18b2d-f0b8-4e26-97f2-7f9349d9ad15 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:05.344069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69f847-f484-4a62-b8cc-7c03708e6a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:05.344817 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f847-f484-4a62-b8cc-7c03708e6a00 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:05.345200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f847-f484-4a62-b8cc-7c03708e6a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:05.345366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e69f847-f484-4a62-b8cc-7c03708e6a00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:05.346081 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69f847-f484-4a62-b8cc-7c03708e6a00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:05.347818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e69f847-f484-4a62-b8cc-7c03708e6a00 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:05.358477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 977/1933] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:05.364483 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ab5ff-1cd7-4d00-b96b-0147715f4f21 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:05.377728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1ab5ff-1cd7-4d00-b96b-0147715f4f21 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:05.384765 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03f8e61-12d6-41e3-8f91-b4284f44f222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:05.385520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f8e61-12d6-41e3-8f91-b4284f44f222 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:05.385919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f8e61-12d6-41e3-8f91-b4284f44f222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:05.386295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03f8e61-12d6-41e3-8f91-b4284f44f222 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:05.387145 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f8e61-12d6-41e3-8f91-b4284f44f222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:05.389156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03f8e61-12d6-41e3-8f91-b4284f44f222 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:05.406178 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 957/1934] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:05.411009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69f847-f484-4a62-b8cc-7c03708e6a00 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:05.422358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e69f847-f484-4a62-b8cc-7c03708e6a00 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:05.427477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1480b-9b41-4145-b826-15be9bf0341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:05.428156 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1480b-9b41-4145-b826-15be9bf0341c admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:05.428439 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1480b-9b41-4145-b826-15be9bf0341c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:05.428713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef1480b-9b41-4145-b826-15be9bf0341c admin admin] PATH_INFO: `/v3/projects/b22d32c0fda644f5b3bbf83d26e3a254/users/08e5e0067c9b4c309103a0eb2fc60385/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:05.446313 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1480b-9b41-4145-b826-15be9bf0341c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b22d32c0fda644f5b3bbf83d26e3a254, user_id=08e5e0067c9b4c309103a0eb2fc60385, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:05.449650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef1480b-9b41-4145-b826-15be9bf0341c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:05.471385 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 978/1935] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:05 2022] PUT /identity/v3/projects/b22d32c0fda644f5b3bbf83d26e3a254/users/08e5e0067c9b4c309103a0eb2fc60385/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:05.484138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5d7b3-36cd-4fb9-8cd8-9508489f451c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:05.484511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5d7b3-36cd-4fb9-8cd8-9508489f451c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:05.484976 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc5d7b3-36cd-4fb9-8cd8-9508489f451c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:05.528320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9fc5d7b3-36cd-4fb9-8cd8-9508489f451c None None] MFA Rules not processed for user `08e5e0067c9b4c309103a0eb2fc60385`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:05.530364 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9fc5d7b3-36cd-4fb9-8cd8-9508489f451c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:05.686644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 958/1936] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:05 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:05.689458 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1480b-9b41-4145-b826-15be9bf0341c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:05.761704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:05.794767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef1480b-9b41-4145-b826-15be9bf0341c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:05.801030 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92798f23-7fbc-41b8-a63c-c2a7e17d29f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:05.801772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92798f23-7fbc-41b8-a63c-c2a7e17d29f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:05.802159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92798f23-7fbc-41b8-a63c-c2a7e17d29f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:05.802532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92798f23-7fbc-41b8-a63c-c2a7e17d29f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:05.803337 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92798f23-7fbc-41b8-a63c-c2a7e17d29f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:05.806314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92798f23-7fbc-41b8-a63c-c2a7e17d29f2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:05.866400 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 979/1937] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:05 2022] POST /identity/v3/projects => generated 385 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:05.866496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5d7b3-36cd-4fb9-8cd8-9508489f451c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:05.876714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92798f23-7fbc-41b8-a63c-c2a7e17d29f2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:05.878414 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-92798f23-7fbc-41b8-a63c-c2a7e17d29f2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:05.882233 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc5d7b3-36cd-4fb9-8cd8-9508489f451c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:05.914309 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:05.949505 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92798f23-7fbc-41b8-a63c-c2a7e17d29f2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:05.953698 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c75641-6cef-46ec-b364-ad502f5bbd9b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:05.955271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c75641-6cef-46ec-b364-ad502f5bbd9b service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:05.955619 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c75641-6cef-46ec-b364-ad502f5bbd9b service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:05.955958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c75641-6cef-46ec-b364-ad502f5bbd9b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:05.957859 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c6c75641-6cef-46ec-b364-ad502f5bbd9b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:05.976156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817fbb6-f585-403e-a7d0-a07cf8f2be37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:05.977371 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817fbb6-f585-403e-a7d0-a07cf8f2be37 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:05.978258 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817fbb6-f585-403e-a7d0-a07cf8f2be37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:05.978851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817fbb6-f585-403e-a7d0-a07cf8f2be37 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:05.979601 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817fbb6-f585-403e-a7d0-a07cf8f2be37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:05.982350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2817fbb6-f585-403e-a7d0-a07cf8f2be37 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:06.014480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 959/1938] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:05 2022] POST /identity/v3/users => generated 299 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:06.018114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817fbb6-f585-403e-a7d0-a07cf8f2be37 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:06.027897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817fbb6-f585-403e-a7d0-a07cf8f2be37 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:06.032627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c0da0-1c2c-4b87-b857-cfa6b14c289d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:06.033218 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c0da0-1c2c-4b87-b857-cfa6b14c289d admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:06.033524 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c0da0-1c2c-4b87-b857-cfa6b14c289d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:06.033797 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02c0da0-1c2c-4b87-b857-cfa6b14c289d admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:06.034479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c0da0-1c2c-4b87-b857-cfa6b14c289d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:06.036136 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02c0da0-1c2c-4b87-b857-cfa6b14c289d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:06.039875 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c75641-6cef-46ec-b364-ad502f5bbd9b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:06.041324 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c75641-6cef-46ec-b364-ad502f5bbd9b service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:06.045994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 960/1939] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:23:06.050506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c0da0-1c2c-4b87-b857-cfa6b14c289d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:06.052225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 980/1940] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:05 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:23:06.060014 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02c0da0-1c2c-4b87-b857-cfa6b14c289d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:06.065358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83159c1b-ca85-4ba9-9a6f-0c8e0d24e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:06.066008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83159c1b-ca85-4ba9-9a6f-0c8e0d24e915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:06.066285 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83159c1b-ca85-4ba9-9a6f-0c8e0d24e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:06.066557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83159c1b-ca85-4ba9-9a6f-0c8e0d24e915 admin admin] PATH_INFO: `/v3/projects/968a3b81613f48fc9d929b3d61ddcc47/users/1b0f0c93b5014fd9a6a836badd861178/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:06.081615 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83159c1b-ca85-4ba9-9a6f-0c8e0d24e915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=968a3b81613f48fc9d929b3d61ddcc47, user_id=1b0f0c93b5014fd9a6a836badd861178, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:06.084231 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83159c1b-ca85-4ba9-9a6f-0c8e0d24e915 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:06.097155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 961/1941] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:06 2022] PUT /identity/v3/projects/968a3b81613f48fc9d929b3d61ddcc47/users/1b0f0c93b5014fd9a6a836badd861178/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:06.101423 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c75641-6cef-46ec-b364-ad502f5bbd9b service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:06.112805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c75641-6cef-46ec-b364-ad502f5bbd9b service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:06.170968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a243a45c-189d-4469-8e33-4258949a1f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:06.172428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243a45c-189d-4469-8e33-4258949a1f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:06.172428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243a45c-189d-4469-8e33-4258949a1f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:06.172428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a243a45c-189d-4469-8e33-4258949a1f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:06.173574 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243a45c-189d-4469-8e33-4258949a1f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:06.175211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a243a45c-189d-4469-8e33-4258949a1f91 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:06.185473 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 981/1942] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:06.190090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83159c1b-ca85-4ba9-9a6f-0c8e0d24e915 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:06.201862 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83159c1b-ca85-4ba9-9a6f-0c8e0d24e915 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:06.207832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d2f1f-5604-44b2-a97d-afa9ce9f66dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:06.208576 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d2f1f-5604-44b2-a97d-afa9ce9f66dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:06.208922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d2f1f-5604-44b2-a97d-afa9ce9f66dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:06.209350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1d2f1f-5604-44b2-a97d-afa9ce9f66dd admin admin] PATH_INFO: `/v3/projects/968a3b81613f48fc9d929b3d61ddcc47/users/1b0f0c93b5014fd9a6a836badd861178/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:06.211398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d2f1f-5604-44b2-a97d-afa9ce9f66dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=968a3b81613f48fc9d929b3d61ddcc47, user_id=1b0f0c93b5014fd9a6a836badd861178, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:06.214382 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1d2f1f-5604-44b2-a97d-afa9ce9f66dd admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:06.234171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 962/1943] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:06 2022] PUT /identity/v3/projects/968a3b81613f48fc9d929b3d61ddcc47/users/1b0f0c93b5014fd9a6a836badd861178/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:06.245201 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf10a-202b-48c5-9fcc-23679d5c0ddf None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:06.245554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf10a-202b-48c5-9fcc-23679d5c0ddf None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:06.245853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3cf10a-202b-48c5-9fcc-23679d5c0ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:06.277139 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-da3cf10a-202b-48c5-9fcc-23679d5c0ddf None None] MFA Rules not processed for user `1b0f0c93b5014fd9a6a836badd861178`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:06.279219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-da3cf10a-202b-48c5-9fcc-23679d5c0ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:06.285949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:06.365958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 982/1944] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:06 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:06.379831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d2f1f-5604-44b2-a97d-afa9ce9f66dd admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:06.381860 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6f1d2f1f-5604-44b2-a97d-afa9ce9f66dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:06.459072 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1d2f1f-5604-44b2-a97d-afa9ce9f66dd admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:06.462952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2a61d6-2cf8-42a5-b1b4-849e1fd8cb35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:06.463577 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a61d6-2cf8-42a5-b1b4-849e1fd8cb35 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:06.463873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a61d6-2cf8-42a5-b1b4-849e1fd8cb35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:06.464142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2a61d6-2cf8-42a5-b1b4-849e1fd8cb35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:06.475017 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a61d6-2cf8-42a5-b1b4-849e1fd8cb35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:06.476467 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2a61d6-2cf8-42a5-b1b4-849e1fd8cb35 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:06.486591 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 963/1945] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:06 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:06.564397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cf10a-202b-48c5-9fcc-23679d5c0ddf None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:06.628216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3cf10a-202b-48c5-9fcc-23679d5c0ddf None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:06.632762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f2342-b49a-4744-944d-c77e2ebb4fe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:06.633406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f2342-b49a-4744-944d-c77e2ebb4fe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:06.633688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f2342-b49a-4744-944d-c77e2ebb4fe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:06.633963 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11f2342-b49a-4744-944d-c77e2ebb4fe2 admin admin] PATH_INFO: `/v3/users/08e5e0067c9b4c309103a0eb2fc60385` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:06.635292 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f2342-b49a-4744-944d-c77e2ebb4fe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08e5e0067c9b4c309103a0eb2fc60385)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:06.637252 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11f2342-b49a-4744-944d-c77e2ebb4fe2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:06.702621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b11f2342-b49a-4744-944d-c77e2ebb4fe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08e5e0067c9b4c309103a0eb2fc60385'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:06.728874 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b11f2342-b49a-4744-944d-c77e2ebb4fe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08e5e0067c9b4c309103a0eb2fc60385'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:06.739512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b11f2342-b49a-4744-944d-c77e2ebb4fe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08e5e0067c9b4c309103a0eb2fc60385'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:06.740399 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b11f2342-b49a-4744-944d-c77e2ebb4fe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08e5e0067c9b4c309103a0eb2fc60385'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:06.752989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b11f2342-b49a-4744-944d-c77e2ebb4fe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08e5e0067c9b4c309103a0eb2fc60385'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:06.762432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 983/1946] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:06 2022] DELETE /identity/v3/users/08e5e0067c9b4c309103a0eb2fc60385 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:06.772178 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bc955-d6b5-49ea-be80-4f0ec6a4c8fb None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:06.772492 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bc955-d6b5-49ea-be80-4f0ec6a4c8fb None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:06.772809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bc955-d6b5-49ea-be80-4f0ec6a4c8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:06.795234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b35bc955-d6b5-49ea-be80-4f0ec6a4c8fb None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:06.796448 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b35bc955-d6b5-49ea-be80-4f0ec6a4c8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:06.880076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 964/1947] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:06.891090 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f2342-b49a-4744-944d-c77e2ebb4fe2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:06.899637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b11f2342-b49a-4744-944d-c77e2ebb4fe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:06.928974 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:06.983209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11f2342-b49a-4744-944d-c77e2ebb4fe2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:07.004616 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de8fa8-7e5c-428e-b334-516f1f729158 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:07.005275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de8fa8-7e5c-428e-b334-516f1f729158 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:07.005560 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de8fa8-7e5c-428e-b334-516f1f729158 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:07.005826 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0de8fa8-7e5c-428e-b334-516f1f729158 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:07.020885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de8fa8-7e5c-428e-b334-516f1f729158 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:07.023368 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0de8fa8-7e5c-428e-b334-516f1f729158 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:07.040575 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 984/1948] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:08.427303 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bc955-d6b5-49ea-be80-4f0ec6a4c8fb None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:08.429220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b35bc955-d6b5-49ea-be80-4f0ec6a4c8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:08.452761 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bc955-d6b5-49ea-be80-4f0ec6a4c8fb None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:08.465890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:08.467087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:08.467370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:08.467824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690 admin admin] PATH_INFO: `/v3/projects/b22d32c0fda644f5b3bbf83d26e3a254` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:08.469198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b22d32c0fda644f5b3bbf83d26e3a254)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:08.473574 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:08.504432 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:08.606234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b22d32c0fda644f5b3bbf83d26e3a254', 'request_id': 'req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:08.619426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b22d32c0fda644f5b3bbf83d26e3a254', 'request_id': 'req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:08.636413 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b22d32c0fda644f5b3bbf83d26e3a254', 'request_id': 'req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:08.655719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690 admin admin] The token cache is being invalidate because project b22d32c0fda644f5b3bbf83d26e3a254 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:08.656018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:08.659120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:08.672310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de8fa8-7e5c-428e-b334-516f1f729158 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:08.673351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 965/1949] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:08 2022] DELETE /identity/v3/projects/b22d32c0fda644f5b3bbf83d26e3a254 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:08.675866 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0de8fa8-7e5c-428e-b334-516f1f729158 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:08.762983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6b39b0-c1e7-4ecb-8bc5-59b45083cffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:08.763788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b39b0-c1e7-4ecb-8bc5-59b45083cffe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:08.764518 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b39b0-c1e7-4ecb-8bc5-59b45083cffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:08.764881 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6b39b0-c1e7-4ecb-8bc5-59b45083cffe admin admin] PATH_INFO: `/v3/users/1b0f0c93b5014fd9a6a836badd861178` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:08.767641 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b39b0-c1e7-4ecb-8bc5-59b45083cffe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b0f0c93b5014fd9a6a836badd861178)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:08.771055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6b39b0-c1e7-4ecb-8bc5-59b45083cffe admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:08.889986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7f6b39b0-c1e7-4ecb-8bc5-59b45083cffe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b0f0c93b5014fd9a6a836badd861178'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:08.910024 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7f6b39b0-c1e7-4ecb-8bc5-59b45083cffe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b0f0c93b5014fd9a6a836badd861178'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:08.921322 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7f6b39b0-c1e7-4ecb-8bc5-59b45083cffe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b0f0c93b5014fd9a6a836badd861178'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:08.922257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7f6b39b0-c1e7-4ecb-8bc5-59b45083cffe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b0f0c93b5014fd9a6a836badd861178'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:08.944344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7f6b39b0-c1e7-4ecb-8bc5-59b45083cffe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b0f0c93b5014fd9a6a836badd861178'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:08.961166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 985/1950] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:08 2022] DELETE /identity/v3/users/1b0f0c93b5014fd9a6a836badd861178 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:09.417739 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:09.434165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:09.448056 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5293d-df2e-4bd9-b0e4-0c044cc4f690 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:09.528206 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743acf43-b415-4da3-97c5-5508365d6963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:09.528873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743acf43-b415-4da3-97c5-5508365d6963 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.529158 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743acf43-b415-4da3-97c5-5508365d6963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.529438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743acf43-b415-4da3-97c5-5508365d6963 admin admin] PATH_INFO: `/v3/projects/968a3b81613f48fc9d929b3d61ddcc47` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.530963 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743acf43-b415-4da3-97c5-5508365d6963 admin admin] RBAC: Authorizing `identity:delete_project(project_id=968a3b81613f48fc9d929b3d61ddcc47)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:09.533745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743acf43-b415-4da3-97c5-5508365d6963 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:09.584291 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-743acf43-b415-4da3-97c5-5508365d6963 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '968a3b81613f48fc9d929b3d61ddcc47', 'request_id': 'req-743acf43-b415-4da3-97c5-5508365d6963'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:09.596381 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-743acf43-b415-4da3-97c5-5508365d6963 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '968a3b81613f48fc9d929b3d61ddcc47', 'request_id': 'req-743acf43-b415-4da3-97c5-5508365d6963'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:09.605685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-743acf43-b415-4da3-97c5-5508365d6963 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '968a3b81613f48fc9d929b3d61ddcc47', 'request_id': 'req-743acf43-b415-4da3-97c5-5508365d6963'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:09.620118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-743acf43-b415-4da3-97c5-5508365d6963 admin admin] The token cache is being invalidate because project 968a3b81613f48fc9d929b3d61ddcc47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:09.620503 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-743acf43-b415-4da3-97c5-5508365d6963 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:09.621220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-743acf43-b415-4da3-97c5-5508365d6963 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:09.622831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 966/1951] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:09 2022] DELETE /identity/v3/projects/968a3b81613f48fc9d929b3d61ddcc47 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:09.627680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2a5f0-11f3-4d24-9b38-08e057509a4e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.628045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2a5f0-11f3-4d24-9b38-08e057509a4e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.628391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c2a5f0-11f3-4d24-9b38-08e057509a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.649885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-94c2a5f0-11f3-4d24-9b38-08e057509a4e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:09.651148 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-94c2a5f0-11f3-4d24-9b38-08e057509a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:09.693090 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:09.718960 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 986/1952] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:09.727562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b78f24-ef83-4de2-9a03-700aadc1e70e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.727939 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b78f24-ef83-4de2-9a03-700aadc1e70e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.728291 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b78f24-ef83-4de2-9a03-700aadc1e70e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.748355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c7b78f24-ef83-4de2-9a03-700aadc1e70e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:09.749567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c7b78f24-ef83-4de2-9a03-700aadc1e70e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:09.758733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 967/1953] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:09.764397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2a5f0-11f3-4d24-9b38-08e057509a4e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:09.778206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c2a5f0-11f3-4d24-9b38-08e057509a4e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:09.784612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201ad31-8027-4eee-987b-9532efc8969d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:09.785456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ad31-8027-4eee-987b-9532efc8969d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.785815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ad31-8027-4eee-987b-9532efc8969d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.786634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4201ad31-8027-4eee-987b-9532efc8969d admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.787420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201ad31-8027-4eee-987b-9532efc8969d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:23:09.788289 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201ad31-8027-4eee-987b-9532efc8969d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:09.790151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4201ad31-8027-4eee-987b-9532efc8969d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:09.808004 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 987/1954] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:23:09.811546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b78f24-ef83-4de2-9a03-700aadc1e70e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:09.830534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b78f24-ef83-4de2-9a03-700aadc1e70e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:09.837340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e809be-cdf2-4989-a2a5-90fdfbdc8838 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:09.837970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e809be-cdf2-4989-a2a5-90fdfbdc8838 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.838397 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e809be-cdf2-4989-a2a5-90fdfbdc8838 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.838706 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e809be-cdf2-4989-a2a5-90fdfbdc8838 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.839557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e809be-cdf2-4989-a2a5-90fdfbdc8838 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:09.841629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e809be-cdf2-4989-a2a5-90fdfbdc8838 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:09.865345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:09.878796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 968/1955] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:09 2022] POST /identity/v3/projects => generated 375 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:09.879764 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201ad31-8027-4eee-987b-9532efc8969d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:09.894479 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4201ad31-8027-4eee-987b-9532efc8969d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:09.963790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e42fb-2c91-4583-a1fa-9d8f7c45b91f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:09.965066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e42fb-2c91-4583-a1fa-9d8f7c45b91f admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:09.965066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e42fb-2c91-4583-a1fa-9d8f7c45b91f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:09.965256 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e42fb-2c91-4583-a1fa-9d8f7c45b91f admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:09.965771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e42fb-2c91-4583-a1fa-9d8f7c45b91f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:09.967858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e42fb-2c91-4583-a1fa-9d8f7c45b91f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:10.008403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 988/1956] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:09 2022] POST /identity/v3/users => generated 288 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:23:10.009867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e809be-cdf2-4989-a2a5-90fdfbdc8838 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:10.021332 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e809be-cdf2-4989-a2a5-90fdfbdc8838 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:10.031105 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acb5e5-6ce9-4782-87a5-a4f5b0176ed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:10.031875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acb5e5-6ce9-4782-87a5-a4f5b0176ed0 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:10.032873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acb5e5-6ce9-4782-87a5-a4f5b0176ed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:10.033253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7acb5e5-6ce9-4782-87a5-a4f5b0176ed0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:10.033959 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acb5e5-6ce9-4782-87a5-a4f5b0176ed0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:10.035936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7acb5e5-6ce9-4782-87a5-a4f5b0176ed0 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:10.051271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 969/1957] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:10.056392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e42fb-2c91-4583-a1fa-9d8f7c45b91f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:10.076238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e42fb-2c91-4583-a1fa-9d8f7c45b91f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:10.081901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb911ed8-255f-4f16-b2da-7460ac208e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:10.082513 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb911ed8-255f-4f16-b2da-7460ac208e2f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:10.082820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb911ed8-255f-4f16-b2da-7460ac208e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:10.083091 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb911ed8-255f-4f16-b2da-7460ac208e2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:10.083782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb911ed8-255f-4f16-b2da-7460ac208e2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:10.085662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb911ed8-255f-4f16-b2da-7460ac208e2f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:10.099014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 989/1958] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:10.103009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acb5e5-6ce9-4782-87a5-a4f5b0176ed0 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:10.114856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7acb5e5-6ce9-4782-87a5-a4f5b0176ed0 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:10.121296 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db65f7a-1bba-44ab-a35b-35181a4c6d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:10.122063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db65f7a-1bba-44ab-a35b-35181a4c6d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:10.122552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db65f7a-1bba-44ab-a35b-35181a4c6d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:10.122946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db65f7a-1bba-44ab-a35b-35181a4c6d8c admin admin] PATH_INFO: `/v3/projects/76685b4dc0dd48879a4bcad7f47cb5f5/users/bc4103999e4f4a72a904bc236d49a884/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:10.143769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db65f7a-1bba-44ab-a35b-35181a4c6d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=76685b4dc0dd48879a4bcad7f47cb5f5, user_id=bc4103999e4f4a72a904bc236d49a884, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:10.146787 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db65f7a-1bba-44ab-a35b-35181a4c6d8c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:10.163035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 970/1959] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:10 2022] PUT /identity/v3/projects/76685b4dc0dd48879a4bcad7f47cb5f5/users/bc4103999e4f4a72a904bc236d49a884/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:10.180195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ccad-08ed-4574-9d49-c019c9460a03 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:10.180639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ccad-08ed-4574-9d49-c019c9460a03 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:10.181057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ccad-08ed-4574-9d49-c019c9460a03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:10.242864 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d670ccad-08ed-4574-9d49-c019c9460a03 None None] MFA Rules not processed for user `bc4103999e4f4a72a904bc236d49a884`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:10.244760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d670ccad-08ed-4574-9d49-c019c9460a03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:10.349683 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 990/1960] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:10.354522 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db65f7a-1bba-44ab-a35b-35181a4c6d8c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:10.461327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db65f7a-1bba-44ab-a35b-35181a4c6d8c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:10.467712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68057b7c-3abd-4adb-ab13-d666f895dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:10.468360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68057b7c-3abd-4adb-ab13-d666f895dd24 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:10.468638 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68057b7c-3abd-4adb-ab13-d666f895dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:10.469952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68057b7c-3abd-4adb-ab13-d666f895dd24 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:10.469952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68057b7c-3abd-4adb-ab13-d666f895dd24 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:10.472268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68057b7c-3abd-4adb-ab13-d666f895dd24 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:10.504842 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 971/1961] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:10 2022] POST /identity/v3/projects => generated 377 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:23:10.508913 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670ccad-08ed-4574-9d49-c019c9460a03 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:10.523942 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670ccad-08ed-4574-9d49-c019c9460a03 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:10.570760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:10.608172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9352b1-fd40-446b-bf14-4ba7a9975570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:10.608815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9352b1-fd40-446b-bf14-4ba7a9975570 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:10.609097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9352b1-fd40-446b-bf14-4ba7a9975570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:10.609369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9352b1-fd40-446b-bf14-4ba7a9975570 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:10.610748 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9352b1-fd40-446b-bf14-4ba7a9975570 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:10.612690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9352b1-fd40-446b-bf14-4ba7a9975570 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:10.642461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 991/1962] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:10 2022] POST /identity/v3/users => generated 289 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:23:10.646220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68057b7c-3abd-4adb-ab13-d666f895dd24 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:10.664371 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68057b7c-3abd-4adb-ab13-d666f895dd24 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:10.670451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990642bb-05ad-4e07-b9d5-0daab182c36c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:10.670993 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990642bb-05ad-4e07-b9d5-0daab182c36c admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:10.671443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990642bb-05ad-4e07-b9d5-0daab182c36c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:10.671817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990642bb-05ad-4e07-b9d5-0daab182c36c admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:10.673422 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990642bb-05ad-4e07-b9d5-0daab182c36c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:10.675619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990642bb-05ad-4e07-b9d5-0daab182c36c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:10.698074 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 972/1963] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:10.702835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9352b1-fd40-446b-bf14-4ba7a9975570 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:10.716640 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9352b1-fd40-446b-bf14-4ba7a9975570 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:10.729903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d160ded-11b6-4102-8558-7e6ddac0f9cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:10.731352 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d160ded-11b6-4102-8558-7e6ddac0f9cb admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:10.731744 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d160ded-11b6-4102-8558-7e6ddac0f9cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:10.732145 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d160ded-11b6-4102-8558-7e6ddac0f9cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:10.733659 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d160ded-11b6-4102-8558-7e6ddac0f9cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:10.736719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d160ded-11b6-4102-8558-7e6ddac0f9cb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:10.761421 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990642bb-05ad-4e07-b9d5-0daab182c36c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:10.771818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 992/1964] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:10.776247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990642bb-05ad-4e07-b9d5-0daab182c36c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:10.781100 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca067c34-4574-4383-b5da-5df148b95f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:10.781872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca067c34-4574-4383-b5da-5df148b95f85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:10.782473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca067c34-4574-4383-b5da-5df148b95f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:10.787012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca067c34-4574-4383-b5da-5df148b95f85 admin admin] PATH_INFO: `/v3/projects/6d5b1c67da774886a2cf91471e0b950a/users/df9a809dc13f47e6b6fff5a95c5ab302/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:10.834430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca067c34-4574-4383-b5da-5df148b95f85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d5b1c67da774886a2cf91471e0b950a, user_id=df9a809dc13f47e6b6fff5a95c5ab302, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:10.838570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca067c34-4574-4383-b5da-5df148b95f85 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:10.880774 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 973/1965] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:10 2022] PUT /identity/v3/projects/6d5b1c67da774886a2cf91471e0b950a/users/df9a809dc13f47e6b6fff5a95c5ab302/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:10.893355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96553c-776c-4524-a3a8-3f8bba861aa3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:10.893644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96553c-776c-4524-a3a8-3f8bba861aa3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:10.893929 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc96553c-776c-4524-a3a8-3f8bba861aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:10.967054 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-bc96553c-776c-4524-a3a8-3f8bba861aa3 None None] MFA Rules not processed for user `df9a809dc13f47e6b6fff5a95c5ab302`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:10.969651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bc96553c-776c-4524-a3a8-3f8bba861aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:11.084551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 993/1966] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:11.087711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca067c34-4574-4383-b5da-5df148b95f85 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:11.263607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca067c34-4574-4383-b5da-5df148b95f85 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:11.274236 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88496a0-2371-443d-8439-dba8fa380732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:11.275087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88496a0-2371-443d-8439-dba8fa380732 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:11.275371 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88496a0-2371-443d-8439-dba8fa380732 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:11.275671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88496a0-2371-443d-8439-dba8fa380732 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:11.276344 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88496a0-2371-443d-8439-dba8fa380732 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:11.278331 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88496a0-2371-443d-8439-dba8fa380732 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:11.310282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:11.325500 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 974/1967] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:11 2022] POST /identity/v3/projects => generated 377 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:11.327073 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96553c-776c-4524-a3a8-3f8bba861aa3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:11.339720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc96553c-776c-4524-a3a8-3f8bba861aa3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:11.431283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a647be-3d8b-4f2f-b1c1-1e5433cb72bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:11.431283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a647be-3d8b-4f2f-b1c1-1e5433cb72bd admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:11.431283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a647be-3d8b-4f2f-b1c1-1e5433cb72bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:11.431283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a647be-3d8b-4f2f-b1c1-1e5433cb72bd admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:11.431879 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a647be-3d8b-4f2f-b1c1-1e5433cb72bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:11.434328 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a647be-3d8b-4f2f-b1c1-1e5433cb72bd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:11.475508 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 994/1968] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:11 2022] POST /identity/v3/users => generated 295 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:11.479416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88496a0-2371-443d-8439-dba8fa380732 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:11.499192 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88496a0-2371-443d-8439-dba8fa380732 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:11.526835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ae890-f28e-4c90-b70a-b56e54ab0a65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:11.527688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ae890-f28e-4c90-b70a-b56e54ab0a65 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:11.527972 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ae890-f28e-4c90-b70a-b56e54ab0a65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:11.528247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12ae890-f28e-4c90-b70a-b56e54ab0a65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:11.529134 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ae890-f28e-4c90-b70a-b56e54ab0a65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:11.531094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12ae890-f28e-4c90-b70a-b56e54ab0a65 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:11.571981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a647be-3d8b-4f2f-b1c1-1e5433cb72bd admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:11.575450 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 975/1969] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:11.585022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a647be-3d8b-4f2f-b1c1-1e5433cb72bd admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:11.595920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7941d0-f8d0-40cc-bd5b-a48021c40208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:11.597581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7941d0-f8d0-40cc-bd5b-a48021c40208 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:11.598020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7941d0-f8d0-40cc-bd5b-a48021c40208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:11.598450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7941d0-f8d0-40cc-bd5b-a48021c40208 admin admin] PATH_INFO: `/v3/projects/95f1d87ea3294f039ee9168a579082b4/users/ec0aca101f154ef7a0699ec0fe9b90e4/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:11.636581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7941d0-f8d0-40cc-bd5b-a48021c40208 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f1d87ea3294f039ee9168a579082b4, user_id=ec0aca101f154ef7a0699ec0fe9b90e4, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:11.641126 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7941d0-f8d0-40cc-bd5b-a48021c40208 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:11.671635 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ae890-f28e-4c90-b70a-b56e54ab0a65 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:11.672082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 995/1970] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:11 2022] PUT /identity/v3/projects/95f1d87ea3294f039ee9168a579082b4/users/ec0aca101f154ef7a0699ec0fe9b90e4/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:11.684158 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12ae890-f28e-4c90-b70a-b56e54ab0a65 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:11.760431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0409c21-35b2-4929-816c-f2a9c24aa929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:11.761111 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0409c21-35b2-4929-816c-f2a9c24aa929 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:11.761394 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0409c21-35b2-4929-816c-f2a9c24aa929 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:11.761663 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0409c21-35b2-4929-816c-f2a9c24aa929 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:11.762495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0409c21-35b2-4929-816c-f2a9c24aa929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:11.764773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0409c21-35b2-4929-816c-f2a9c24aa929 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:11.778247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 976/1971] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:11.780357 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7941d0-f8d0-40cc-bd5b-a48021c40208 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:11.792180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7941d0-f8d0-40cc-bd5b-a48021c40208 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:11.802024 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4290bb-6389-44af-aa98-59d4a0ead179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:11.802878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4290bb-6389-44af-aa98-59d4a0ead179 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:11.803167 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4290bb-6389-44af-aa98-59d4a0ead179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:11.803535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4290bb-6389-44af-aa98-59d4a0ead179 admin admin] PATH_INFO: `/v3/projects/95f1d87ea3294f039ee9168a579082b4/users/ec0aca101f154ef7a0699ec0fe9b90e4/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:11.805563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4290bb-6389-44af-aa98-59d4a0ead179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95f1d87ea3294f039ee9168a579082b4, user_id=ec0aca101f154ef7a0699ec0fe9b90e4, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:11.808282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4290bb-6389-44af-aa98-59d4a0ead179 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:11.814923 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:11.821834 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 996/1972] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:11 2022] PUT /identity/v3/projects/95f1d87ea3294f039ee9168a579082b4/users/ec0aca101f154ef7a0699ec0fe9b90e4/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:11.833188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690188a-f1f5-42ed-b88f-272315c9c3d0 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:11.833467 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690188a-f1f5-42ed-b88f-272315c9c3d0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:11.833734 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b690188a-f1f5-42ed-b88f-272315c9c3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:11.863936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b690188a-f1f5-42ed-b88f-272315c9c3d0 None None] MFA Rules not processed for user `ec0aca101f154ef7a0699ec0fe9b90e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:11.865130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b690188a-f1f5-42ed-b88f-272315c9c3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:11.937500 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 977/1973] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:11.949099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4290bb-6389-44af-aa98-59d4a0ead179 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:11.950863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1b4290bb-6389-44af-aa98-59d4a0ead179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:12.036954 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4290bb-6389-44af-aa98-59d4a0ead179 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:12.040960 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db9bfc-0d9a-468c-a115-75962213c65e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:12.041578 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db9bfc-0d9a-468c-a115-75962213c65e service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:12.041859 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db9bfc-0d9a-468c-a115-75962213c65e service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:12.042129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67db9bfc-0d9a-468c-a115-75962213c65e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:12.099377 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db9bfc-0d9a-468c-a115-75962213c65e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:12.100844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67db9bfc-0d9a-468c-a115-75962213c65e service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:12.109767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 997/1974] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:13.702789 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690188a-f1f5-42ed-b88f-272315c9c3d0 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:13.705490 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b690188a-f1f5-42ed-b88f-272315c9c3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:13.722214 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b690188a-f1f5-42ed-b88f-272315c9c3d0 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:13.723762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db9bfc-0d9a-468c-a115-75962213c65e service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:13.725411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-67db9bfc-0d9a-468c-a115-75962213c65e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:13.727384 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2f9a23-9df8-411f-8363-8e4ecc6f8b7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:13.728015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f9a23-9df8-411f-8363-8e4ecc6f8b7c service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:13.728297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f9a23-9df8-411f-8363-8e4ecc6f8b7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:13.728570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2f9a23-9df8-411f-8363-8e4ecc6f8b7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:13.796042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f9a23-9df8-411f-8363-8e4ecc6f8b7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:13.798232 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2f9a23-9df8-411f-8363-8e4ecc6f8b7c service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:13.807733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67db9bfc-0d9a-468c-a115-75962213c65e service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:13.812234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 978/1975] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:13 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:13.814205 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80419d30-e5a5-4e6f-8611-d5b199e3413a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:13.814923 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80419d30-e5a5-4e6f-8611-d5b199e3413a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:13.815206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80419d30-e5a5-4e6f-8611-d5b199e3413a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:13.815483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80419d30-e5a5-4e6f-8611-d5b199e3413a admin admin] PATH_INFO: `/v3/users/3f6922147b2a4669a05ed8c00680a8f8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:13.817087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80419d30-e5a5-4e6f-8611-d5b199e3413a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3f6922147b2a4669a05ed8c00680a8f8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:13.821234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80419d30-e5a5-4e6f-8611-d5b199e3413a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:13.901226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-80419d30-e5a5-4e6f-8611-d5b199e3413a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3f6922147b2a4669a05ed8c00680a8f8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:13.908387 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:13.920841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-80419d30-e5a5-4e6f-8611-d5b199e3413a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3f6922147b2a4669a05ed8c00680a8f8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:13.930882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-80419d30-e5a5-4e6f-8611-d5b199e3413a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3f6922147b2a4669a05ed8c00680a8f8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:13.931965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-80419d30-e5a5-4e6f-8611-d5b199e3413a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3f6922147b2a4669a05ed8c00680a8f8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:13.940568 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-80419d30-e5a5-4e6f-8611-d5b199e3413a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3f6922147b2a4669a05ed8c00680a8f8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:13.951441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 998/1976] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:13 2022] DELETE /identity/v3/users/3f6922147b2a4669a05ed8c00680a8f8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:13.958208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c42cba-74d6-4c4c-a96b-d436fa65b735 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:13.958543 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c42cba-74d6-4c4c-a96b-d436fa65b735 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:13.959270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c42cba-74d6-4c4c-a96b-d436fa65b735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:13.975102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:13.982343 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a6c42cba-74d6-4c4c-a96b-d436fa65b735 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:13.983694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a6c42cba-74d6-4c4c-a96b-d436fa65b735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:14.063988 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 979/1977] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:14.074155 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80419d30-e5a5-4e6f-8611-d5b199e3413a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:14.075639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-80419d30-e5a5-4e6f-8611-d5b199e3413a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:14.211663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80419d30-e5a5-4e6f-8611-d5b199e3413a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:14.216159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6ab17-5dc7-4f37-924c-743a6f28895f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:14.216802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6ab17-5dc7-4f37-924c-743a6f28895f service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:14.217080 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6ab17-5dc7-4f37-924c-743a6f28895f service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:14.217449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e6ab17-5dc7-4f37-924c-743a6f28895f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:14.230045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6ab17-5dc7-4f37-924c-743a6f28895f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:14.231618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e6ab17-5dc7-4f37-924c-743a6f28895f service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:14.254324 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 999/1978] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:14.830136 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c42cba-74d6-4c4c-a96b-d436fa65b735 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:14.835498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a6c42cba-74d6-4c4c-a96b-d436fa65b735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:14.843742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6ab17-5dc7-4f37-924c-743a6f28895f service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:14.845828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-45e6ab17-5dc7-4f37-924c-743a6f28895f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:14.850807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c42cba-74d6-4c4c-a96b-d436fa65b735 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:14.864950 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb520b74-efb0-4846-9323-bf047f69c73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:14.865611 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb520b74-efb0-4846-9323-bf047f69c73d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:14.866044 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb520b74-efb0-4846-9323-bf047f69c73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:14.866463 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb520b74-efb0-4846-9323-bf047f69c73d admin admin] PATH_INFO: `/v3/projects/67ccfc9bcd0b47c38070c6b2137a0731` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:14.867849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb520b74-efb0-4846-9323-bf047f69c73d admin admin] RBAC: Authorizing `identity:delete_project(project_id=67ccfc9bcd0b47c38070c6b2137a0731)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:14.869927 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb520b74-efb0-4846-9323-bf047f69c73d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:14.924271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e6ab17-5dc7-4f37-924c-743a6f28895f service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:14.942717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bb520b74-efb0-4846-9323-bf047f69c73d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '67ccfc9bcd0b47c38070c6b2137a0731', 'request_id': 'req-bb520b74-efb0-4846-9323-bf047f69c73d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:14.950515 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bb520b74-efb0-4846-9323-bf047f69c73d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '67ccfc9bcd0b47c38070c6b2137a0731', 'request_id': 'req-bb520b74-efb0-4846-9323-bf047f69c73d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:14.963794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bb520b74-efb0-4846-9323-bf047f69c73d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '67ccfc9bcd0b47c38070c6b2137a0731', 'request_id': 'req-bb520b74-efb0-4846-9323-bf047f69c73d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:14.982401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bb520b74-efb0-4846-9323-bf047f69c73d admin admin] The token cache is being invalidate because project 67ccfc9bcd0b47c38070c6b2137a0731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:14.983628 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bb520b74-efb0-4846-9323-bf047f69c73d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:14.984317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bb520b74-efb0-4846-9323-bf047f69c73d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:14.986895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 980/1979] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:14 2022] DELETE /identity/v3/projects/67ccfc9bcd0b47c38070c6b2137a0731 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:15.007732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84fd496-2e72-4d2c-8b54-aa1d52872504 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:15.008393 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fd496-2e72-4d2c-8b54-aa1d52872504 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:15.008677 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fd496-2e72-4d2c-8b54-aa1d52872504 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:15.009100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84fd496-2e72-4d2c-8b54-aa1d52872504 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:15.011098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d84fd496-2e72-4d2c-8b54-aa1d52872504 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:15.072790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:15.097663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fd496-2e72-4d2c-8b54-aa1d52872504 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:15.099200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84fd496-2e72-4d2c-8b54-aa1d52872504 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:15.111621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1000/1980] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:19.235748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb520b74-efb0-4846-9323-bf047f69c73d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:19.237216 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bb520b74-efb0-4846-9323-bf047f69c73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:19.304698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb520b74-efb0-4846-9323-bf047f69c73d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:19.311881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e566e-25de-4fb8-9d79-6b6529f97b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:19.313025 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e566e-25de-4fb8-9d79-6b6529f97b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:19.313321 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e566e-25de-4fb8-9d79-6b6529f97b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:19.313596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e566e-25de-4fb8-9d79-6b6529f97b56 admin admin] PATH_INFO: `/v3/users/bc4103999e4f4a72a904bc236d49a884` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:19.314831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e566e-25de-4fb8-9d79-6b6529f97b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc4103999e4f4a72a904bc236d49a884)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:19.316785 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3e566e-25de-4fb8-9d79-6b6529f97b56 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:19.356113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:19.376843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ff3e566e-25de-4fb8-9d79-6b6529f97b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc4103999e4f4a72a904bc236d49a884'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:19.384659 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ff3e566e-25de-4fb8-9d79-6b6529f97b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc4103999e4f4a72a904bc236d49a884'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:19.397202 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ff3e566e-25de-4fb8-9d79-6b6529f97b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc4103999e4f4a72a904bc236d49a884'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:19.397832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ff3e566e-25de-4fb8-9d79-6b6529f97b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc4103999e4f4a72a904bc236d49a884'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:19.404741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ff3e566e-25de-4fb8-9d79-6b6529f97b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc4103999e4f4a72a904bc236d49a884'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:19.410648 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 981/1981] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:19 2022] DELETE /identity/v3/users/bc4103999e4f4a72a904bc236d49a884 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:19.415095 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78064fc-b70c-4521-961e-0a9f9d1834b9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:19.415560 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78064fc-b70c-4521-961e-0a9f9d1834b9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:19.415651 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78064fc-b70c-4521-961e-0a9f9d1834b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:19.434200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d78064fc-b70c-4521-961e-0a9f9d1834b9 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:19.435450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d78064fc-b70c-4521-961e-0a9f9d1834b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:19.495042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1001/1982] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:19.505583 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e566e-25de-4fb8-9d79-6b6529f97b56 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:19.507024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ff3e566e-25de-4fb8-9d79-6b6529f97b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:19.564826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e566e-25de-4fb8-9d79-6b6529f97b56 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:19.568443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c8dcfb-b2f0-430c-b74e-ac533b882ffd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:19.569058 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8dcfb-b2f0-430c-b74e-ac533b882ffd service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:19.569339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8dcfb-b2f0-430c-b74e-ac533b882ffd service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:19.569611 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c8dcfb-b2f0-430c-b74e-ac533b882ffd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:19.582199 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8dcfb-b2f0-430c-b74e-ac533b882ffd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:19.583787 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c8dcfb-b2f0-430c-b74e-ac533b882ffd service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:19.594090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 982/1983] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:19.631830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78064fc-b70c-4521-961e-0a9f9d1834b9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:19.634013 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d78064fc-b70c-4521-961e-0a9f9d1834b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:19.647317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78064fc-b70c-4521-961e-0a9f9d1834b9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:19.656094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8815ee-7a15-48af-a9cd-e5b1ea5f897f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:19.657184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8815ee-7a15-48af-a9cd-e5b1ea5f897f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:19.657657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8815ee-7a15-48af-a9cd-e5b1ea5f897f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:19.658173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8815ee-7a15-48af-a9cd-e5b1ea5f897f admin admin] PATH_INFO: `/v3/users/b52b2a4929ba48e0885aa94d14b17fce` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:19.659850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8815ee-7a15-48af-a9cd-e5b1ea5f897f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b52b2a4929ba48e0885aa94d14b17fce)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:19.661876 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8815ee-7a15-48af-a9cd-e5b1ea5f897f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:19.745380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-9e8815ee-7a15-48af-a9cd-e5b1ea5f897f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b52b2a4929ba48e0885aa94d14b17fce'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:19.767385 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-9e8815ee-7a15-48af-a9cd-e5b1ea5f897f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b52b2a4929ba48e0885aa94d14b17fce'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:19.774265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-9e8815ee-7a15-48af-a9cd-e5b1ea5f897f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b52b2a4929ba48e0885aa94d14b17fce'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:19.776085 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-9e8815ee-7a15-48af-a9cd-e5b1ea5f897f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b52b2a4929ba48e0885aa94d14b17fce'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:19.795174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-9e8815ee-7a15-48af-a9cd-e5b1ea5f897f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b52b2a4929ba48e0885aa94d14b17fce'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:19.809882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1002/1984] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:19 2022] DELETE /identity/v3/users/b52b2a4929ba48e0885aa94d14b17fce => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:19.819278 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef4b1f-78aa-4f36-8416-f79c34a8be4b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:19.819741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef4b1f-78aa-4f36-8416-f79c34a8be4b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:19.820177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ef4b1f-78aa-4f36-8416-f79c34a8be4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:19.841782 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c3ef4b1f-78aa-4f36-8416-f79c34a8be4b None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:19.843224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c3ef4b1f-78aa-4f36-8416-f79c34a8be4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:19.915251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 983/1985] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:19.925175 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8815ee-7a15-48af-a9cd-e5b1ea5f897f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:19.926827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9e8815ee-7a15-48af-a9cd-e5b1ea5f897f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:19.949735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef4b1f-78aa-4f36-8416-f79c34a8be4b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:19.951393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c3ef4b1f-78aa-4f36-8416-f79c34a8be4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:19.965132 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ef4b1f-78aa-4f36-8416-f79c34a8be4b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:19.971179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce389e76-cb55-4656-827b-be5940adde27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:19.972068 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce389e76-cb55-4656-827b-be5940adde27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:19.972417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce389e76-cb55-4656-827b-be5940adde27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:19.973223 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce389e76-cb55-4656-827b-be5940adde27 admin admin] PATH_INFO: `/v3/projects/76685b4dc0dd48879a4bcad7f47cb5f5` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:19.974627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce389e76-cb55-4656-827b-be5940adde27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76685b4dc0dd48879a4bcad7f47cb5f5)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:19.976696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce389e76-cb55-4656-827b-be5940adde27 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:20.025921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8815ee-7a15-48af-a9cd-e5b1ea5f897f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:20.030710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:20.040605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:20.041634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ce389e76-cb55-4656-827b-be5940adde27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76685b4dc0dd48879a4bcad7f47cb5f5', 'request_id': 'req-ce389e76-cb55-4656-827b-be5940adde27'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.048156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ce389e76-cb55-4656-827b-be5940adde27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76685b4dc0dd48879a4bcad7f47cb5f5', 'request_id': 'req-ce389e76-cb55-4656-827b-be5940adde27'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.056327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ce389e76-cb55-4656-827b-be5940adde27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76685b4dc0dd48879a4bcad7f47cb5f5', 'request_id': 'req-ce389e76-cb55-4656-827b-be5940adde27'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.071479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ce389e76-cb55-4656-827b-be5940adde27 admin admin] The token cache is being invalidate because project 76685b4dc0dd48879a4bcad7f47cb5f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:20.072060 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ce389e76-cb55-4656-827b-be5940adde27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.073226 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ce389e76-cb55-4656-827b-be5940adde27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.075983 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 984/1986] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:19 2022] DELETE /identity/v3/projects/76685b4dc0dd48879a4bcad7f47cb5f5 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:20.080308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce389e76-cb55-4656-827b-be5940adde27 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:20.081676 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ce389e76-cb55-4656-827b-be5940adde27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:20.085459 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293add24-d506-440b-bc5e-e12266b93a50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:20.086103 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293add24-d506-440b-bc5e-e12266b93a50 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:20.086390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293add24-d506-440b-bc5e-e12266b93a50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:20.086702 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293add24-d506-440b-bc5e-e12266b93a50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:20.089377 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-293add24-d506-440b-bc5e-e12266b93a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:20.167176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce389e76-cb55-4656-827b-be5940adde27 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:20.169924 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293add24-d506-440b-bc5e-e12266b93a50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:20.172685 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293add24-d506-440b-bc5e-e12266b93a50 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:20.172851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8b083-373f-4e72-86ac-246008a40894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:20.173505 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8b083-373f-4e72-86ac-246008a40894 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:20.173782 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8b083-373f-4e72-86ac-246008a40894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:20.174052 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8b083-373f-4e72-86ac-246008a40894 admin admin] PATH_INFO: `/v3/users/df9a809dc13f47e6b6fff5a95c5ab302` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:20.175247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8b083-373f-4e72-86ac-246008a40894 admin admin] RBAC: Authorizing `identity:delete_user(user_id=df9a809dc13f47e6b6fff5a95c5ab302)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:20.177164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8b083-373f-4e72-86ac-246008a40894 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:20.184566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1003/1987] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:23:20.233137 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-53c8b083-373f-4e72-86ac-246008a40894 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df9a809dc13f47e6b6fff5a95c5ab302'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.245946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-53c8b083-373f-4e72-86ac-246008a40894 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df9a809dc13f47e6b6fff5a95c5ab302'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.262487 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-53c8b083-373f-4e72-86ac-246008a40894 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df9a809dc13f47e6b6fff5a95c5ab302'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.263283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-53c8b083-373f-4e72-86ac-246008a40894 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df9a809dc13f47e6b6fff5a95c5ab302'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.282385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-53c8b083-373f-4e72-86ac-246008a40894 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df9a809dc13f47e6b6fff5a95c5ab302'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.289214 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 985/1988] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:20 2022] DELETE /identity/v3/users/df9a809dc13f47e6b6fff5a95c5ab302 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:20.472956 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293add24-d506-440b-bc5e-e12266b93a50 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:20.474708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-293add24-d506-440b-bc5e-e12266b93a50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:20.494800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293add24-d506-440b-bc5e-e12266b93a50 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:20.582902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbf07a-eefb-4751-aa84-1842dd234385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:20.583721 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbf07a-eefb-4751-aa84-1842dd234385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:20.584099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbf07a-eefb-4751-aa84-1842dd234385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:20.584471 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fbf07a-eefb-4751-aa84-1842dd234385 admin admin] PATH_INFO: `/v3/projects/6c20133e93fd48dfa4a90a88256fbbda` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:20.585754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbf07a-eefb-4751-aa84-1842dd234385 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c20133e93fd48dfa4a90a88256fbbda)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:20.587826 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fbf07a-eefb-4751-aa84-1842dd234385 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:20.641994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8b083-373f-4e72-86ac-246008a40894 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:20.643596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-53c8b083-373f-4e72-86ac-246008a40894 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:20.657840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8b083-373f-4e72-86ac-246008a40894 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:20.663401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a1bb5-b61f-4300-aa76-7689fe8096ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:20.664042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a1bb5-b61f-4300-aa76-7689fe8096ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:20.665026 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a1bb5-b61f-4300-aa76-7689fe8096ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:20.665309 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918a1bb5-b61f-4300-aa76-7689fe8096ba admin admin] PATH_INFO: `/v3/projects/6d5b1c67da774886a2cf91471e0b950a` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:20.666835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a1bb5-b61f-4300-aa76-7689fe8096ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d5b1c67da774886a2cf91471e0b950a)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:20.668810 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918a1bb5-b61f-4300-aa76-7689fe8096ba admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:20.684071 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d8fbf07a-eefb-4751-aa84-1842dd234385 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c20133e93fd48dfa4a90a88256fbbda', 'request_id': 'req-d8fbf07a-eefb-4751-aa84-1842dd234385'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.690496 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d8fbf07a-eefb-4751-aa84-1842dd234385 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c20133e93fd48dfa4a90a88256fbbda', 'request_id': 'req-d8fbf07a-eefb-4751-aa84-1842dd234385'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.695823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:20.697232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d8fbf07a-eefb-4751-aa84-1842dd234385 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c20133e93fd48dfa4a90a88256fbbda', 'request_id': 'req-d8fbf07a-eefb-4751-aa84-1842dd234385'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.712980 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d8fbf07a-eefb-4751-aa84-1842dd234385 admin admin] The token cache is being invalidate because project 6c20133e93fd48dfa4a90a88256fbbda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:20.713267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d8fbf07a-eefb-4751-aa84-1842dd234385 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.713906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d8fbf07a-eefb-4751-aa84-1842dd234385 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.715448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1004/1989] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:20 2022] DELETE /identity/v3/projects/6c20133e93fd48dfa4a90a88256fbbda => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:20.719955 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbf07a-eefb-4751-aa84-1842dd234385 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:20.721479 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d8fbf07a-eefb-4751-aa84-1842dd234385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:20.723693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-918a1bb5-b61f-4300-aa76-7689fe8096ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d5b1c67da774886a2cf91471e0b950a', 'request_id': 'req-918a1bb5-b61f-4300-aa76-7689fe8096ba'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.724895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:20.730939 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-918a1bb5-b61f-4300-aa76-7689fe8096ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d5b1c67da774886a2cf91471e0b950a', 'request_id': 'req-918a1bb5-b61f-4300-aa76-7689fe8096ba'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.739836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-918a1bb5-b61f-4300-aa76-7689fe8096ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d5b1c67da774886a2cf91471e0b950a', 'request_id': 'req-918a1bb5-b61f-4300-aa76-7689fe8096ba'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.752071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-918a1bb5-b61f-4300-aa76-7689fe8096ba admin admin] The token cache is being invalidate because project 6d5b1c67da774886a2cf91471e0b950a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:20.752358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-918a1bb5-b61f-4300-aa76-7689fe8096ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.752990 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-918a1bb5-b61f-4300-aa76-7689fe8096ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.754559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 986/1990] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:20 2022] DELETE /identity/v3/projects/6d5b1c67da774886a2cf91471e0b950a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:20.758458 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a1bb5-b61f-4300-aa76-7689fe8096ba admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:20.759822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-918a1bb5-b61f-4300-aa76-7689fe8096ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:20.789878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fbf07a-eefb-4751-aa84-1842dd234385 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:20.824408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918a1bb5-b61f-4300-aa76-7689fe8096ba admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:20.829467 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076e8b9-05c6-479b-8957-923232e7be60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:20.830137 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076e8b9-05c6-479b-8957-923232e7be60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:20.830409 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076e8b9-05c6-479b-8957-923232e7be60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:20.830711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d076e8b9-05c6-479b-8957-923232e7be60 admin admin] PATH_INFO: `/v3/users/ec0aca101f154ef7a0699ec0fe9b90e4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:20.831929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076e8b9-05c6-479b-8957-923232e7be60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec0aca101f154ef7a0699ec0fe9b90e4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:20.833928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d076e8b9-05c6-479b-8957-923232e7be60 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:20.862789 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf0522-c1ad-4781-9291-121e09a7e659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:20.863647 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf0522-c1ad-4781-9291-121e09a7e659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:20.863999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf0522-c1ad-4781-9291-121e09a7e659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:20.864370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcf0522-c1ad-4781-9291-121e09a7e659 admin admin] PATH_INFO: `/v3/users/cdf9a3e1519b4a66bd91c1d9503b24a2` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:20.865797 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf0522-c1ad-4781-9291-121e09a7e659 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdf9a3e1519b4a66bd91c1d9503b24a2)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:20.868142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcf0522-c1ad-4781-9291-121e09a7e659 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:20.892948 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d076e8b9-05c6-479b-8957-923232e7be60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec0aca101f154ef7a0699ec0fe9b90e4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.903006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d076e8b9-05c6-479b-8957-923232e7be60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec0aca101f154ef7a0699ec0fe9b90e4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.916654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d076e8b9-05c6-479b-8957-923232e7be60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec0aca101f154ef7a0699ec0fe9b90e4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.917412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d076e8b9-05c6-479b-8957-923232e7be60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec0aca101f154ef7a0699ec0fe9b90e4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.922554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bcf0522-c1ad-4781-9291-121e09a7e659 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdf9a3e1519b4a66bd91c1d9503b24a2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.926061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d076e8b9-05c6-479b-8957-923232e7be60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec0aca101f154ef7a0699ec0fe9b90e4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.932454 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 987/1991] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:20 2022] DELETE /identity/v3/users/ec0aca101f154ef7a0699ec0fe9b90e4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:20.937260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bcf0522-c1ad-4781-9291-121e09a7e659 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdf9a3e1519b4a66bd91c1d9503b24a2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.946737 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bcf0522-c1ad-4781-9291-121e09a7e659 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdf9a3e1519b4a66bd91c1d9503b24a2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.947502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bcf0522-c1ad-4781-9291-121e09a7e659 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdf9a3e1519b4a66bd91c1d9503b24a2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.956735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1bcf0522-c1ad-4781-9291-121e09a7e659 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdf9a3e1519b4a66bd91c1d9503b24a2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:20.963665 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1005/1992] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:20 2022] DELETE /identity/v3/users/cdf9a3e1519b4a66bd91c1d9503b24a2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:21.373081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076e8b9-05c6-479b-8957-923232e7be60 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:21.374531 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d076e8b9-05c6-479b-8957-923232e7be60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:21.426216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf0522-c1ad-4781-9291-121e09a7e659 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:21.427873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1bcf0522-c1ad-4781-9291-121e09a7e659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:21.454508 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:21.460124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:21.465497 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d076e8b9-05c6-479b-8957-923232e7be60 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:21.522256 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcf0522-c1ad-4781-9291-121e09a7e659 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:21.527113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196d4a63-ce2b-4f59-aa8b-8c773d09bd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:21.527767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d4a63-ce2b-4f59-aa8b-8c773d09bd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:21.528195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d4a63-ce2b-4f59-aa8b-8c773d09bd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:21.528508 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196d4a63-ce2b-4f59-aa8b-8c773d09bd9b admin admin] PATH_INFO: `/v3/projects/675218b9731749cf9b4609aab5f40063` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:21.529700 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d4a63-ce2b-4f59-aa8b-8c773d09bd9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=675218b9731749cf9b4609aab5f40063)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:21.530834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990c298-fe95-441b-875d-4fe60a475dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:21.532126 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990c298-fe95-441b-875d-4fe60a475dca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:21.532371 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196d4a63-ce2b-4f59-aa8b-8c773d09bd9b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:21.532485 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990c298-fe95-441b-875d-4fe60a475dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:21.533340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990c298-fe95-441b-875d-4fe60a475dca admin admin] PATH_INFO: `/v3/projects/95f1d87ea3294f039ee9168a579082b4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:21.543010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990c298-fe95-441b-875d-4fe60a475dca admin admin] RBAC: Authorizing `identity:delete_project(project_id=95f1d87ea3294f039ee9168a579082b4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:21.546294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990c298-fe95-441b-875d-4fe60a475dca admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:21.620399 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-196d4a63-ce2b-4f59-aa8b-8c773d09bd9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '675218b9731749cf9b4609aab5f40063', 'request_id': 'req-196d4a63-ce2b-4f59-aa8b-8c773d09bd9b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:21.628697 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-196d4a63-ce2b-4f59-aa8b-8c773d09bd9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '675218b9731749cf9b4609aab5f40063', 'request_id': 'req-196d4a63-ce2b-4f59-aa8b-8c773d09bd9b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:21.661598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-196d4a63-ce2b-4f59-aa8b-8c773d09bd9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '675218b9731749cf9b4609aab5f40063', 'request_id': 'req-196d4a63-ce2b-4f59-aa8b-8c773d09bd9b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:21.679875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1990c298-fe95-441b-875d-4fe60a475dca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95f1d87ea3294f039ee9168a579082b4', 'request_id': 'req-1990c298-fe95-441b-875d-4fe60a475dca'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:21.689821 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1990c298-fe95-441b-875d-4fe60a475dca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95f1d87ea3294f039ee9168a579082b4', 'request_id': 'req-1990c298-fe95-441b-875d-4fe60a475dca'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:21.693880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-196d4a63-ce2b-4f59-aa8b-8c773d09bd9b admin admin] The token cache is being invalidate because project 675218b9731749cf9b4609aab5f40063 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:21.694181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-196d4a63-ce2b-4f59-aa8b-8c773d09bd9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:21.695591 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-196d4a63-ce2b-4f59-aa8b-8c773d09bd9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:21.700278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1006/1993] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:21 2022] DELETE /identity/v3/projects/675218b9731749cf9b4609aab5f40063 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:21.705524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab4244-d5d1-40ff-ac5d-116ffbf6e5c2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:21.705917 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab4244-d5d1-40ff-ac5d-116ffbf6e5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:21.706051 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ab4244-d5d1-40ff-ac5d-116ffbf6e5c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:21.707912 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1990c298-fe95-441b-875d-4fe60a475dca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95f1d87ea3294f039ee9168a579082b4', 'request_id': 'req-1990c298-fe95-441b-875d-4fe60a475dca'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:21.744465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a2ab4244-d5d1-40ff-ac5d-116ffbf6e5c2 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:21.745793 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a2ab4244-d5d1-40ff-ac5d-116ffbf6e5c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:21.751209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1990c298-fe95-441b-875d-4fe60a475dca admin admin] The token cache is being invalidate because project 95f1d87ea3294f039ee9168a579082b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:21.751585 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1990c298-fe95-441b-875d-4fe60a475dca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:21.752529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1990c298-fe95-441b-875d-4fe60a475dca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:21.760124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 988/1994] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:21 2022] DELETE /identity/v3/projects/95f1d87ea3294f039ee9168a579082b4 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:21.762059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b99976-72fb-46b9-a87b-bb7604e32c71 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:21.762565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b99976-72fb-46b9-a87b-bb7604e32c71 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:21.763097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b99976-72fb-46b9-a87b-bb7604e32c71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:21.787918 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-54b99976-72fb-46b9-a87b-bb7604e32c71 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:21.790641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-54b99976-72fb-46b9-a87b-bb7604e32c71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:21.886295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1007/1995] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:21.894778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f2d71-38a9-411c-b8ad-efb28e964c5c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:21.895071 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f2d71-38a9-411c-b8ad-efb28e964c5c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:21.895352 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7f2d71-38a9-411c-b8ad-efb28e964c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:21.951878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fc7f2d71-38a9-411c-b8ad-efb28e964c5c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:21.958081 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fc7f2d71-38a9-411c-b8ad-efb28e964c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:21.971557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 989/1996] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:21.979267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1eb2f5-9e91-4bc4-a883-69be0d0c31eb None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:21.980101 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1eb2f5-9e91-4bc4-a883-69be0d0c31eb None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:21.980659 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1eb2f5-9e91-4bc4-a883-69be0d0c31eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.001676 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1008/1997] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:22.005629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f2d71-38a9-411c-b8ad-efb28e964c5c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:22.037509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-ed1eb2f5-9e91-4bc4-a883-69be0d0c31eb None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:22.038754 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ed1eb2f5-9e91-4bc4-a883-69be0d0c31eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:22.061865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7f2d71-38a9-411c-b8ad-efb28e964c5c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:22.074599 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 990/1998] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:22.078874 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1eb2f5-9e91-4bc4-a883-69be0d0c31eb None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:22.083693 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9beb3d-a3c1-477c-a990-d023f174cc0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:22.085418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9beb3d-a3c1-477c-a990-d023f174cc0f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.086225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9beb3d-a3c1-477c-a990-d023f174cc0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.086519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9beb3d-a3c1-477c-a990-d023f174cc0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.089138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9beb3d-a3c1-477c-a990-d023f174cc0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:23:22.090610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9beb3d-a3c1-477c-a990-d023f174cc0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:22.096677 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9beb3d-a3c1-477c-a990-d023f174cc0f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:22.133392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1009/1999] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:23:22.134682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1eb2f5-9e91-4bc4-a883-69be0d0c31eb None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:22.135352 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9beb3d-a3c1-477c-a990-d023f174cc0f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:22.155991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962ce0d-fd7a-40fa-8543-8239d527c355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:22.157209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962ce0d-fd7a-40fa-8543-8239d527c355 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.157925 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962ce0d-fd7a-40fa-8543-8239d527c355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.157925 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962ce0d-fd7a-40fa-8543-8239d527c355 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.158098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9beb3d-a3c1-477c-a990-d023f174cc0f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:22.158590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962ce0d-fd7a-40fa-8543-8239d527c355 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:23:22.158917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962ce0d-fd7a-40fa-8543-8239d527c355 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:22.164064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962ce0d-fd7a-40fa-8543-8239d527c355 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:22.167287 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e2554-e574-45c4-9c0c-5f5eb630930a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:22.168400 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e2554-e574-45c4-9c0c-5f5eb630930a admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.168888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e2554-e574-45c4-9c0c-5f5eb630930a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.169402 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0e2554-e574-45c4-9c0c-5f5eb630930a admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.170288 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e2554-e574-45c4-9c0c-5f5eb630930a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:22.173706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0e2554-e574-45c4-9c0c-5f5eb630930a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:22.185978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 991/2000] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:23:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:23:22.190172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962ce0d-fd7a-40fa-8543-8239d527c355 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:22.203817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962ce0d-fd7a-40fa-8543-8239d527c355 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:22.212722 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c449a-819b-4329-a0b6-f9b5ce51400e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:22.213193 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c449a-819b-4329-a0b6-f9b5ce51400e admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.213564 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c449a-819b-4329-a0b6-f9b5ce51400e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.213923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54c449a-819b-4329-a0b6-f9b5ce51400e admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.214722 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c449a-819b-4329-a0b6-f9b5ce51400e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:22.216881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54c449a-819b-4329-a0b6-f9b5ce51400e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:22.222963 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1010/2001] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:22 2022] POST /identity/v3/projects => generated 387 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:22.226665 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e2554-e574-45c4-9c0c-5f5eb630930a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:22.236096 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:22.243208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:22.268353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 992/2002] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:22 2022] POST /identity/v3/projects => generated 371 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:22.272895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c449a-819b-4329-a0b6-f9b5ce51400e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:22.410664 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0e2554-e574-45c4-9c0c-5f5eb630930a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:22.414639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54c449a-819b-4329-a0b6-f9b5ce51400e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:22.417918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1e9b7-adc9-4939-9ee2-ecd29886543b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:22.419661 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1e9b7-adc9-4939-9ee2-ecd29886543b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.420135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1e9b7-adc9-4939-9ee2-ecd29886543b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.420663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1e9b7-adc9-4939-9ee2-ecd29886543b admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.421528 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1e9b7-adc9-4939-9ee2-ecd29886543b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:22.433155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6d29b-2a32-4cdd-9410-00ed31178b1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:22.433616 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d1e9b7-adc9-4939-9ee2-ecd29886543b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:22.433942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6d29b-2a32-4cdd-9410-00ed31178b1d admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.434323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6d29b-2a32-4cdd-9410-00ed31178b1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.434691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f6d29b-2a32-4cdd-9410-00ed31178b1d admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.435430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6d29b-2a32-4cdd-9410-00ed31178b1d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:22.441137 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f6d29b-2a32-4cdd-9410-00ed31178b1d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:22.472776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1011/2003] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:22 2022] POST /identity/v3/users => generated 294 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:22.476714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1e9b7-adc9-4939-9ee2-ecd29886543b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:22.492916 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 993/2004] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:22 2022] POST /identity/v3/users => generated 286 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:22.497368 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6d29b-2a32-4cdd-9410-00ed31178b1d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:22.497718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1e9b7-adc9-4939-9ee2-ecd29886543b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:22.503435 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc578d-8647-4348-904d-b8fbfead5bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:22.504142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc578d-8647-4348-904d-b8fbfead5bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.504531 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc578d-8647-4348-904d-b8fbfead5bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.504880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdc578d-8647-4348-904d-b8fbfead5bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.505727 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc578d-8647-4348-904d-b8fbfead5bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:22.508682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdc578d-8647-4348-904d-b8fbfead5bb5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:22.519360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f6d29b-2a32-4cdd-9410-00ed31178b1d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:22.524562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1012/2005] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:22.525504 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa687d50-ea48-4e6c-a452-f04f2a79a140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:22.526212 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa687d50-ea48-4e6c-a452-f04f2a79a140 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.526674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa687d50-ea48-4e6c-a452-f04f2a79a140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.526957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa687d50-ea48-4e6c-a452-f04f2a79a140 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.527694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa687d50-ea48-4e6c-a452-f04f2a79a140 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:22.542464 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa687d50-ea48-4e6c-a452-f04f2a79a140 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:22.550492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc578d-8647-4348-904d-b8fbfead5bb5 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:22.556771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 994/2006] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:22.561032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa687d50-ea48-4e6c-a452-f04f2a79a140 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:22.573182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa687d50-ea48-4e6c-a452-f04f2a79a140 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:22.574506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdc578d-8647-4348-904d-b8fbfead5bb5 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:22.578778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deefeb0-6f07-4cae-ab71-ab12fe18b1e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:22.579922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deefeb0-6f07-4cae-ab71-ab12fe18b1e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.580413 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deefeb0-6f07-4cae-ab71-ab12fe18b1e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.580900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deefeb0-6f07-4cae-ab71-ab12fe18b1e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.581832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deefeb0-6f07-4cae-ab71-ab12fe18b1e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:22.581944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8e6a4-e148-4c63-864a-2685871ceb86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:22.582641 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8e6a4-e148-4c63-864a-2685871ceb86 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.582935 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8e6a4-e148-4c63-864a-2685871ceb86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.583213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e8e6a4-e148-4c63-864a-2685871ceb86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.583923 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8e6a4-e148-4c63-864a-2685871ceb86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:22.584679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deefeb0-6f07-4cae-ab71-ab12fe18b1e6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:22.586370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e8e6a4-e148-4c63-864a-2685871ceb86 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:22.597872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 995/2007] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:22.601284 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1013/2008] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:22 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:22.602606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deefeb0-6f07-4cae-ab71-ab12fe18b1e6 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:22.605627 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8e6a4-e148-4c63-864a-2685871ceb86 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:22.614605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deefeb0-6f07-4cae-ab71-ab12fe18b1e6 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:22.620786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da7345f-c875-4564-8b61-87c056e07e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:22.621600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7345f-c875-4564-8b61-87c056e07e69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.621959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e8e6a4-e148-4c63-864a-2685871ceb86 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:22.622081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7345f-c875-4564-8b61-87c056e07e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.622431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da7345f-c875-4564-8b61-87c056e07e69 admin admin] PATH_INFO: `/v3/projects/d96bdde52958423791386338323fbd03/users/1b9fa6d7d5954c2c84b34d3d167f9853/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.629199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb9a2a1-40d6-4861-a9c4-8db73f0a06b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:22.630369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9a2a1-40d6-4861-a9c4-8db73f0a06b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.630691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9a2a1-40d6-4861-a9c4-8db73f0a06b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.630972 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb9a2a1-40d6-4861-a9c4-8db73f0a06b9 admin admin] PATH_INFO: `/v3/projects/492f6852c61748ce9af7354f4e3b3f7d/users/a36892c6a21e4b10b81036e41800d1f2/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.641213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7345f-c875-4564-8b61-87c056e07e69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d96bdde52958423791386338323fbd03, user_id=1b9fa6d7d5954c2c84b34d3d167f9853, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:22.644795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da7345f-c875-4564-8b61-87c056e07e69 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:22.651411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9a2a1-40d6-4861-a9c4-8db73f0a06b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=492f6852c61748ce9af7354f4e3b3f7d, user_id=a36892c6a21e4b10b81036e41800d1f2, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:22.655056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb9a2a1-40d6-4861-a9c4-8db73f0a06b9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:22.666363 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 996/2009] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:22 2022] PUT /identity/v3/projects/d96bdde52958423791386338323fbd03/users/1b9fa6d7d5954c2c84b34d3d167f9853/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:22.678530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eb58c-221c-4e54-bebd-04f099d13087 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.682197 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eb58c-221c-4e54-bebd-04f099d13087 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.682197 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81eb58c-221c-4e54-bebd-04f099d13087 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.692129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1014/2010] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:22 2022] PUT /identity/v3/projects/492f6852c61748ce9af7354f4e3b3f7d/users/a36892c6a21e4b10b81036e41800d1f2/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:22.705697 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b72bf7-6a69-4922-ae7c-afe425d9f5de None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.706465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b72bf7-6a69-4922-ae7c-afe425d9f5de None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.707295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b72bf7-6a69-4922-ae7c-afe425d9f5de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.733956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c81eb58c-221c-4e54-bebd-04f099d13087 None None] MFA Rules not processed for user `1b9fa6d7d5954c2c84b34d3d167f9853`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:22.736395 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c81eb58c-221c-4e54-bebd-04f099d13087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:22.752123 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d5b72bf7-6a69-4922-ae7c-afe425d9f5de None None] MFA Rules not processed for user `a36892c6a21e4b10b81036e41800d1f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:22.754251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d5b72bf7-6a69-4922-ae7c-afe425d9f5de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:22.841741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 997/2011] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:22.856292 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eb58c-221c-4e54-bebd-04f099d13087 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:22.857818 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c81eb58c-221c-4e54-bebd-04f099d13087 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:22.875524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1015/2012] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:22 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:22.879746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b72bf7-6a69-4922-ae7c-afe425d9f5de None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:22.916733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:22.942861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:22.967534 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b72bf7-6a69-4922-ae7c-afe425d9f5de None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:22.971303 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81eb58c-221c-4e54-bebd-04f099d13087 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:22.973169 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9f70e-d4e4-4e29-a1fd-d7cceb59aaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:22.973865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9f70e-d4e4-4e29-a1fd-d7cceb59aaf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.974180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9f70e-d4e4-4e29-a1fd-d7cceb59aaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.974529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd9f70e-d4e4-4e29-a1fd-d7cceb59aaf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.975377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc046f-c9bf-47af-ad38-a4080f28f002 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc213ef64924074bd16152228913ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:22.975519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9f70e-d4e4-4e29-a1fd-d7cceb59aaf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:22.975759 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc046f-c9bf-47af-ad38-a4080f28f002 service glance] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:22.976169 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc046f-c9bf-47af-ad38-a4080f28f002 service glance] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:22.976455 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc046f-c9bf-47af-ad38-a4080f28f002 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:22.977444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd9f70e-d4e4-4e29-a1fd-d7cceb59aaf1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:22.990719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc046f-c9bf-47af-ad38-a4080f28f002 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:22.992533 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc046f-c9bf-47af-ad38-a4080f28f002 service glance] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:23.002556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 998/2013] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:23:23.014388 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1016/2014] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:22 2022] POST /identity/v3/projects => generated 387 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:23.018901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc046f-c9bf-47af-ad38-a4080f28f002 service glance] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:23.030001 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc046f-c9bf-47af-ad38-a4080f28f002 service glance] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:23.101595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8cb83-a2bc-43cf-9893-89c4bac26ad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:23.102227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8cb83-a2bc-43cf-9893-89c4bac26ad2 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:23.102538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8cb83-a2bc-43cf-9893-89c4bac26ad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:23.102852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a8cb83-a2bc-43cf-9893-89c4bac26ad2 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:23.103515 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8cb83-a2bc-43cf-9893-89c4bac26ad2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:23.105462 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a8cb83-a2bc-43cf-9893-89c4bac26ad2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:23.130353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 999/2015] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:23 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:23:23.134173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9f70e-d4e4-4e29-a1fd-d7cceb59aaf1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:23.146125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd9f70e-d4e4-4e29-a1fd-d7cceb59aaf1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:23.150918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550c083-af77-414a-8f43-6825d34f21ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:23.151557 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550c083-af77-414a-8f43-6825d34f21ef admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:23.151841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550c083-af77-414a-8f43-6825d34f21ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:23.152123 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550c083-af77-414a-8f43-6825d34f21ef admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:23.152818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550c083-af77-414a-8f43-6825d34f21ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:23.154409 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550c083-af77-414a-8f43-6825d34f21ef admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:23.166624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1017/2016] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:23.169566 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8cb83-a2bc-43cf-9893-89c4bac26ad2 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:23.180027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a8cb83-a2bc-43cf-9893-89c4bac26ad2 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:23.184862 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3352ed2-6ead-4449-8980-45f7a90d1506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:23.185590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3352ed2-6ead-4449-8980-45f7a90d1506 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:23.185911 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3352ed2-6ead-4449-8980-45f7a90d1506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:23.186184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3352ed2-6ead-4449-8980-45f7a90d1506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:23.186917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3352ed2-6ead-4449-8980-45f7a90d1506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:23.189057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3352ed2-6ead-4449-8980-45f7a90d1506 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:23.205187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1000/2017] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:23.207009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550c083-af77-414a-8f43-6825d34f21ef admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:23.219416 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550c083-af77-414a-8f43-6825d34f21ef admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:23.224556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68505c-d2b0-44ab-bbcd-b7f7c7178060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:23.225294 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68505c-d2b0-44ab-bbcd-b7f7c7178060 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:23.225581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68505c-d2b0-44ab-bbcd-b7f7c7178060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:23.225860 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e68505c-d2b0-44ab-bbcd-b7f7c7178060 admin admin] PATH_INFO: `/v3/projects/de42678e05dd4455aa44b980581f03ff/users/39259b49997144d68e6ca0a45b1bdc98/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:23.241952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68505c-d2b0-44ab-bbcd-b7f7c7178060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de42678e05dd4455aa44b980581f03ff, user_id=39259b49997144d68e6ca0a45b1bdc98, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:23.244654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e68505c-d2b0-44ab-bbcd-b7f7c7178060 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:23.261545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1018/2018] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:23 2022] PUT /identity/v3/projects/de42678e05dd4455aa44b980581f03ff/users/39259b49997144d68e6ca0a45b1bdc98/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:23.271610 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df38bc-79f6-4706-b2db-6365d6aa6922 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:23.272006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df38bc-79f6-4706-b2db-6365d6aa6922 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:23.272278 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df38bc-79f6-4706-b2db-6365d6aa6922 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:23.303164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-86df38bc-79f6-4706-b2db-6365d6aa6922 None None] MFA Rules not processed for user `39259b49997144d68e6ca0a45b1bdc98`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:23.304765 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-86df38bc-79f6-4706-b2db-6365d6aa6922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:23.376486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1001/2019] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:23.381892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68505c-d2b0-44ab-bbcd-b7f7c7178060 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:23.448254 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e68505c-d2b0-44ab-bbcd-b7f7c7178060 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:23.457481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93476582-69db-46f3-9638-0b1f9c0eebc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:23.458181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93476582-69db-46f3-9638-0b1f9c0eebc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:23.462970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93476582-69db-46f3-9638-0b1f9c0eebc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:23.463403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93476582-69db-46f3-9638-0b1f9c0eebc3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:23.464202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93476582-69db-46f3-9638-0b1f9c0eebc3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:23.466302 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93476582-69db-46f3-9638-0b1f9c0eebc3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:23.501867 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1019/2020] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:23 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:23.503231 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df38bc-79f6-4706-b2db-6365d6aa6922 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:23.516401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df38bc-79f6-4706-b2db-6365d6aa6922 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:23.539893 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:23.591106 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500a7e5-6986-4404-ae21-6057d175dd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:23.591782 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500a7e5-6986-4404-ae21-6057d175dd48 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:23.592274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500a7e5-6986-4404-ae21-6057d175dd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:23.592546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6500a7e5-6986-4404-ae21-6057d175dd48 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:23.593213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500a7e5-6986-4404-ae21-6057d175dd48 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:23.595735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6500a7e5-6986-4404-ae21-6057d175dd48 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:23.617619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1002/2021] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:23 2022] POST /identity/v3/users => generated 299 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:23.622064 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93476582-69db-46f3-9638-0b1f9c0eebc3 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:23.635214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93476582-69db-46f3-9638-0b1f9c0eebc3 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:23.640748 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6fb74-7136-44a9-bfbf-6da4fa0ba82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:23.641727 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6fb74-7136-44a9-bfbf-6da4fa0ba82f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:23.642277 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6fb74-7136-44a9-bfbf-6da4fa0ba82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:23.643547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a6fb74-7136-44a9-bfbf-6da4fa0ba82f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:23.644075 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6fb74-7136-44a9-bfbf-6da4fa0ba82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:23.646159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a6fb74-7136-44a9-bfbf-6da4fa0ba82f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:23.657975 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1020/2022] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:23.662497 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500a7e5-6986-4404-ae21-6057d175dd48 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:23.672694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6500a7e5-6986-4404-ae21-6057d175dd48 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:23.677472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3cb60-5f34-4f97-a399-4bd8d4c16749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:23.678152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3cb60-5f34-4f97-a399-4bd8d4c16749 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:23.678437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3cb60-5f34-4f97-a399-4bd8d4c16749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:23.678748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c3cb60-5f34-4f97-a399-4bd8d4c16749 admin admin] PATH_INFO: `/v3/projects/154690371cc14c8181c0a7c9954e03ca/users/6430fcf337964497bd43b4e3eb9888a0/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:23.695465 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3cb60-5f34-4f97-a399-4bd8d4c16749 admin admin] RBAC: Authorizing `identity:create_grant(project_id=154690371cc14c8181c0a7c9954e03ca, user_id=6430fcf337964497bd43b4e3eb9888a0, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:23.698152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c3cb60-5f34-4f97-a399-4bd8d4c16749 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:23.714498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1003/2023] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:23 2022] PUT /identity/v3/projects/154690371cc14c8181c0a7c9954e03ca/users/6430fcf337964497bd43b4e3eb9888a0/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:23.718464 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6fb74-7136-44a9-bfbf-6da4fa0ba82f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:23.729229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a6fb74-7136-44a9-bfbf-6da4fa0ba82f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:23.789786 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c395720c-2330-470d-b550-2ef2b511a647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:23.790409 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395720c-2330-470d-b550-2ef2b511a647 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:23.790727 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395720c-2330-470d-b550-2ef2b511a647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:23.790999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c395720c-2330-470d-b550-2ef2b511a647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:23.791675 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395720c-2330-470d-b550-2ef2b511a647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:23.793255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c395720c-2330-470d-b550-2ef2b511a647 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:23.795388 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:23.807025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1021/2024] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:23.809204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3cb60-5f34-4f97-a399-4bd8d4c16749 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:23.819658 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c3cb60-5f34-4f97-a399-4bd8d4c16749 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:23.824695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaa2bf-3d4e-4444-99a7-9f6f3916ae56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:23.825387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaa2bf-3d4e-4444-99a7-9f6f3916ae56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:23.825659 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaa2bf-3d4e-4444-99a7-9f6f3916ae56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:23.825928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddaa2bf-3d4e-4444-99a7-9f6f3916ae56 admin admin] PATH_INFO: `/v3/projects/154690371cc14c8181c0a7c9954e03ca/users/6430fcf337964497bd43b4e3eb9888a0/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:23.827940 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaa2bf-3d4e-4444-99a7-9f6f3916ae56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=154690371cc14c8181c0a7c9954e03ca, user_id=6430fcf337964497bd43b4e3eb9888a0, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:23.830862 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddaa2bf-3d4e-4444-99a7-9f6f3916ae56 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:23.841313 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1004/2025] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:23 2022] PUT /identity/v3/projects/154690371cc14c8181c0a7c9954e03ca/users/6430fcf337964497bd43b4e3eb9888a0/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:23.852039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d1cb7-3dff-41be-b92a-a4feb58a9c42 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:23.852406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d1cb7-3dff-41be-b92a-a4feb58a9c42 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:23.852774 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744d1cb7-3dff-41be-b92a-a4feb58a9c42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:23.880756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-744d1cb7-3dff-41be-b92a-a4feb58a9c42 None None] MFA Rules not processed for user `6430fcf337964497bd43b4e3eb9888a0`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:23.881974 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-744d1cb7-3dff-41be-b92a-a4feb58a9c42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:23.954044 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1022/2026] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:23.966274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaa2bf-3d4e-4444-99a7-9f6f3916ae56 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:23.968079 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5ddaa2bf-3d4e-4444-99a7-9f6f3916ae56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:24.042419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddaa2bf-3d4e-4444-99a7-9f6f3916ae56 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:24.046176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95204f18-7912-4c39-874b-f694743c542e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:24.046877 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95204f18-7912-4c39-874b-f694743c542e service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:24.047158 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95204f18-7912-4c39-874b-f694743c542e service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:24.047433 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95204f18-7912-4c39-874b-f694743c542e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:24.062138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95204f18-7912-4c39-874b-f694743c542e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:24.064182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95204f18-7912-4c39-874b-f694743c542e service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:24.075367 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1005/2027] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:24.744269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d1cb7-3dff-41be-b92a-a4feb58a9c42 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:24.764235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744d1cb7-3dff-41be-b92a-a4feb58a9c42 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:24.770748 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a246765-e3d6-4653-ae6f-ff76c0e2717b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:24.771791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a246765-e3d6-4653-ae6f-ff76c0e2717b service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:24.772207 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a246765-e3d6-4653-ae6f-ff76c0e2717b service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:24.772620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a246765-e3d6-4653-ae6f-ff76c0e2717b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:24.842022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a246765-e3d6-4653-ae6f-ff76c0e2717b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:24.844229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a246765-e3d6-4653-ae6f-ff76c0e2717b service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:24.853302 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1023/2028] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:28.949703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95204f18-7912-4c39-874b-f694743c542e service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:28.955903 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-95204f18-7912-4c39-874b-f694743c542e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:28.976177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95204f18-7912-4c39-874b-f694743c542e service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:28.990634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2456319f-ea4a-4b7c-8a75-bd4b393ae5fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:28.991279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456319f-ea4a-4b7c-8a75-bd4b393ae5fc service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:28.991558 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456319f-ea4a-4b7c-8a75-bd4b393ae5fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:28.991883 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2456319f-ea4a-4b7c-8a75-bd4b393ae5fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:29.064436 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456319f-ea4a-4b7c-8a75-bd4b393ae5fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:29.065908 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2456319f-ea4a-4b7c-8a75-bd4b393ae5fc service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:29.076358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1006/2029] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:31.406222 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a246765-e3d6-4653-ae6f-ff76c0e2717b service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:31.481197 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a246765-e3d6-4653-ae6f-ff76c0e2717b service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:31.488006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a19fb-4bea-43f7-9500-99d57ffa7c75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:31.488653 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a19fb-4bea-43f7-9500-99d57ffa7c75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:31.488931 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a19fb-4bea-43f7-9500-99d57ffa7c75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:31.489202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954a19fb-4bea-43f7-9500-99d57ffa7c75 admin admin] PATH_INFO: `/v3/users/a36892c6a21e4b10b81036e41800d1f2` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:31.490354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a19fb-4bea-43f7-9500-99d57ffa7c75 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a36892c6a21e4b10b81036e41800d1f2)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:31.492296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954a19fb-4bea-43f7-9500-99d57ffa7c75 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:31.516645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:31.542238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-954a19fb-4bea-43f7-9500-99d57ffa7c75 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a36892c6a21e4b10b81036e41800d1f2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:31.554905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-954a19fb-4bea-43f7-9500-99d57ffa7c75 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a36892c6a21e4b10b81036e41800d1f2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:31.565064 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-954a19fb-4bea-43f7-9500-99d57ffa7c75 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a36892c6a21e4b10b81036e41800d1f2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:31.565738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-954a19fb-4bea-43f7-9500-99d57ffa7c75 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a36892c6a21e4b10b81036e41800d1f2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:31.575902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-954a19fb-4bea-43f7-9500-99d57ffa7c75 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a36892c6a21e4b10b81036e41800d1f2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:31.585512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1024/2030] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:31 2022] DELETE /identity/v3/users/a36892c6a21e4b10b81036e41800d1f2 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:31.590100 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d1ef3-003d-40d1-ba1b-df1793af2141 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:31.590654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d1ef3-003d-40d1-ba1b-df1793af2141 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:31.590843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d1ef3-003d-40d1-ba1b-df1793af2141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:31.611129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d27d1ef3-003d-40d1-ba1b-df1793af2141 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:31.612316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d27d1ef3-003d-40d1-ba1b-df1793af2141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:31.617616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:31.674945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1007/2031] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:31.684625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a19fb-4bea-43f7-9500-99d57ffa7c75 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:31.686359 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-954a19fb-4bea-43f7-9500-99d57ffa7c75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:31.746712 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954a19fb-4bea-43f7-9500-99d57ffa7c75 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:31.750444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99a4c4-7e69-43dd-8b54-3daeae808f08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:31.751106 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99a4c4-7e69-43dd-8b54-3daeae808f08 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:31.751386 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99a4c4-7e69-43dd-8b54-3daeae808f08 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:31.751659 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e99a4c4-7e69-43dd-8b54-3daeae808f08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:31.763453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99a4c4-7e69-43dd-8b54-3daeae808f08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:31.765614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e99a4c4-7e69-43dd-8b54-3daeae808f08 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:31.775920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1025/2032] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:32.091373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d1ef3-003d-40d1-ba1b-df1793af2141 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:32.093099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d27d1ef3-003d-40d1-ba1b-df1793af2141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:32.108120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27d1ef3-003d-40d1-ba1b-df1793af2141 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:32.112898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ec15a-0e47-47e3-9dfd-764605347d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:32.113627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ec15a-0e47-47e3-9dfd-764605347d0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:32.113977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ec15a-0e47-47e3-9dfd-764605347d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:32.114370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209ec15a-0e47-47e3-9dfd-764605347d0c admin admin] PATH_INFO: `/v3/projects/492f6852c61748ce9af7354f4e3b3f7d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:32.115782 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ec15a-0e47-47e3-9dfd-764605347d0c admin admin] RBAC: Authorizing `identity:delete_project(project_id=492f6852c61748ce9af7354f4e3b3f7d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:32.117874 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209ec15a-0e47-47e3-9dfd-764605347d0c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:32.176306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-209ec15a-0e47-47e3-9dfd-764605347d0c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '492f6852c61748ce9af7354f4e3b3f7d', 'request_id': 'req-209ec15a-0e47-47e3-9dfd-764605347d0c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:32.181912 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-209ec15a-0e47-47e3-9dfd-764605347d0c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '492f6852c61748ce9af7354f4e3b3f7d', 'request_id': 'req-209ec15a-0e47-47e3-9dfd-764605347d0c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:32.190081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-209ec15a-0e47-47e3-9dfd-764605347d0c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '492f6852c61748ce9af7354f4e3b3f7d', 'request_id': 'req-209ec15a-0e47-47e3-9dfd-764605347d0c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:32.202050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-209ec15a-0e47-47e3-9dfd-764605347d0c admin admin] The token cache is being invalidate because project 492f6852c61748ce9af7354f4e3b3f7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:32.202339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-209ec15a-0e47-47e3-9dfd-764605347d0c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:32.203630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-209ec15a-0e47-47e3-9dfd-764605347d0c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:32.205433 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1008/2033] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:32 2022] DELETE /identity/v3/projects/492f6852c61748ce9af7354f4e3b3f7d => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:32.209570 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99a4c4-7e69-43dd-8b54-3daeae808f08 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:32.219718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e99a4c4-7e69-43dd-8b54-3daeae808f08 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:32.288214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e86d4c-abd5-4ef6-b6bb-af8f9f1f39a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:32.288863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e86d4c-abd5-4ef6-b6bb-af8f9f1f39a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:32.289145 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e86d4c-abd5-4ef6-b6bb-af8f9f1f39a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:32.289422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e86d4c-abd5-4ef6-b6bb-af8f9f1f39a9 admin admin] PATH_INFO: `/v3/users/39259b49997144d68e6ca0a45b1bdc98` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:32.290626 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e86d4c-abd5-4ef6-b6bb-af8f9f1f39a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39259b49997144d68e6ca0a45b1bdc98)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:32.293573 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e86d4c-abd5-4ef6-b6bb-af8f9f1f39a9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:32.357922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:32.360345 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-66e86d4c-abd5-4ef6-b6bb-af8f9f1f39a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39259b49997144d68e6ca0a45b1bdc98'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:32.382567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-66e86d4c-abd5-4ef6-b6bb-af8f9f1f39a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39259b49997144d68e6ca0a45b1bdc98'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:32.392722 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-66e86d4c-abd5-4ef6-b6bb-af8f9f1f39a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39259b49997144d68e6ca0a45b1bdc98'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:32.394915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-66e86d4c-abd5-4ef6-b6bb-af8f9f1f39a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39259b49997144d68e6ca0a45b1bdc98'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:32.408116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-66e86d4c-abd5-4ef6-b6bb-af8f9f1f39a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39259b49997144d68e6ca0a45b1bdc98'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:32.417689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1026/2034] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:32 2022] DELETE /identity/v3/users/39259b49997144d68e6ca0a45b1bdc98 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:32.766466 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ec15a-0e47-47e3-9dfd-764605347d0c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:32.768024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-209ec15a-0e47-47e3-9dfd-764605347d0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:32.785015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209ec15a-0e47-47e3-9dfd-764605347d0c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:32.843391 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:32.844050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:32.844381 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:32.844652 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99 admin admin] PATH_INFO: `/v3/projects/de42678e05dd4455aa44b980581f03ff` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:32.845778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de42678e05dd4455aa44b980581f03ff)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:32.847719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:32.884956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:32.896323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de42678e05dd4455aa44b980581f03ff', 'request_id': 'req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:32.902246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de42678e05dd4455aa44b980581f03ff', 'request_id': 'req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:32.910445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de42678e05dd4455aa44b980581f03ff', 'request_id': 'req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:32.921882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99 admin admin] The token cache is being invalidate because project de42678e05dd4455aa44b980581f03ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:32.922170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:32.922856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:32.924737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1009/2035] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:32 2022] DELETE /identity/v3/projects/de42678e05dd4455aa44b980581f03ff => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:32.929062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e86d4c-abd5-4ef6-b6bb-af8f9f1f39a9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:32.930484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-66e86d4c-abd5-4ef6-b6bb-af8f9f1f39a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:32.943799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e86d4c-abd5-4ef6-b6bb-af8f9f1f39a9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:33.007554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1953e0e1-3a8d-40f8-b413-1420343d4359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:33.008215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953e0e1-3a8d-40f8-b413-1420343d4359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:33.008500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953e0e1-3a8d-40f8-b413-1420343d4359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:33.008777 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1953e0e1-3a8d-40f8-b413-1420343d4359 admin admin] PATH_INFO: `/v3/users/6430fcf337964497bd43b4e3eb9888a0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:33.009978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953e0e1-3a8d-40f8-b413-1420343d4359 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6430fcf337964497bd43b4e3eb9888a0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:33.011943 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1953e0e1-3a8d-40f8-b413-1420343d4359 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:33.058683 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1953e0e1-3a8d-40f8-b413-1420343d4359 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6430fcf337964497bd43b4e3eb9888a0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:33.071644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1953e0e1-3a8d-40f8-b413-1420343d4359 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6430fcf337964497bd43b4e3eb9888a0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:33.079408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1953e0e1-3a8d-40f8-b413-1420343d4359 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6430fcf337964497bd43b4e3eb9888a0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:33.080123 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1953e0e1-3a8d-40f8-b413-1420343d4359 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6430fcf337964497bd43b4e3eb9888a0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:33.088030 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1953e0e1-3a8d-40f8-b413-1420343d4359 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6430fcf337964497bd43b4e3eb9888a0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:33.094156 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1027/2036] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:32 2022] DELETE /identity/v3/users/6430fcf337964497bd43b4e3eb9888a0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:33.375381 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:33.376837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:33.392600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f0f6c2-0beb-4056-a6fa-056b0a3a4e99 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:33.455908 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2906a5c-0ba2-4c03-8560-a2e7f39657bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:33.456490 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2906a5c-0ba2-4c03-8560-a2e7f39657bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:33.456796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2906a5c-0ba2-4c03-8560-a2e7f39657bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:33.457291 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2906a5c-0ba2-4c03-8560-a2e7f39657bb admin admin] PATH_INFO: `/v3/projects/154690371cc14c8181c0a7c9954e03ca` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:33.458552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2906a5c-0ba2-4c03-8560-a2e7f39657bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=154690371cc14c8181c0a7c9954e03ca)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:33.461031 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2906a5c-0ba2-4c03-8560-a2e7f39657bb admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:33.512086 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d2906a5c-0ba2-4c03-8560-a2e7f39657bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '154690371cc14c8181c0a7c9954e03ca', 'request_id': 'req-d2906a5c-0ba2-4c03-8560-a2e7f39657bb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:33.517667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d2906a5c-0ba2-4c03-8560-a2e7f39657bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '154690371cc14c8181c0a7c9954e03ca', 'request_id': 'req-d2906a5c-0ba2-4c03-8560-a2e7f39657bb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:33.525543 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d2906a5c-0ba2-4c03-8560-a2e7f39657bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '154690371cc14c8181c0a7c9954e03ca', 'request_id': 'req-d2906a5c-0ba2-4c03-8560-a2e7f39657bb'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:33.538802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d2906a5c-0ba2-4c03-8560-a2e7f39657bb admin admin] The token cache is being invalidate because project 154690371cc14c8181c0a7c9954e03ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:33.539179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d2906a5c-0ba2-4c03-8560-a2e7f39657bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:33.539925 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d2906a5c-0ba2-4c03-8560-a2e7f39657bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:33.545996 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1010/2037] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:33 2022] DELETE /identity/v3/projects/154690371cc14c8181c0a7c9954e03ca => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:33.548362 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693ffb7-fa0b-4986-8507-a4392aea8f85 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:33.548819 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693ffb7-fa0b-4986-8507-a4392aea8f85 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:33.548971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7693ffb7-fa0b-4986-8507-a4392aea8f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:33.569144 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7693ffb7-fa0b-4986-8507-a4392aea8f85 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:33.570340 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7693ffb7-fa0b-4986-8507-a4392aea8f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:33.612732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:33.641574 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1028/2038] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:33.649779 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a886967-a2c7-4bc1-9bff-ee2dca05208c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:33.650146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a886967-a2c7-4bc1-9bff-ee2dca05208c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:33.650452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a886967-a2c7-4bc1-9bff-ee2dca05208c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:33.677317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2a886967-a2c7-4bc1-9bff-ee2dca05208c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:33.678820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2a886967-a2c7-4bc1-9bff-ee2dca05208c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:33.690630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1011/2039] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:33.693459 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693ffb7-fa0b-4986-8507-a4392aea8f85 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:33.704972 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7693ffb7-fa0b-4986-8507-a4392aea8f85 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:33.711711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6bec4-da44-466a-b926-a8cbc88d8932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:33.712395 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6bec4-da44-466a-b926-a8cbc88d8932 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:33.712683 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6bec4-da44-466a-b926-a8cbc88d8932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:33.713043 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc6bec4-da44-466a-b926-a8cbc88d8932 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:33.713809 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6bec4-da44-466a-b926-a8cbc88d8932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:23:33.714122 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6bec4-da44-466a-b926-a8cbc88d8932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:33.715803 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc6bec4-da44-466a-b926-a8cbc88d8932 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:33.732587 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1029/2040] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:23:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:23:33.737502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a886967-a2c7-4bc1-9bff-ee2dca05208c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:33.748564 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a886967-a2c7-4bc1-9bff-ee2dca05208c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:33.754212 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d60d00-f9fa-432c-97e6-572ac1024ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:33.755096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d60d00-f9fa-432c-97e6-572ac1024ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:33.755378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d60d00-f9fa-432c-97e6-572ac1024ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:33.755823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d60d00-f9fa-432c-97e6-572ac1024ed2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:33.756512 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d60d00-f9fa-432c-97e6-572ac1024ed2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:33.758794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d60d00-f9fa-432c-97e6-572ac1024ed2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:33.794411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1012/2041] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:33 2022] POST /identity/v3/projects => generated 389 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:23:33.799020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6bec4-da44-466a-b926-a8cbc88d8932 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:33.810478 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc6bec4-da44-466a-b926-a8cbc88d8932 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:33.893536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795f01d-57c6-432a-8a90-7a3b85f7c83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:33.893924 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795f01d-57c6-432a-8a90-7a3b85f7c83f admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:33.894181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795f01d-57c6-432a-8a90-7a3b85f7c83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:33.894456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7795f01d-57c6-432a-8a90-7a3b85f7c83f admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:33.895182 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795f01d-57c6-432a-8a90-7a3b85f7c83f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:33.897112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7795f01d-57c6-432a-8a90-7a3b85f7c83f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:33.922897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d60d00-f9fa-432c-97e6-572ac1024ed2 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:33.923742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1030/2042] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:33 2022] POST /identity/v3/users => generated 295 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:33.927640 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795f01d-57c6-432a-8a90-7a3b85f7c83f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:33.927766 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-82d60d00-f9fa-432c-97e6-572ac1024ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:33.940785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7795f01d-57c6-432a-8a90-7a3b85f7c83f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:33.949940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87d229-249c-497b-842a-4640a62a1c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:33.950682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87d229-249c-497b-842a-4640a62a1c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:33.951026 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87d229-249c-497b-842a-4640a62a1c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:33.951371 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db87d229-249c-497b-842a-4640a62a1c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:33.952146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87d229-249c-497b-842a-4640a62a1c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:33.954390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db87d229-249c-497b-842a-4640a62a1c22 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:33.962868 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:33.971913 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1031/2043] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:23:33.973353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87d229-249c-497b-842a-4640a62a1c22 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:33.989425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db87d229-249c-497b-842a-4640a62a1c22 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:33.996830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644d14e-8623-4d2e-8d7d-d6f805976d0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:33.997842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644d14e-8623-4d2e-8d7d-d6f805976d0c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:33.997842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644d14e-8623-4d2e-8d7d-d6f805976d0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:33.998221 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6644d14e-8623-4d2e-8d7d-d6f805976d0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:33.998947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644d14e-8623-4d2e-8d7d-d6f805976d0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:34.001270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6644d14e-8623-4d2e-8d7d-d6f805976d0c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:34.004810 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d60d00-f9fa-432c-97e6-572ac1024ed2 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:34.013812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9804d91-f7b9-4770-a3bb-a04840215cff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:34.014344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1032/2044] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:33 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:34.014885 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9804d91-f7b9-4770-a3bb-a04840215cff service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:34.015280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9804d91-f7b9-4770-a3bb-a04840215cff service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:34.015762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9804d91-f7b9-4770-a3bb-a04840215cff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:34.018127 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d9804d91-f7b9-4770-a3bb-a04840215cff service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:34.018240 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644d14e-8623-4d2e-8d7d-d6f805976d0c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:34.029211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6644d14e-8623-4d2e-8d7d-d6f805976d0c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:34.035343 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74395392-5e9e-42d3-a14c-50f2327f38a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:34.035711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74395392-5e9e-42d3-a14c-50f2327f38a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:34.035994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74395392-5e9e-42d3-a14c-50f2327f38a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:34.036272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74395392-5e9e-42d3-a14c-50f2327f38a3 admin admin] PATH_INFO: `/v3/projects/4511e2f5ed4940a2a6d174dc9a388317/users/f9037514d6ac41fdb7a2d3505a33df66/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:34.061365 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74395392-5e9e-42d3-a14c-50f2327f38a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4511e2f5ed4940a2a6d174dc9a388317, user_id=f9037514d6ac41fdb7a2d3505a33df66, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:34.064692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74395392-5e9e-42d3-a14c-50f2327f38a3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:34.079764 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1033/2045] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:34 2022] PUT /identity/v3/projects/4511e2f5ed4940a2a6d174dc9a388317/users/f9037514d6ac41fdb7a2d3505a33df66/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:34.090974 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f59c4-e84e-41fe-846f-9e212b2d5905 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:34.091260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f59c4-e84e-41fe-846f-9e212b2d5905 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:34.091546 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f59c4-e84e-41fe-846f-9e212b2d5905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:34.101053 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9804d91-f7b9-4770-a3bb-a04840215cff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:34.102517 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9804d91-f7b9-4770-a3bb-a04840215cff service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:34.113340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1013/2046] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:33 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:23:34.121224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0a7f59c4-e84e-41fe-846f-9e212b2d5905 None None] MFA Rules not processed for user `f9037514d6ac41fdb7a2d3505a33df66`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:34.122515 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0a7f59c4-e84e-41fe-846f-9e212b2d5905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:34.214313 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1034/2047] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:34 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:34.219180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9804d91-f7b9-4770-a3bb-a04840215cff service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:34.230596 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9804d91-f7b9-4770-a3bb-a04840215cff service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:34.301721 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd18cf-a628-44ae-ac32-eff3f0ce2a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:34.302355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd18cf-a628-44ae-ac32-eff3f0ce2a36 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:34.302667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd18cf-a628-44ae-ac32-eff3f0ce2a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:34.303034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd18cf-a628-44ae-ac32-eff3f0ce2a36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:34.303803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd18cf-a628-44ae-ac32-eff3f0ce2a36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:34.305608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd18cf-a628-44ae-ac32-eff3f0ce2a36 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:34.331915 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1014/2048] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:34 2022] POST /identity/v3/projects => generated 389 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:23:34.336353 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f59c4-e84e-41fe-846f-9e212b2d5905 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:34.342014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:34.349727 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f59c4-e84e-41fe-846f-9e212b2d5905 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:34.407428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd48d30-97e6-42f4-a252-7a36a7902bdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:34.408073 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd48d30-97e6-42f4-a252-7a36a7902bdd admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:34.408355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd48d30-97e6-42f4-a252-7a36a7902bdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:34.408627 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd48d30-97e6-42f4-a252-7a36a7902bdd admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:34.409297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd48d30-97e6-42f4-a252-7a36a7902bdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:34.412185 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd48d30-97e6-42f4-a252-7a36a7902bdd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:34.435042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1035/2049] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:34 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:34.439099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd18cf-a628-44ae-ac32-eff3f0ce2a36 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:34.450014 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd18cf-a628-44ae-ac32-eff3f0ce2a36 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:34.455076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bfbca-60b2-411e-baeb-e01bf1b8461d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:34.455698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bfbca-60b2-411e-baeb-e01bf1b8461d admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:34.455980 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bfbca-60b2-411e-baeb-e01bf1b8461d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:34.456253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56bfbca-60b2-411e-baeb-e01bf1b8461d admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:34.456947 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bfbca-60b2-411e-baeb-e01bf1b8461d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:34.458567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56bfbca-60b2-411e-baeb-e01bf1b8461d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:34.469953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1015/2050] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:34.474796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd48d30-97e6-42f4-a252-7a36a7902bdd admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:34.485839 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd48d30-97e6-42f4-a252-7a36a7902bdd admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:34.490639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe5d20-beb8-4eb6-b471-78bbec674b09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:34.491304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe5d20-beb8-4eb6-b471-78bbec674b09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:34.491582 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe5d20-beb8-4eb6-b471-78bbec674b09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:34.491853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fe5d20-beb8-4eb6-b471-78bbec674b09 admin admin] PATH_INFO: `/v3/projects/f21caac85a0342828f94d9d2b3bab67e/users/c5c7b7387dd04714bc9dd886b44c7b44/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:34.508116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe5d20-beb8-4eb6-b471-78bbec674b09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21caac85a0342828f94d9d2b3bab67e, user_id=c5c7b7387dd04714bc9dd886b44c7b44, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:34.510805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fe5d20-beb8-4eb6-b471-78bbec674b09 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:34.525219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1036/2051] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:34 2022] PUT /identity/v3/projects/f21caac85a0342828f94d9d2b3bab67e/users/c5c7b7387dd04714bc9dd886b44c7b44/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:34.529429 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bfbca-60b2-411e-baeb-e01bf1b8461d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:34.540215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56bfbca-60b2-411e-baeb-e01bf1b8461d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:34.587851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:34.600189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214f4688-ee4d-42ed-ae53-6bdb8fb778f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:34.600817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f4688-ee4d-42ed-ae53-6bdb8fb778f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:34.601096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f4688-ee4d-42ed-ae53-6bdb8fb778f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:34.601369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214f4688-ee4d-42ed-ae53-6bdb8fb778f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:34.602054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f4688-ee4d-42ed-ae53-6bdb8fb778f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:34.603703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214f4688-ee4d-42ed-ae53-6bdb8fb778f0 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:34.619042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1016/2052] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:34 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:34.623652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe5d20-beb8-4eb6-b471-78bbec674b09 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:34.637063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fe5d20-beb8-4eb6-b471-78bbec674b09 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:34.642331 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fb03b-18d1-496a-922b-a3ecda8f2671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:34.642991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fb03b-18d1-496a-922b-a3ecda8f2671 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:34.643272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fb03b-18d1-496a-922b-a3ecda8f2671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:34.643603 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296fb03b-18d1-496a-922b-a3ecda8f2671 admin admin] PATH_INFO: `/v3/projects/f21caac85a0342828f94d9d2b3bab67e/users/c5c7b7387dd04714bc9dd886b44c7b44/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:34.645521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fb03b-18d1-496a-922b-a3ecda8f2671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f21caac85a0342828f94d9d2b3bab67e, user_id=c5c7b7387dd04714bc9dd886b44c7b44, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:34.648195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296fb03b-18d1-496a-922b-a3ecda8f2671 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:34.659443 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1037/2053] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:34 2022] PUT /identity/v3/projects/f21caac85a0342828f94d9d2b3bab67e/users/c5c7b7387dd04714bc9dd886b44c7b44/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:34.670800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d6e62-3d1c-40e3-9a12-dbd9f0a71041 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:34.671091 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d6e62-3d1c-40e3-9a12-dbd9f0a71041 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:34.671586 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d6e62-3d1c-40e3-9a12-dbd9f0a71041 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:34.707332 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-bc0d6e62-3d1c-40e3-9a12-dbd9f0a71041 None None] MFA Rules not processed for user `c5c7b7387dd04714bc9dd886b44c7b44`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:34.708693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bc0d6e62-3d1c-40e3-9a12-dbd9f0a71041 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:34.788622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1017/2054] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:34 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:34.796842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fb03b-18d1-496a-922b-a3ecda8f2671 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:34.798644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-296fb03b-18d1-496a-922b-a3ecda8f2671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:34.862478 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296fb03b-18d1-496a-922b-a3ecda8f2671 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:34.866261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f41c8ef-d172-4e51-b600-ba6bfafc1b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:34.866907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c8ef-d172-4e51-b600-ba6bfafc1b3e service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:34.867214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c8ef-d172-4e51-b600-ba6bfafc1b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:34.867512 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f41c8ef-d172-4e51-b600-ba6bfafc1b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:34.877541 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41c8ef-d172-4e51-b600-ba6bfafc1b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:34.879024 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f41c8ef-d172-4e51-b600-ba6bfafc1b3e service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:34.888827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1038/2055] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:34 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:35.060998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d6e62-3d1c-40e3-9a12-dbd9f0a71041 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:35.144981 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d6e62-3d1c-40e3-9a12-dbd9f0a71041 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:35.154304 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0484e79-469a-4e64-a78e-12637d997058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:35.154598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0484e79-469a-4e64-a78e-12637d997058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:35.154995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0484e79-469a-4e64-a78e-12637d997058 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:35.155396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0484e79-469a-4e64-a78e-12637d997058 admin admin] PATH_INFO: `/v3/users/f9037514d6ac41fdb7a2d3505a33df66` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:35.157008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0484e79-469a-4e64-a78e-12637d997058 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9037514d6ac41fdb7a2d3505a33df66)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:35.159099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0484e79-469a-4e64-a78e-12637d997058 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:35.248586 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b0484e79-469a-4e64-a78e-12637d997058 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9037514d6ac41fdb7a2d3505a33df66'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:35.260263 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b0484e79-469a-4e64-a78e-12637d997058 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9037514d6ac41fdb7a2d3505a33df66'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:35.287820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b0484e79-469a-4e64-a78e-12637d997058 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9037514d6ac41fdb7a2d3505a33df66'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:35.288632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b0484e79-469a-4e64-a78e-12637d997058 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9037514d6ac41fdb7a2d3505a33df66'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:35.290924 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:35.298877 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b0484e79-469a-4e64-a78e-12637d997058 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9037514d6ac41fdb7a2d3505a33df66'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:35.307834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1018/2056] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:35 2022] DELETE /identity/v3/users/f9037514d6ac41fdb7a2d3505a33df66 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:35.312770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea626b-3153-4729-a6c4-f2e0f112d4e6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:35.313087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea626b-3153-4729-a6c4-f2e0f112d4e6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:35.313362 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ea626b-3153-4729-a6c4-f2e0f112d4e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:35.333081 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a7ea626b-3153-4729-a6c4-f2e0f112d4e6 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:35.337540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a7ea626b-3153-4729-a6c4-f2e0f112d4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:35.394935 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:35.408460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1039/2057] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:35.418875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0484e79-469a-4e64-a78e-12637d997058 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:35.420169 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b0484e79-469a-4e64-a78e-12637d997058 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:35.486029 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0484e79-469a-4e64-a78e-12637d997058 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:35.489781 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945335f-9c4f-4cc7-90f8-722585310994 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:35.490486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945335f-9c4f-4cc7-90f8-722585310994 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:35.490910 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945335f-9c4f-4cc7-90f8-722585310994 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:35.491200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c945335f-9c4f-4cc7-90f8-722585310994 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:35.501023 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945335f-9c4f-4cc7-90f8-722585310994 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:35.502472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c945335f-9c4f-4cc7-90f8-722585310994 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:35.512038 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1019/2058] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:36.239110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea626b-3153-4729-a6c4-f2e0f112d4e6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:36.241105 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a7ea626b-3153-4729-a6c4-f2e0f112d4e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:36.253258 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ea626b-3153-4729-a6c4-f2e0f112d4e6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:36.258233 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14fbbf-5409-4d54-8a06-a6929924dc71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:36.258974 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14fbbf-5409-4d54-8a06-a6929924dc71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:36.259282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14fbbf-5409-4d54-8a06-a6929924dc71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:36.259556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec14fbbf-5409-4d54-8a06-a6929924dc71 admin admin] PATH_INFO: `/v3/projects/4511e2f5ed4940a2a6d174dc9a388317` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:36.260746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14fbbf-5409-4d54-8a06-a6929924dc71 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4511e2f5ed4940a2a6d174dc9a388317)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:36.263017 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec14fbbf-5409-4d54-8a06-a6929924dc71 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:36.340675 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ec14fbbf-5409-4d54-8a06-a6929924dc71 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4511e2f5ed4940a2a6d174dc9a388317', 'request_id': 'req-ec14fbbf-5409-4d54-8a06-a6929924dc71'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:36.355599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ec14fbbf-5409-4d54-8a06-a6929924dc71 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4511e2f5ed4940a2a6d174dc9a388317', 'request_id': 'req-ec14fbbf-5409-4d54-8a06-a6929924dc71'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:36.363794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ec14fbbf-5409-4d54-8a06-a6929924dc71 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4511e2f5ed4940a2a6d174dc9a388317', 'request_id': 'req-ec14fbbf-5409-4d54-8a06-a6929924dc71'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:36.378594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ec14fbbf-5409-4d54-8a06-a6929924dc71 admin admin] The token cache is being invalidate because project 4511e2f5ed4940a2a6d174dc9a388317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:36.379164 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ec14fbbf-5409-4d54-8a06-a6929924dc71 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:36.380067 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ec14fbbf-5409-4d54-8a06-a6929924dc71 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:36.381805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1040/2059] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:36 2022] DELETE /identity/v3/projects/4511e2f5ed4940a2a6d174dc9a388317 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:36.385576 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945335f-9c4f-4cc7-90f8-722585310994 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:36.396507 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c945335f-9c4f-4cc7-90f8-722585310994 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:36.477028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd72bd-b824-485c-809d-eaa64d119efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:36.478015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd72bd-b824-485c-809d-eaa64d119efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:36.478673 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd72bd-b824-485c-809d-eaa64d119efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:36.479250 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd72bd-b824-485c-809d-eaa64d119efd admin admin] PATH_INFO: `/v3/users/c5c7b7387dd04714bc9dd886b44c7b44` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:36.481468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd72bd-b824-485c-809d-eaa64d119efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5c7b7387dd04714bc9dd886b44c7b44)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:36.485352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd72bd-b824-485c-809d-eaa64d119efd admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:36.556085 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d5bd72bd-b824-485c-809d-eaa64d119efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5c7b7387dd04714bc9dd886b44c7b44'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:36.574512 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d5bd72bd-b824-485c-809d-eaa64d119efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5c7b7387dd04714bc9dd886b44c7b44'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:36.592891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d5bd72bd-b824-485c-809d-eaa64d119efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5c7b7387dd04714bc9dd886b44c7b44'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:36.593822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d5bd72bd-b824-485c-809d-eaa64d119efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5c7b7387dd04714bc9dd886b44c7b44'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:36.601871 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d5bd72bd-b824-485c-809d-eaa64d119efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5c7b7387dd04714bc9dd886b44c7b44'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:36.608763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1020/2060] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:36 2022] DELETE /identity/v3/users/c5c7b7387dd04714bc9dd886b44c7b44 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:36.936132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14fbbf-5409-4d54-8a06-a6929924dc71 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:36.938648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ec14fbbf-5409-4d54-8a06-a6929924dc71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:36.955242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec14fbbf-5409-4d54-8a06-a6929924dc71 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:37.031382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474e04ad-dbf7-48c7-86bf-5ee921f4dfd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:37.032039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e04ad-dbf7-48c7-86bf-5ee921f4dfd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:37.032320 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e04ad-dbf7-48c7-86bf-5ee921f4dfd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:37.032596 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474e04ad-dbf7-48c7-86bf-5ee921f4dfd7 admin admin] PATH_INFO: `/v3/projects/f21caac85a0342828f94d9d2b3bab67e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:37.033829 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e04ad-dbf7-48c7-86bf-5ee921f4dfd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f21caac85a0342828f94d9d2b3bab67e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:37.035896 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474e04ad-dbf7-48c7-86bf-5ee921f4dfd7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:37.088814 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-474e04ad-dbf7-48c7-86bf-5ee921f4dfd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f21caac85a0342828f94d9d2b3bab67e', 'request_id': 'req-474e04ad-dbf7-48c7-86bf-5ee921f4dfd7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:37.097195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-474e04ad-dbf7-48c7-86bf-5ee921f4dfd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f21caac85a0342828f94d9d2b3bab67e', 'request_id': 'req-474e04ad-dbf7-48c7-86bf-5ee921f4dfd7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:37.109474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-474e04ad-dbf7-48c7-86bf-5ee921f4dfd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f21caac85a0342828f94d9d2b3bab67e', 'request_id': 'req-474e04ad-dbf7-48c7-86bf-5ee921f4dfd7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:37.125474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-474e04ad-dbf7-48c7-86bf-5ee921f4dfd7 admin admin] The token cache is being invalidate because project f21caac85a0342828f94d9d2b3bab67e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:37.125865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-474e04ad-dbf7-48c7-86bf-5ee921f4dfd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:37.126441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-474e04ad-dbf7-48c7-86bf-5ee921f4dfd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:37.128785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1041/2061] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:36 2022] DELETE /identity/v3/projects/f21caac85a0342828f94d9d2b3bab67e => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:37.133420 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04e6f5-96ef-4590-aedf-3b7c06dc295a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:37.133580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04e6f5-96ef-4590-aedf-3b7c06dc295a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:37.133897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f04e6f5-96ef-4590-aedf-3b7c06dc295a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:37.154715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4f04e6f5-96ef-4590-aedf-3b7c06dc295a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:37.156800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4f04e6f5-96ef-4590-aedf-3b7c06dc295a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:37.165862 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:37.238114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1021/2062] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:37.245973 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311ce4d-ed05-4169-a55e-e6083d8f4ff4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:37.246462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311ce4d-ed05-4169-a55e-e6083d8f4ff4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:37.246976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0311ce4d-ed05-4169-a55e-e6083d8f4ff4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:37.277665 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0311ce4d-ed05-4169-a55e-e6083d8f4ff4 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:37.278918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0311ce4d-ed05-4169-a55e-e6083d8f4ff4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:37.292160 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1042/2063] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:37.293928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04e6f5-96ef-4590-aedf-3b7c06dc295a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:37.306955 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f04e6f5-96ef-4590-aedf-3b7c06dc295a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:37.314033 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd8db7-662a-4723-937c-847cc3c8bd19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:37.314716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd8db7-662a-4723-937c-847cc3c8bd19 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:37.314998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd8db7-662a-4723-937c-847cc3c8bd19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:37.315268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcd8db7-662a-4723-937c-847cc3c8bd19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:37.315964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd8db7-662a-4723-937c-847cc3c8bd19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:23:37.316263 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd8db7-662a-4723-937c-847cc3c8bd19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:37.318028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcd8db7-662a-4723-937c-847cc3c8bd19 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:37.331714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1022/2064] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:23:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:23:37.336036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311ce4d-ed05-4169-a55e-e6083d8f4ff4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:37.341754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:37.348075 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0311ce4d-ed05-4169-a55e-e6083d8f4ff4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:37.363304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370f016-d72b-4a93-8d91-9504b29939bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:37.363931 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370f016-d72b-4a93-8d91-9504b29939bd admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:37.364242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370f016-d72b-4a93-8d91-9504b29939bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:37.364468 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3370f016-d72b-4a93-8d91-9504b29939bd admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:37.365482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370f016-d72b-4a93-8d91-9504b29939bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:37.367267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3370f016-d72b-4a93-8d91-9504b29939bd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:37.409217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1043/2065] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:37 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:37.413222 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd8db7-662a-4723-937c-847cc3c8bd19 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:37.434222 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcd8db7-662a-4723-937c-847cc3c8bd19 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:37.507050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ece7a9-d1f9-4036-a4e2-35b77fecd8ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:37.507686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ece7a9-d1f9-4036-a4e2-35b77fecd8ab admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:37.507966 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ece7a9-d1f9-4036-a4e2-35b77fecd8ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:37.508238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ece7a9-d1f9-4036-a4e2-35b77fecd8ab admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:37.508977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ece7a9-d1f9-4036-a4e2-35b77fecd8ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:37.512035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ece7a9-d1f9-4036-a4e2-35b77fecd8ab admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:37.543965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1023/2066] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:37 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:23:37.548373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370f016-d72b-4a93-8d91-9504b29939bd admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:37.559531 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3370f016-d72b-4a93-8d91-9504b29939bd admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:37.565011 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ef286-ad4f-4b4e-8f18-877e568c31e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:37.565639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ef286-ad4f-4b4e-8f18-877e568c31e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:37.565920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ef286-ad4f-4b4e-8f18-877e568c31e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:37.566190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5ef286-ad4f-4b4e-8f18-877e568c31e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:37.566958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ef286-ad4f-4b4e-8f18-877e568c31e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:37.568553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5ef286-ad4f-4b4e-8f18-877e568c31e2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:37.581006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1044/2067] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:23:37.591985 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ece7a9-d1f9-4036-a4e2-35b77fecd8ab admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:37.603123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ece7a9-d1f9-4036-a4e2-35b77fecd8ab admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:37.610254 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fb6ccc-c60b-4453-a927-9bdfcd8fa987 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:37.610924 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb6ccc-c60b-4453-a927-9bdfcd8fa987 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:37.611209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb6ccc-c60b-4453-a927-9bdfcd8fa987 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:37.611473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fb6ccc-c60b-4453-a927-9bdfcd8fa987 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:37.612176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb6ccc-c60b-4453-a927-9bdfcd8fa987 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:37.613846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2fb6ccc-c60b-4453-a927-9bdfcd8fa987 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:37.630374 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1024/2068] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:37 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:37.631413 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ef286-ad4f-4b4e-8f18-877e568c31e2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:37.650420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5ef286-ad4f-4b4e-8f18-877e568c31e2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:37.655784 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e02fc-872f-4a16-808f-2063d5123aaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:37.656461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e02fc-872f-4a16-808f-2063d5123aaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:37.656737 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e02fc-872f-4a16-808f-2063d5123aaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:37.657007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e02fc-872f-4a16-808f-2063d5123aaf admin admin] PATH_INFO: `/v3/projects/edd9a36aca5240b4b30f3ccc8c895a1e/users/909167662f754cbeb6d9df2f1f41140d/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:37.673921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e02fc-872f-4a16-808f-2063d5123aaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd9a36aca5240b4b30f3ccc8c895a1e, user_id=909167662f754cbeb6d9df2f1f41140d, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:37.676618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e02fc-872f-4a16-808f-2063d5123aaf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:37.713974 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1045/2069] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:37 2022] PUT /identity/v3/projects/edd9a36aca5240b4b30f3ccc8c895a1e/users/909167662f754cbeb6d9df2f1f41140d/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:37.716228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3a8b4-6ba6-43fb-a6f8-5e41c5543436 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:37.716605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3a8b4-6ba6-43fb-a6f8-5e41c5543436 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:37.716903 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf3a8b4-6ba6-43fb-a6f8-5e41c5543436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:37.767444 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-3cf3a8b4-6ba6-43fb-a6f8-5e41c5543436 None None] MFA Rules not processed for user `909167662f754cbeb6d9df2f1f41140d`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:37.769825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3cf3a8b4-6ba6-43fb-a6f8-5e41c5543436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:37.863531 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1025/2070] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:37.867933 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e02fc-872f-4a16-808f-2063d5123aaf admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:37.931884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e02fc-872f-4a16-808f-2063d5123aaf admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:37.937397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda75f63-38e5-4efb-8319-29ddbef488e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:37.938018 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda75f63-38e5-4efb-8319-29ddbef488e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:37.938286 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda75f63-38e5-4efb-8319-29ddbef488e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:37.938556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda75f63-38e5-4efb-8319-29ddbef488e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:37.939257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda75f63-38e5-4efb-8319-29ddbef488e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:37.941157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda75f63-38e5-4efb-8319-29ddbef488e0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:37.974632 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1046/2071] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:37 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:23:37.983327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3a8b4-6ba6-43fb-a6f8-5e41c5543436 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:37.989423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf3a8b4-6ba6-43fb-a6f8-5e41c5543436 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:37.995043 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:38.056235 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f3ab5-a068-4434-9b1b-815b8743f788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:38.057135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f3ab5-a068-4434-9b1b-815b8743f788 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:38.057578 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f3ab5-a068-4434-9b1b-815b8743f788 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:38.057994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f3ab5-a068-4434-9b1b-815b8743f788 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:38.058830 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f3ab5-a068-4434-9b1b-815b8743f788 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:38.060948 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f3ab5-a068-4434-9b1b-815b8743f788 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:38.093258 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda75f63-38e5-4efb-8319-29ddbef488e0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:38.094094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1026/2072] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:37 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:38.106189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda75f63-38e5-4efb-8319-29ddbef488e0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:38.111206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e1010-5b14-4fd8-915e-c96e6e04b509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:38.111850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e1010-5b14-4fd8-915e-c96e6e04b509 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:38.112132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e1010-5b14-4fd8-915e-c96e6e04b509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:38.112404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635e1010-5b14-4fd8-915e-c96e6e04b509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:38.113112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e1010-5b14-4fd8-915e-c96e6e04b509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:38.115331 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635e1010-5b14-4fd8-915e-c96e6e04b509 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:38.129234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1047/2073] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:38.134048 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f3ab5-a068-4434-9b1b-815b8743f788 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:38.148502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f3ab5-a068-4434-9b1b-815b8743f788 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:38.157510 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f463369-c367-40df-8fa6-6a01b057e21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:38.158208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f463369-c367-40df-8fa6-6a01b057e21f admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:38.158488 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f463369-c367-40df-8fa6-6a01b057e21f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:38.158790 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f463369-c367-40df-8fa6-6a01b057e21f admin admin] PATH_INFO: `/v3/projects/de3860fb47ad4937940af4cf1e94f810/users/bc556a4fa8f74268894c21ec01fef5f8/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:38.177842 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f463369-c367-40df-8fa6-6a01b057e21f admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3860fb47ad4937940af4cf1e94f810, user_id=bc556a4fa8f74268894c21ec01fef5f8, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:38.180589 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f463369-c367-40df-8fa6-6a01b057e21f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:38.205030 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1027/2074] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:38 2022] PUT /identity/v3/projects/de3860fb47ad4937940af4cf1e94f810/users/bc556a4fa8f74268894c21ec01fef5f8/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:38.209109 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e1010-5b14-4fd8-915e-c96e6e04b509 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:38.221109 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635e1010-5b14-4fd8-915e-c96e6e04b509 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:38.293103 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd90dd3-d6f1-4cb1-8f58-9053e41567d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:38.293790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd90dd3-d6f1-4cb1-8f58-9053e41567d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:38.294024 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd90dd3-d6f1-4cb1-8f58-9053e41567d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:38.294301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd90dd3-d6f1-4cb1-8f58-9053e41567d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:38.295035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd90dd3-d6f1-4cb1-8f58-9053e41567d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:38.296666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd90dd3-d6f1-4cb1-8f58-9053e41567d4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:38.308014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1048/2075] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:38.312317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f463369-c367-40df-8fa6-6a01b057e21f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:38.323750 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f463369-c367-40df-8fa6-6a01b057e21f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:38.336032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307ad2b-6640-4818-9ba3-51649edbc2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:38.337085 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307ad2b-6640-4818-9ba3-51649edbc2b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:38.337085 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307ad2b-6640-4818-9ba3-51649edbc2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:38.337306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d307ad2b-6640-4818-9ba3-51649edbc2b3 admin admin] PATH_INFO: `/v3/projects/de3860fb47ad4937940af4cf1e94f810/users/bc556a4fa8f74268894c21ec01fef5f8/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:38.344916 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307ad2b-6640-4818-9ba3-51649edbc2b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de3860fb47ad4937940af4cf1e94f810, user_id=bc556a4fa8f74268894c21ec01fef5f8, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:38.347794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d307ad2b-6640-4818-9ba3-51649edbc2b3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:38.360008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1028/2076] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:38 2022] PUT /identity/v3/projects/de3860fb47ad4937940af4cf1e94f810/users/bc556a4fa8f74268894c21ec01fef5f8/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:38.370656 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4822d2-2b0b-4277-b7c0-429ea8ab10ff None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:38.371002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4822d2-2b0b-4277-b7c0-429ea8ab10ff None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:38.371287 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4822d2-2b0b-4277-b7c0-429ea8ab10ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:38.403073 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3d4822d2-2b0b-4277-b7c0-429ea8ab10ff None None] MFA Rules not processed for user `bc556a4fa8f74268894c21ec01fef5f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:38.404312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3d4822d2-2b0b-4277-b7c0-429ea8ab10ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:38.411873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:38.511663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1049/2077] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:38 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:38.523534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307ad2b-6640-4818-9ba3-51649edbc2b3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:38.525264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d307ad2b-6640-4818-9ba3-51649edbc2b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:38.600901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d307ad2b-6640-4818-9ba3-51649edbc2b3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:38.604950 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9642fc0-e7c0-4d75-8748-cd306a8a6b8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:38.605668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9642fc0-e7c0-4d75-8748-cd306a8a6b8c service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:38.606019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9642fc0-e7c0-4d75-8748-cd306a8a6b8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:38.606366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9642fc0-e7c0-4d75-8748-cd306a8a6b8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:38.627216 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9642fc0-e7c0-4d75-8748-cd306a8a6b8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:38.628741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9642fc0-e7c0-4d75-8748-cd306a8a6b8c service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:38.639601 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1029/2078] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:38.744840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4822d2-2b0b-4277-b7c0-429ea8ab10ff None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:38.764270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4822d2-2b0b-4277-b7c0-429ea8ab10ff None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:38.771150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7497a8-c995-4580-be65-fde1b6e8da12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:38.771892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7497a8-c995-4580-be65-fde1b6e8da12 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:38.772204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7497a8-c995-4580-be65-fde1b6e8da12 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:38.772551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7497a8-c995-4580-be65-fde1b6e8da12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:38.898952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7497a8-c995-4580-be65-fde1b6e8da12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:38.904037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7497a8-c995-4580-be65-fde1b6e8da12 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:38.925442 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1050/2079] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:38 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:39.350741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9642fc0-e7c0-4d75-8748-cd306a8a6b8c service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:39.443845 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9642fc0-e7c0-4d75-8748-cd306a8a6b8c service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:39.448683 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32ac8d-2b6d-450c-b1c9-a8ef6ccf7a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:39.449327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32ac8d-2b6d-450c-b1c9-a8ef6ccf7a34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:39.449608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32ac8d-2b6d-450c-b1c9-a8ef6ccf7a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:39.450037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f32ac8d-2b6d-450c-b1c9-a8ef6ccf7a34 admin admin] PATH_INFO: `/v3/users/909167662f754cbeb6d9df2f1f41140d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:39.451288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32ac8d-2b6d-450c-b1c9-a8ef6ccf7a34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=909167662f754cbeb6d9df2f1f41140d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:39.453303 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f32ac8d-2b6d-450c-b1c9-a8ef6ccf7a34 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:39.463245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:39.530973 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7f32ac8d-2b6d-450c-b1c9-a8ef6ccf7a34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909167662f754cbeb6d9df2f1f41140d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:39.540173 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7f32ac8d-2b6d-450c-b1c9-a8ef6ccf7a34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909167662f754cbeb6d9df2f1f41140d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:39.556123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7f32ac8d-2b6d-450c-b1c9-a8ef6ccf7a34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909167662f754cbeb6d9df2f1f41140d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:39.556858 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7f32ac8d-2b6d-450c-b1c9-a8ef6ccf7a34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909167662f754cbeb6d9df2f1f41140d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:39.571843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7f32ac8d-2b6d-450c-b1c9-a8ef6ccf7a34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909167662f754cbeb6d9df2f1f41140d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:39.581516 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1030/2080] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:39 2022] DELETE /identity/v3/users/909167662f754cbeb6d9df2f1f41140d => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:39.585714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14686b-53fe-497d-a944-6d4208d76a2e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:39.586597 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14686b-53fe-497d-a944-6d4208d76a2e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:39.587047 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f14686b-53fe-497d-a944-6d4208d76a2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:39.609515 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4f14686b-53fe-497d-a944-6d4208d76a2e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:39.611094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4f14686b-53fe-497d-a944-6d4208d76a2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:39.690373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1051/2081] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:39.697147 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32ac8d-2b6d-450c-b1c9-a8ef6ccf7a34 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:39.699047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7f32ac8d-2b6d-450c-b1c9-a8ef6ccf7a34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:39.768517 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f32ac8d-2b6d-450c-b1c9-a8ef6ccf7a34 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:39.772312 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1479230-c270-4a53-960e-e47b56f1b86c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:39.772936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1479230-c270-4a53-960e-e47b56f1b86c service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:39.773219 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1479230-c270-4a53-960e-e47b56f1b86c service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:39.773495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1479230-c270-4a53-960e-e47b56f1b86c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:39.783657 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1479230-c270-4a53-960e-e47b56f1b86c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:39.785106 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1479230-c270-4a53-960e-e47b56f1b86c service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:39.794942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1031/2082] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:39.938509 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4c843-1834-431d-acae-6bed9116ae2a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:39.945389 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4c843-1834-431d-acae-6bed9116ae2a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:39.946521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4c843-1834-431d-acae-6bed9116ae2a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:39.948270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1052/2083] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 1 14:23:39 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:23:39.976350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c0273-987a-4be0-8a6f-785a80e5ee44 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:39.976986 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c0273-987a-4be0-8a6f-785a80e5ee44 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:39.978622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26c0273-987a-4be0-8a6f-785a80e5ee44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:40.001354 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b26c0273-987a-4be0-8a6f-785a80e5ee44 None None] MFA Rules not processed for user `e210ee6c390849e7a630a677ec52e966`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:40.002517 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b26c0273-987a-4be0-8a6f-785a80e5ee44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:40.042385 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4c843-1834-431d-acae-6bed9116ae2a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:40.047018 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bfb4c843-1834-431d-acae-6bed9116ae2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:40.069540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4c843-1834-431d-acae-6bed9116ae2a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:40.078355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f33ac1-50de-43a4-9e25-bc45e08b275b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:40.079528 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f33ac1-50de-43a4-9e25-bc45e08b275b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:40.079800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f33ac1-50de-43a4-9e25-bc45e08b275b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:40.080093 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f33ac1-50de-43a4-9e25-bc45e08b275b admin admin] PATH_INFO: `/v3/users/3c069d8c991d482992951ba0eb7b3395` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:40.081296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f33ac1-50de-43a4-9e25-bc45e08b275b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c069d8c991d482992951ba0eb7b3395)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:40.083278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f33ac1-50de-43a4-9e25-bc45e08b275b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:40.103664 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1032/2084] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 1 14:23:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:40.104669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c0273-987a-4be0-8a6f-785a80e5ee44 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:40.106302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b26c0273-987a-4be0-8a6f-785a80e5ee44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:40.130281 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26c0273-987a-4be0-8a6f-785a80e5ee44 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:40.135607 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:40.137317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:40.138128 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:40.138508 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:40.138971 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376 admin admin] PATH_INFO: `/v3/projects/edd9a36aca5240b4b30f3ccc8c895a1e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:40.141725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd9a36aca5240b4b30f3ccc8c895a1e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:40.149960 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-62f33ac1-50de-43a4-9e25-bc45e08b275b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c069d8c991d482992951ba0eb7b3395'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.152507 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:40.176154 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-62f33ac1-50de-43a4-9e25-bc45e08b275b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c069d8c991d482992951ba0eb7b3395'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.180149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:40.187316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-62f33ac1-50de-43a4-9e25-bc45e08b275b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c069d8c991d482992951ba0eb7b3395'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.189391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-62f33ac1-50de-43a4-9e25-bc45e08b275b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c069d8c991d482992951ba0eb7b3395'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.199417 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-62f33ac1-50de-43a4-9e25-bc45e08b275b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c069d8c991d482992951ba0eb7b3395'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.219906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd9a36aca5240b4b30f3ccc8c895a1e', 'request_id': 'req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.220544 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1053/2085] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:40 2022] DELETE /identity/v3/users/3c069d8c991d482992951ba0eb7b3395 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:40.225107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f33ac1-50de-43a4-9e25-bc45e08b275b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:40.232767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-62f33ac1-50de-43a4-9e25-bc45e08b275b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:40.235224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd9a36aca5240b4b30f3ccc8c895a1e', 'request_id': 'req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.251131 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd9a36aca5240b4b30f3ccc8c895a1e', 'request_id': 'req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.271805 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376 admin admin] The token cache is being invalidate because project edd9a36aca5240b4b30f3ccc8c895a1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:40.272331 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.273354 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.275662 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1033/2086] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:40 2022] DELETE /identity/v3/projects/edd9a36aca5240b4b30f3ccc8c895a1e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:40.279543 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:40.282921 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:40.382175 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f33ac1-50de-43a4-9e25-bc45e08b275b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:40.391557 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b6eff-ce3d-45ab-b36d-44aedca767ca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210ee6c390849e7a630a677ec52e966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:40.392081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd51b18e-b4cd-49f7-afe8-740f0bb5c376 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:40.392809 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b6eff-ce3d-45ab-b36d-44aedca767ca service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:40.393843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b6eff-ce3d-45ab-b36d-44aedca767ca service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:40.394314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48b6eff-ce3d-45ab-b36d-44aedca767ca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:40.397287 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e48b6eff-ce3d-45ab-b36d-44aedca767ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:40.412791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b6eff-ce3d-45ab-b36d-44aedca767ca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:40.414877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48b6eff-ce3d-45ab-b36d-44aedca767ca service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:40.442008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1054/2087] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:40.499218 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bccd560c-bb14-4e68-b638-1a03a6ce0bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:40.500151 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd560c-bb14-4e68-b638-1a03a6ce0bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:40.500642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd560c-bb14-4e68-b638-1a03a6ce0bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:40.501538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bccd560c-bb14-4e68-b638-1a03a6ce0bb6 admin admin] PATH_INFO: `/v3/users/bc556a4fa8f74268894c21ec01fef5f8` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:40.510248 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd560c-bb14-4e68-b638-1a03a6ce0bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc556a4fa8f74268894c21ec01fef5f8)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:40.513240 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bccd560c-bb14-4e68-b638-1a03a6ce0bb6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:40.549041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b6eff-ce3d-45ab-b36d-44aedca767ca service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:40.550041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e48b6eff-ce3d-45ab-b36d-44aedca767ca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:40.569745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48b6eff-ce3d-45ab-b36d-44aedca767ca service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:40.577798 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92cf83c-9a46-4a75-8732-081240e15d00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:40.578636 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cf83c-9a46-4a75-8732-081240e15d00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:40.579241 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cf83c-9a46-4a75-8732-081240e15d00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:40.579773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92cf83c-9a46-4a75-8732-081240e15d00 admin admin] PATH_INFO: `/v3/projects/c34baccea2194944bd4b491bb434dc01` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:40.581272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cf83c-9a46-4a75-8732-081240e15d00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c34baccea2194944bd4b491bb434dc01)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:40.583595 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92cf83c-9a46-4a75-8732-081240e15d00 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:40.585599 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bccd560c-bb14-4e68-b638-1a03a6ce0bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc556a4fa8f74268894c21ec01fef5f8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.596723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bccd560c-bb14-4e68-b638-1a03a6ce0bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc556a4fa8f74268894c21ec01fef5f8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.598548 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:40.616314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bccd560c-bb14-4e68-b638-1a03a6ce0bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc556a4fa8f74268894c21ec01fef5f8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.617461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bccd560c-bb14-4e68-b638-1a03a6ce0bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc556a4fa8f74268894c21ec01fef5f8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.626385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bccd560c-bb14-4e68-b638-1a03a6ce0bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc556a4fa8f74268894c21ec01fef5f8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.636184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1034/2088] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:40 2022] DELETE /identity/v3/users/bc556a4fa8f74268894c21ec01fef5f8 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:40.647563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a92cf83c-9a46-4a75-8732-081240e15d00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c34baccea2194944bd4b491bb434dc01', 'request_id': 'req-a92cf83c-9a46-4a75-8732-081240e15d00'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.654359 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a92cf83c-9a46-4a75-8732-081240e15d00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c34baccea2194944bd4b491bb434dc01', 'request_id': 'req-a92cf83c-9a46-4a75-8732-081240e15d00'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.667247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a92cf83c-9a46-4a75-8732-081240e15d00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c34baccea2194944bd4b491bb434dc01', 'request_id': 'req-a92cf83c-9a46-4a75-8732-081240e15d00'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.681431 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a92cf83c-9a46-4a75-8732-081240e15d00 admin admin] The token cache is being invalidate because project c34baccea2194944bd4b491bb434dc01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:40.681796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a92cf83c-9a46-4a75-8732-081240e15d00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.682539 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a92cf83c-9a46-4a75-8732-081240e15d00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:40.684477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1055/2089] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:40 2022] DELETE /identity/v3/projects/c34baccea2194944bd4b491bb434dc01 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:40.696089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b11ae-0e46-47a9-b104-2dfedfcfc0aa None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:40.696374 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b11ae-0e46-47a9-b104-2dfedfcfc0aa None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:40.696652 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116b11ae-0e46-47a9-b104-2dfedfcfc0aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:40.719540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-116b11ae-0e46-47a9-b104-2dfedfcfc0aa None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:40.720744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-116b11ae-0e46-47a9-b104-2dfedfcfc0aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:40.783452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1035/2090] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:40.796709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f106dd-6039-44e9-a38f-16df109bcfe1 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:40.797002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f106dd-6039-44e9-a38f-16df109bcfe1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:40.797276 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f106dd-6039-44e9-a38f-16df109bcfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:40.820418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-41f106dd-6039-44e9-a38f-16df109bcfe1 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:40.821656 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-41f106dd-6039-44e9-a38f-16df109bcfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:40.830687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1056/2091] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:40.835022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b11ae-0e46-47a9-b104-2dfedfcfc0aa None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:40.845480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116b11ae-0e46-47a9-b104-2dfedfcfc0aa None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:40.851471 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0998513-d064-4bfa-bebf-82fd692cdf86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:40.852088 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0998513-d064-4bfa-bebf-82fd692cdf86 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:40.852368 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0998513-d064-4bfa-bebf-82fd692cdf86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:40.852691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0998513-d064-4bfa-bebf-82fd692cdf86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:40.853397 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0998513-d064-4bfa-bebf-82fd692cdf86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:23:40.853700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0998513-d064-4bfa-bebf-82fd692cdf86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:40.856354 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0998513-d064-4bfa-bebf-82fd692cdf86 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:40.869694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1036/2092] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:23:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:23:40.874494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f106dd-6039-44e9-a38f-16df109bcfe1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:40.883990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f106dd-6039-44e9-a38f-16df109bcfe1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:40.888692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60598a5-e087-4b57-acfa-500e59146ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:40.889352 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60598a5-e087-4b57-acfa-500e59146ef9 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:40.889606 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60598a5-e087-4b57-acfa-500e59146ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:40.890549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60598a5-e087-4b57-acfa-500e59146ef9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:40.891271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60598a5-e087-4b57-acfa-500e59146ef9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:40.893161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60598a5-e087-4b57-acfa-500e59146ef9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:40.915498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0998513-d064-4bfa-bebf-82fd692cdf86 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:40.917516 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d0998513-d064-4bfa-bebf-82fd692cdf86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:40.917962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:40.929852 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1057/2093] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:40 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:40.931181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60598a5-e087-4b57-acfa-500e59146ef9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:40.938019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0998513-d064-4bfa-bebf-82fd692cdf86 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.013100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60598a5-e087-4b57-acfa-500e59146ef9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.018201 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990e4b6-ea01-487c-ba3f-71c1b6990d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.018848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990e4b6-ea01-487c-ba3f-71c1b6990d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.019129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990e4b6-ea01-487c-ba3f-71c1b6990d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.019467 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9990e4b6-ea01-487c-ba3f-71c1b6990d52 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.020084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990e4b6-ea01-487c-ba3f-71c1b6990d52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.022075 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9990e4b6-ea01-487c-ba3f-71c1b6990d52 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.024794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d3410-cadc-4877-8fce-4a6257f39013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.025447 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d3410-cadc-4877-8fce-4a6257f39013 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.025729 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d3410-cadc-4877-8fce-4a6257f39013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.026004 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d3410-cadc-4877-8fce-4a6257f39013 admin admin] PATH_INFO: `/v3/projects/de3860fb47ad4937940af4cf1e94f810` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.027295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d3410-cadc-4877-8fce-4a6257f39013 admin admin] RBAC: Authorizing `identity:delete_project(project_id=de3860fb47ad4937940af4cf1e94f810)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.029279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d3410-cadc-4877-8fce-4a6257f39013 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.050390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1058/2094] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:40 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:41.054340 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990e4b6-ea01-487c-ba3f-71c1b6990d52 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.066473 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9990e4b6-ea01-487c-ba3f-71c1b6990d52 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.073175 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f0b69-4ace-486b-a778-983d85c35480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.074344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f0b69-4ace-486b-a778-983d85c35480 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.074344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f0b69-4ace-486b-a778-983d85c35480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.074602 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f0b69-4ace-486b-a778-983d85c35480 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.075533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f0b69-4ace-486b-a778-983d85c35480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.077579 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f0b69-4ace-486b-a778-983d85c35480 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.088951 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1059/2095] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:23:41.093333 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f0b69-4ace-486b-a778-983d85c35480 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.096235 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1a4d3410-cadc-4877-8fce-4a6257f39013 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de3860fb47ad4937940af4cf1e94f810', 'request_id': 'req-1a4d3410-cadc-4877-8fce-4a6257f39013'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:41.102455 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1a4d3410-cadc-4877-8fce-4a6257f39013 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de3860fb47ad4937940af4cf1e94f810', 'request_id': 'req-1a4d3410-cadc-4877-8fce-4a6257f39013'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:41.103276 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f0b69-4ace-486b-a778-983d85c35480 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.105202 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:41.112333 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1a4d3410-cadc-4877-8fce-4a6257f39013 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de3860fb47ad4937940af4cf1e94f810', 'request_id': 'req-1a4d3410-cadc-4877-8fce-4a6257f39013'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:41.127207 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1a4d3410-cadc-4877-8fce-4a6257f39013 admin admin] The token cache is being invalidate because project de3860fb47ad4937940af4cf1e94f810 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:41.127496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1a4d3410-cadc-4877-8fce-4a6257f39013 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:41.128149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1a4d3410-cadc-4877-8fce-4a6257f39013 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:41.130672 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1037/2096] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:40 2022] DELETE /identity/v3/projects/de3860fb47ad4937940af4cf1e94f810 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:41.135422 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768469-e615-4e60-aa03-f20b1ac37904 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.135813 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768469-e615-4e60-aa03-f20b1ac37904 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.136343 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9768469-e615-4e60-aa03-f20b1ac37904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.156652 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a9768469-e615-4e60-aa03-f20b1ac37904 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:41.157867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a9768469-e615-4e60-aa03-f20b1ac37904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:41.163261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f57d1-4a73-4e26-8460-695feaa56938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.163866 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f57d1-4a73-4e26-8460-695feaa56938 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.164143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f57d1-4a73-4e26-8460-695feaa56938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.164419 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4f57d1-4a73-4e26-8460-695feaa56938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.165110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f57d1-4a73-4e26-8460-695feaa56938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.166736 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4f57d1-4a73-4e26-8460-695feaa56938 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.177181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1060/2097] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:23:41.181349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f57d1-4a73-4e26-8460-695feaa56938 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.183092 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dc4f57d1-4a73-4e26-8460-695feaa56938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:41.198640 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4f57d1-4a73-4e26-8460-695feaa56938 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.203700 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50841c7-a51a-4b29-ac2e-f28a6b8fffb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.205034 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50841c7-a51a-4b29-ac2e-f28a6b8fffb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.205310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50841c7-a51a-4b29-ac2e-f28a6b8fffb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.205578 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50841c7-a51a-4b29-ac2e-f28a6b8fffb7 admin admin] PATH_INFO: `/v3/projects/189a9370f8b94faabb7009c002c9f642/users/fa4545613ae24960bb2d0d5e8bd2a2bd/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.224424 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50841c7-a51a-4b29-ac2e-f28a6b8fffb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=189a9370f8b94faabb7009c002c9f642, user_id=fa4545613ae24960bb2d0d5e8bd2a2bd, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.224669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1038/2098] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:41.227476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50841c7-a51a-4b29-ac2e-f28a6b8fffb7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.233100 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a007c4-5ad9-43b4-a989-f8794d27f1b1 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.234170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a007c4-5ad9-43b4-a989-f8794d27f1b1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.234551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a007c4-5ad9-43b4-a989-f8794d27f1b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.241672 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1061/2099] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:41 2022] PUT /identity/v3/projects/189a9370f8b94faabb7009c002c9f642/users/fa4545613ae24960bb2d0d5e8bd2a2bd/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:41.251927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b15c-a9b9-41d4-9efd-0ef81ef83688 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.252218 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b15c-a9b9-41d4-9efd-0ef81ef83688 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.252498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c403b15c-a9b9-41d4-9efd-0ef81ef83688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.254914 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-37a007c4-5ad9-43b4-a989-f8794d27f1b1 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:41.256128 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-37a007c4-5ad9-43b4-a989-f8794d27f1b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:41.281088 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c403b15c-a9b9-41d4-9efd-0ef81ef83688 None None] MFA Rules not processed for user `fa4545613ae24960bb2d0d5e8bd2a2bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:41.282296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c403b15c-a9b9-41d4-9efd-0ef81ef83688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:41.314546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1039/2100] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:41.318886 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a007c4-5ad9-43b4-a989-f8794d27f1b1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.319400 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:41.330067 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a007c4-5ad9-43b4-a989-f8794d27f1b1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.334780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6eb2e-be8a-4d8a-9e5f-9f5315821dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.335393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6eb2e-be8a-4d8a-9e5f-9f5315821dca admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.335708 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6eb2e-be8a-4d8a-9e5f-9f5315821dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.335981 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea6eb2e-be8a-4d8a-9e5f-9f5315821dca admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.336644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6eb2e-be8a-4d8a-9e5f-9f5315821dca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:23:41.337029 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6eb2e-be8a-4d8a-9e5f-9f5315821dca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.338673 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea6eb2e-be8a-4d8a-9e5f-9f5315821dca admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.348698 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1062/2101] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:41 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:41.353425 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1040/2102] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:23:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:23:41.353553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b15c-a9b9-41d4-9efd-0ef81ef83688 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.354641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6eb2e-be8a-4d8a-9e5f-9f5315821dca admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.364470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c403b15c-a9b9-41d4-9efd-0ef81ef83688 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.364838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea6eb2e-be8a-4d8a-9e5f-9f5315821dca admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.369073 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccc214-fbd0-4758-b6aa-93644c809f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.369461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7309169-0ad4-4668-9fed-f887fe10f154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.369667 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccc214-fbd0-4758-b6aa-93644c809f94 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.369942 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccc214-fbd0-4758-b6aa-93644c809f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.370046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7309169-0ad4-4668-9fed-f887fe10f154 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.370212 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ccc214-fbd0-4758-b6aa-93644c809f94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.370313 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7309169-0ad4-4668-9fed-f887fe10f154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.370552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7309169-0ad4-4668-9fed-f887fe10f154 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.370892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccc214-fbd0-4758-b6aa-93644c809f94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.371233 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7309169-0ad4-4668-9fed-f887fe10f154 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.372931 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ccc214-fbd0-4758-b6aa-93644c809f94 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.373122 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7309169-0ad4-4668-9fed-f887fe10f154 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.403826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1041/2103] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:41 2022] POST /identity/v3/projects => generated 363 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:23:41.404039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1063/2104] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:41 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:23:41.405035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7309169-0ad4-4668-9fed-f887fe10f154 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.405155 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccc214-fbd0-4758-b6aa-93644c809f94 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.463695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:41.468943 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ccc214-fbd0-4758-b6aa-93644c809f94 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.470823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7309169-0ad4-4668-9fed-f887fe10f154 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.473985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0074d-5b2e-4e96-b780-7ba8a3abc1ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.474790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0074d-5b2e-4e96-b780-7ba8a3abc1ca admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.475069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0074d-5b2e-4e96-b780-7ba8a3abc1ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.475374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb0074d-5b2e-4e96-b780-7ba8a3abc1ca admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.476063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0074d-5b2e-4e96-b780-7ba8a3abc1ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.478099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb0074d-5b2e-4e96-b780-7ba8a3abc1ca admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.478873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa3250-2a4d-438f-b3ca-ec5b3432c1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.479510 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa3250-2a4d-438f-b3ca-ec5b3432c1e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.479787 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa3250-2a4d-438f-b3ca-ec5b3432c1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.480061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa3250-2a4d-438f-b3ca-ec5b3432c1e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.480712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa3250-2a4d-438f-b3ca-ec5b3432c1e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.482648 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa3250-2a4d-438f-b3ca-ec5b3432c1e1 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.501023 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1064/2105] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:41 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:41.504953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1042/2106] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:41 2022] POST /identity/v3/users => generated 282 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:41.506712 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0074d-5b2e-4e96-b780-7ba8a3abc1ca admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.509095 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa3250-2a4d-438f-b3ca-ec5b3432c1e1 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.520552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb0074d-5b2e-4e96-b780-7ba8a3abc1ca admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.521623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa3250-2a4d-438f-b3ca-ec5b3432c1e1 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.525394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72562577-1aa1-46e9-8cae-cceb5971684f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.526006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72562577-1aa1-46e9-8cae-cceb5971684f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.526292 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72562577-1aa1-46e9-8cae-cceb5971684f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.528226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72562577-1aa1-46e9-8cae-cceb5971684f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.528226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72562577-1aa1-46e9-8cae-cceb5971684f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.528899 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b6671-92b0-4cfe-88ba-0e13e0724176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.529017 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72562577-1aa1-46e9-8cae-cceb5971684f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.529513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b6671-92b0-4cfe-88ba-0e13e0724176 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.529788 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b6671-92b0-4cfe-88ba-0e13e0724176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.530057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871b6671-92b0-4cfe-88ba-0e13e0724176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.531539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b6671-92b0-4cfe-88ba-0e13e0724176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.533188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871b6671-92b0-4cfe-88ba-0e13e0724176 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.542758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1065/2107] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:23:41.544903 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1043/2108] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:41.549169 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72562577-1aa1-46e9-8cae-cceb5971684f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.549411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b6671-92b0-4cfe-88ba-0e13e0724176 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.561235 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871b6671-92b0-4cfe-88ba-0e13e0724176 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.563418 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72562577-1aa1-46e9-8cae-cceb5971684f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.569027 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388892b-9ebf-49a0-8db9-30d35fb1eaf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.570114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388892b-9ebf-49a0-8db9-30d35fb1eaf5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.570486 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388892b-9ebf-49a0-8db9-30d35fb1eaf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.570909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6388892b-9ebf-49a0-8db9-30d35fb1eaf5 admin admin] PATH_INFO: `/v3/projects/a9eedf1f3954443f84e95188051806d0/users/9c3693c8a9b044b9a55725e9d9661dcd/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.587825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d4b08-b24e-4acf-b07c-d0fbc87b507c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.588576 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d4b08-b24e-4acf-b07c-d0fbc87b507c admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.588935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d4b08-b24e-4acf-b07c-d0fbc87b507c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.589238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d4b08-b24e-4acf-b07c-d0fbc87b507c admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.590372 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d4b08-b24e-4acf-b07c-d0fbc87b507c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.593303 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d4b08-b24e-4acf-b07c-d0fbc87b507c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.595295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388892b-9ebf-49a0-8db9-30d35fb1eaf5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9eedf1f3954443f84e95188051806d0, user_id=9c3693c8a9b044b9a55725e9d9661dcd, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.598429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6388892b-9ebf-49a0-8db9-30d35fb1eaf5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.606613 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1044/2109] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:41.615737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d4b08-b24e-4acf-b07c-d0fbc87b507c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.627922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d4b08-b24e-4acf-b07c-d0fbc87b507c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.629607 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1066/2110] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:41 2022] PUT /identity/v3/projects/a9eedf1f3954443f84e95188051806d0/users/9c3693c8a9b044b9a55725e9d9661dcd/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:41.633235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388892b-9ebf-49a0-8db9-30d35fb1eaf5 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.701318 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a761e-e142-45c6-a471-9c11c5b86572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.703161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a761e-e142-45c6-a471-9c11c5b86572 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.703451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a761e-e142-45c6-a471-9c11c5b86572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.703745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8a761e-e142-45c6-a471-9c11c5b86572 admin admin] PATH_INFO: `/v3/projects/7702504382904b2b963d338b88818c57/users/8daf9af7c68448dc93fdbf5acf5e4a35/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.724054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a761e-e142-45c6-a471-9c11c5b86572 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7702504382904b2b963d338b88818c57, user_id=8daf9af7c68448dc93fdbf5acf5e4a35, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.727027 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6388892b-9ebf-49a0-8db9-30d35fb1eaf5 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.727486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8a761e-e142-45c6-a471-9c11c5b86572 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.735535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a5c0d01-6503-425d-9807-72b89b3946ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.736355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c0d01-6503-425d-9807-72b89b3946ca admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.736730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c0d01-6503-425d-9807-72b89b3946ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.737123 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a5c0d01-6503-425d-9807-72b89b3946ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.738007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c0d01-6503-425d-9807-72b89b3946ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.739666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a5c0d01-6503-425d-9807-72b89b3946ca admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.754601 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1045/2111] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:41 2022] PUT /identity/v3/projects/7702504382904b2b963d338b88818c57/users/8daf9af7c68448dc93fdbf5acf5e4a35/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:41.759887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1067/2112] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:41 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:23:41.771893 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a761e-e142-45c6-a471-9c11c5b86572 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.819406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1ccaa-3f07-4ea5-9234-61ef275bc938 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.819706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1ccaa-3f07-4ea5-9234-61ef275bc938 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.819961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1ccaa-3f07-4ea5-9234-61ef275bc938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.835283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:41.854008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-afe1ccaa-3f07-4ea5-9234-61ef275bc938 None None] MFA Rules not processed for user `8daf9af7c68448dc93fdbf5acf5e4a35`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:41.854200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8a761e-e142-45c6-a471-9c11c5b86572 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:41.855826 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-afe1ccaa-3f07-4ea5-9234-61ef275bc938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:41.864182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88169016-a4ce-466a-9bbb-ce83c29f34d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:41.865840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88169016-a4ce-466a-9bbb-ce83c29f34d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.866391 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88169016-a4ce-466a-9bbb-ce83c29f34d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.866699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88169016-a4ce-466a-9bbb-ce83c29f34d6 admin admin] PATH_INFO: `/v3/projects/a9eedf1f3954443f84e95188051806d0/users/9c3693c8a9b044b9a55725e9d9661dcd/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.869011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88169016-a4ce-466a-9bbb-ce83c29f34d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9eedf1f3954443f84e95188051806d0, user_id=9c3693c8a9b044b9a55725e9d9661dcd, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:41.872094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88169016-a4ce-466a-9bbb-ce83c29f34d6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:41.890631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1046/2113] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:41 2022] PUT /identity/v3/projects/a9eedf1f3954443f84e95188051806d0/users/9c3693c8a9b044b9a55725e9d9661dcd/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:41.896946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb575b-3d88-4cad-8583-33da104f4b17 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:41.897329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb575b-3d88-4cad-8583-33da104f4b17 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:41.897591 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbb575b-3d88-4cad-8583-33da104f4b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:41.930495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2bbb575b-3d88-4cad-8583-33da104f4b17 None None] MFA Rules not processed for user `9c3693c8a9b044b9a55725e9d9661dcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:41.931766 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2bbb575b-3d88-4cad-8583-33da104f4b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:41.939837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1068/2114] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:41 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:41.951616 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1ccaa-3f07-4ea5-9234-61ef275bc938 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:41.954151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-afe1ccaa-3f07-4ea5-9234-61ef275bc938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:41.965273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:42.013748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1047/2115] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:41 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:42.016002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1ccaa-3f07-4ea5-9234-61ef275bc938 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:42.024992 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb575b-3d88-4cad-8583-33da104f4b17 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:42.026352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2bbb575b-3d88-4cad-8583-33da104f4b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:42.068639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553efad7-a82e-43c0-9e46-cf6895c4b951 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:42.069503 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553efad7-a82e-43c0-9e46-cf6895c4b951 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:42.069829 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553efad7-a82e-43c0-9e46-cf6895c4b951 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:42.070135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553efad7-a82e-43c0-9e46-cf6895c4b951 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:42.089577 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbb575b-3d88-4cad-8583-33da104f4b17 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:42.093327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdb8a3-6b9c-47c1-987a-c1de8481d137 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:42.093943 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdb8a3-6b9c-47c1-987a-c1de8481d137 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:42.094246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdb8a3-6b9c-47c1-987a-c1de8481d137 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:42.094519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdb8a3-6b9c-47c1-987a-c1de8481d137 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:42.104585 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdb8a3-6b9c-47c1-987a-c1de8481d137 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:42.106026 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdb8a3-6b9c-47c1-987a-c1de8481d137 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:42.116846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1048/2116] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:42 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:23:42.131370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553efad7-a82e-43c0-9e46-cf6895c4b951 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:42.132807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553efad7-a82e-43c0-9e46-cf6895c4b951 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:42.144481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1069/2117] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:41 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:23:42.191740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdb8a3-6b9c-47c1-987a-c1de8481d137 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:42.201481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdb8a3-6b9c-47c1-987a-c1de8481d137 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:42.207417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4057a86-8019-4549-92ff-9970cd658d72 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:42.208123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4057a86-8019-4549-92ff-9970cd658d72 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:42.208574 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4057a86-8019-4549-92ff-9970cd658d72 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:42.209339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4057a86-8019-4549-92ff-9970cd658d72 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:42.270707 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4057a86-8019-4549-92ff-9970cd658d72 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:42.272071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4057a86-8019-4549-92ff-9970cd658d72 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:42.282108 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1049/2118] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:52.139126 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:52.277547 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=70 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:56.685241 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b80b00-0d87-4ca6-9037-c3ff976d9f6a None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:56.685736 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b80b00-0d87-4ca6-9037-c3ff976d9f6a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:56.686172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b80b00-0d87-4ca6-9037-c3ff976d9f6a None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:56.688916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1070/2119] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 1 14:23:56 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:23:56.727792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150b66c-be3d-4dc1-9510-32f938b9294f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:56.728686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150b66c-be3d-4dc1-9510-32f938b9294f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:56.729528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150b66c-be3d-4dc1-9510-32f938b9294f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:56.753586 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2150b66c-be3d-4dc1-9510-32f938b9294f None None] MFA Rules not processed for user `e210ee6c390849e7a630a677ec52e966`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:56.755082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2150b66c-be3d-4dc1-9510-32f938b9294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:56.844229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1050/2120] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 1 14:23:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:56.858086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b80b00-0d87-4ca6-9037-c3ff976d9f6a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:56.860098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c1b80b00-0d87-4ca6-9037-c3ff976d9f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:56.881094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b80b00-0d87-4ca6-9037-c3ff976d9f6a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:56.888075 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbc5a6-006a-4f3d-91dd-851bf69823bc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210ee6c390849e7a630a677ec52e966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:56.888865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbc5a6-006a-4f3d-91dd-851bf69823bc service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:56.889855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbc5a6-006a-4f3d-91dd-851bf69823bc service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:56.890246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45dbc5a6-006a-4f3d-91dd-851bf69823bc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:56.907733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbc5a6-006a-4f3d-91dd-851bf69823bc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:56.909544 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45dbc5a6-006a-4f3d-91dd-851bf69823bc service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:56.921821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1071/2121] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:57.361727 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150b66c-be3d-4dc1-9510-32f938b9294f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:57.363678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2150b66c-be3d-4dc1-9510-32f938b9294f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:57.447360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150b66c-be3d-4dc1-9510-32f938b9294f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:57.452542 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcdfbe-c266-44cb-a79c-3b4c7a1bb8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:57.453187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcdfbe-c266-44cb-a79c-3b4c7a1bb8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:57.453466 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcdfbe-c266-44cb-a79c-3b4c7a1bb8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:57.454018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dcdfbe-c266-44cb-a79c-3b4c7a1bb8de admin admin] PATH_INFO: `/v3/users/ea1ddc41c94e4f789e0afe5d3ed3d419` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:57.455216 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcdfbe-c266-44cb-a79c-3b4c7a1bb8de admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea1ddc41c94e4f789e0afe5d3ed3d419)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:57.457161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dcdfbe-c266-44cb-a79c-3b4c7a1bb8de admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:57.502295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e0dcdfbe-c266-44cb-a79c-3b4c7a1bb8de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea1ddc41c94e4f789e0afe5d3ed3d419'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:57.509836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e0dcdfbe-c266-44cb-a79c-3b4c7a1bb8de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea1ddc41c94e4f789e0afe5d3ed3d419'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:57.522754 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e0dcdfbe-c266-44cb-a79c-3b4c7a1bb8de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea1ddc41c94e4f789e0afe5d3ed3d419'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:57.523342 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e0dcdfbe-c266-44cb-a79c-3b4c7a1bb8de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea1ddc41c94e4f789e0afe5d3ed3d419'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:57.530244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e0dcdfbe-c266-44cb-a79c-3b4c7a1bb8de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea1ddc41c94e4f789e0afe5d3ed3d419'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:57.536239 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1051/2122] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:57 2022] DELETE /identity/v3/users/ea1ddc41c94e4f789e0afe5d3ed3d419 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:57.707971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbc5a6-006a-4f3d-91dd-851bf69823bc service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:57.720326 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45dbc5a6-006a-4f3d-91dd-851bf69823bc service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:57.788271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe5302-c085-464a-9b25-83aded2829db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:57.789498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe5302-c085-464a-9b25-83aded2829db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:57.789782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe5302-c085-464a-9b25-83aded2829db admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:57.790053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-febe5302-c085-464a-9b25-83aded2829db admin admin] PATH_INFO: `/v3/projects/d29153d0f4d3429a9ea80364f11c0b90` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:57.791536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe5302-c085-464a-9b25-83aded2829db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29153d0f4d3429a9ea80364f11c0b90)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:57.793463 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-febe5302-c085-464a-9b25-83aded2829db admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:57.844302 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-febe5302-c085-464a-9b25-83aded2829db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29153d0f4d3429a9ea80364f11c0b90', 'request_id': 'req-febe5302-c085-464a-9b25-83aded2829db'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:57.851408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-febe5302-c085-464a-9b25-83aded2829db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29153d0f4d3429a9ea80364f11c0b90', 'request_id': 'req-febe5302-c085-464a-9b25-83aded2829db'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:57.857470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-febe5302-c085-464a-9b25-83aded2829db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29153d0f4d3429a9ea80364f11c0b90', 'request_id': 'req-febe5302-c085-464a-9b25-83aded2829db'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:57.872417 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-febe5302-c085-464a-9b25-83aded2829db admin admin] The token cache is being invalidate because project d29153d0f4d3429a9ea80364f11c0b90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:57.872720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-febe5302-c085-464a-9b25-83aded2829db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:57.874027 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-febe5302-c085-464a-9b25-83aded2829db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:57.876006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1072/2123] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:57 2022] DELETE /identity/v3/projects/d29153d0f4d3429a9ea80364f11c0b90 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:57.879962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcdfbe-c266-44cb-a79c-3b4c7a1bb8de admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:57.881442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e0dcdfbe-c266-44cb-a79c-3b4c7a1bb8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:57.899452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dcdfbe-c266-44cb-a79c-3b4c7a1bb8de admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:57.911498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:57.963912 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c8fe5-f3b5-42dc-92c7-27265bd9bcc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:57.964840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c8fe5-f3b5-42dc-92c7-27265bd9bcc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:57.965150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c8fe5-f3b5-42dc-92c7-27265bd9bcc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:57.965423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c8fe5-f3b5-42dc-92c7-27265bd9bcc3 admin admin] PATH_INFO: `/v3/users/9b2f968dd3b0459695bf280ef849c839` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:57.967320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c8fe5-f3b5-42dc-92c7-27265bd9bcc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b2f968dd3b0459695bf280ef849c839)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:57.969295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c8fe5-f3b5-42dc-92c7-27265bd9bcc3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:57.989501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe5302-c085-464a-9b25-83aded2829db admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:57.990944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-febe5302-c085-464a-9b25-83aded2829db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:58.006797 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-febe5302-c085-464a-9b25-83aded2829db admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:58.012337 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7823593-8af7-4f9b-a34f-00da78055a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:58.012977 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7823593-8af7-4f9b-a34f-00da78055a0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:58.013255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7823593-8af7-4f9b-a34f-00da78055a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:58.013529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7823593-8af7-4f9b-a34f-00da78055a0f admin admin] PATH_INFO: `/v3/users/1b9fa6d7d5954c2c84b34d3d167f9853` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:58.014766 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7823593-8af7-4f9b-a34f-00da78055a0f admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b9fa6d7d5954c2c84b34d3d167f9853)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:58.016693 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7823593-8af7-4f9b-a34f-00da78055a0f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:58.026095 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-975c8fe5-f3b5-42dc-92c7-27265bd9bcc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b2f968dd3b0459695bf280ef849c839'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.034190 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-975c8fe5-f3b5-42dc-92c7-27265bd9bcc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b2f968dd3b0459695bf280ef849c839'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.049306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-975c8fe5-f3b5-42dc-92c7-27265bd9bcc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b2f968dd3b0459695bf280ef849c839'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.050186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-975c8fe5-f3b5-42dc-92c7-27265bd9bcc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b2f968dd3b0459695bf280ef849c839'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.059377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-975c8fe5-f3b5-42dc-92c7-27265bd9bcc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b2f968dd3b0459695bf280ef849c839'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.066416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1052/2124] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:57 2022] DELETE /identity/v3/users/9b2f968dd3b0459695bf280ef849c839 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:58.078856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c7823593-8af7-4f9b-a34f-00da78055a0f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b9fa6d7d5954c2c84b34d3d167f9853'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.092617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c7823593-8af7-4f9b-a34f-00da78055a0f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b9fa6d7d5954c2c84b34d3d167f9853'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.098239 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:58.100392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c7823593-8af7-4f9b-a34f-00da78055a0f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b9fa6d7d5954c2c84b34d3d167f9853'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.102063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c7823593-8af7-4f9b-a34f-00da78055a0f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b9fa6d7d5954c2c84b34d3d167f9853'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.114372 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c7823593-8af7-4f9b-a34f-00da78055a0f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b9fa6d7d5954c2c84b34d3d167f9853'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.121183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1073/2125] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:57 2022] DELETE /identity/v3/users/1b9fa6d7d5954c2c84b34d3d167f9853 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:58.126330 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7715-018e-4036-961f-0ca60fa00439 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:58.126642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7715-018e-4036-961f-0ca60fa00439 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:58.126946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279f7715-018e-4036-961f-0ca60fa00439 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:58.146253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-279f7715-018e-4036-961f-0ca60fa00439 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:58.147504 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-279f7715-018e-4036-961f-0ca60fa00439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:58.215381 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1053/2126] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:58.225562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7823593-8af7-4f9b-a34f-00da78055a0f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:58.227117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c7823593-8af7-4f9b-a34f-00da78055a0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:58.261875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f7715-018e-4036-961f-0ca60fa00439 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:58.263459 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-279f7715-018e-4036-961f-0ca60fa00439 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:58.282397 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279f7715-018e-4036-961f-0ca60fa00439 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:58.288562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf063654-b7d0-414c-b87a-d0025387c798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:58.289326 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf063654-b7d0-414c-b87a-d0025387c798 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:58.289548 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf063654-b7d0-414c-b87a-d0025387c798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:58.289825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf063654-b7d0-414c-b87a-d0025387c798 admin admin] PATH_INFO: `/v3/projects/95cd143af9214116a9c8f47f836db570` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:58.291016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf063654-b7d0-414c-b87a-d0025387c798 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95cd143af9214116a9c8f47f836db570)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:58.293116 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf063654-b7d0-414c-b87a-d0025387c798 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:58.309172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7823593-8af7-4f9b-a34f-00da78055a0f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:58.313168 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52afc73-99bd-4e31-9eb2-280e4a903c25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:58.313899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52afc73-99bd-4e31-9eb2-280e4a903c25 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:58.314183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52afc73-99bd-4e31-9eb2-280e4a903c25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:58.314458 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52afc73-99bd-4e31-9eb2-280e4a903c25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:58.324194 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52afc73-99bd-4e31-9eb2-280e4a903c25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:58.325912 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52afc73-99bd-4e31-9eb2-280e4a903c25 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:58.330726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:58.337041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1074/2127] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:58.349639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cf063654-b7d0-414c-b87a-d0025387c798 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95cd143af9214116a9c8f47f836db570', 'request_id': 'req-cf063654-b7d0-414c-b87a-d0025387c798'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.357338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cf063654-b7d0-414c-b87a-d0025387c798 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95cd143af9214116a9c8f47f836db570', 'request_id': 'req-cf063654-b7d0-414c-b87a-d0025387c798'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.367507 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cf063654-b7d0-414c-b87a-d0025387c798 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95cd143af9214116a9c8f47f836db570', 'request_id': 'req-cf063654-b7d0-414c-b87a-d0025387c798'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.380366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cf063654-b7d0-414c-b87a-d0025387c798 admin admin] The token cache is being invalidate because project 95cd143af9214116a9c8f47f836db570 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:58.380655 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cf063654-b7d0-414c-b87a-d0025387c798 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.381315 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-cf063654-b7d0-414c-b87a-d0025387c798 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.382882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1054/2128] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:58 2022] DELETE /identity/v3/projects/95cd143af9214116a9c8f47f836db570 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:58.388002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e426f-2c14-4aae-896a-2035f3cbd00a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:58.388375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e426f-2c14-4aae-896a-2035f3cbd00a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:58.388820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e426f-2c14-4aae-896a-2035f3cbd00a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:58.409911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ad5e426f-2c14-4aae-896a-2035f3cbd00a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:58.411213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ad5e426f-2c14-4aae-896a-2035f3cbd00a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:58.491498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1075/2129] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:58.500172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af92c9-0b82-474e-abd6-cc577aae1523 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:58.500534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af92c9-0b82-474e-abd6-cc577aae1523 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:58.500931 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50af92c9-0b82-474e-abd6-cc577aae1523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:58.539892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-50af92c9-0b82-474e-abd6-cc577aae1523 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:58.540871 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-50af92c9-0b82-474e-abd6-cc577aae1523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:58.550448 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1055/2130] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:23:58.554711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e426f-2c14-4aae-896a-2035f3cbd00a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:58.565971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e426f-2c14-4aae-896a-2035f3cbd00a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:58.571443 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a6b4e-94dc-4394-844d-8a90487d818f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:58.572060 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a6b4e-94dc-4394-844d-8a90487d818f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:58.572345 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a6b4e-94dc-4394-844d-8a90487d818f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:58.572619 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396a6b4e-94dc-4394-844d-8a90487d818f admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:58.573323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a6b4e-94dc-4394-844d-8a90487d818f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:23:58.573628 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a6b4e-94dc-4394-844d-8a90487d818f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:58.575269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396a6b4e-94dc-4394-844d-8a90487d818f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:58.588099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1076/2131] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:23:58.593124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af92c9-0b82-474e-abd6-cc577aae1523 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:58.608360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50af92c9-0b82-474e-abd6-cc577aae1523 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:58.611640 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfc3c0-1a98-4984-9646-be36ef9ff3a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:58.612405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfc3c0-1a98-4984-9646-be36ef9ff3a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:58.612740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfc3c0-1a98-4984-9646-be36ef9ff3a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:58.612948 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bfc3c0-1a98-4984-9646-be36ef9ff3a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:58.613639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfc3c0-1a98-4984-9646-be36ef9ff3a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:58.615698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bfc3c0-1a98-4984-9646-be36ef9ff3a7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:58.659987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1056/2132] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:23:58 2022] POST /identity/v3/projects => generated 385 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:58.666545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a6b4e-94dc-4394-844d-8a90487d818f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:58.677379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396a6b4e-94dc-4394-844d-8a90487d818f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:58.684140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfc3c0-1a98-4984-9646-be36ef9ff3a7 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:58.686879 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-26bfc3c0-1a98-4984-9646-be36ef9ff3a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:58.755414 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261f2fd-662c-4699-b544-d25b7e05d0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:58.756708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261f2fd-662c-4699-b544-d25b7e05d0b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:58.756995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261f2fd-662c-4699-b544-d25b7e05d0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:58.757264 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7261f2fd-662c-4699-b544-d25b7e05d0b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:58.757941 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261f2fd-662c-4699-b544-d25b7e05d0b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:58.759915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7261f2fd-662c-4699-b544-d25b7e05d0b7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:58.761004 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bfc3c0-1a98-4984-9646-be36ef9ff3a7 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:58.765697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffe0c1-6837-4dd2-bf3f-d89213ead353 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:58.766336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe0c1-6837-4dd2-bf3f-d89213ead353 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:58.766642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe0c1-6837-4dd2-bf3f-d89213ead353 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:58.766919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ffe0c1-6837-4dd2-bf3f-d89213ead353 admin admin] PATH_INFO: `/v3/projects/d96bdde52958423791386338323fbd03` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:58.768139 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffe0c1-6837-4dd2-bf3f-d89213ead353 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d96bdde52958423791386338323fbd03)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:58.770277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ffe0c1-6837-4dd2-bf3f-d89213ead353 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:58.786609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1077/2133] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:23:58 2022] POST /identity/v3/users => generated 293 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:23:58.788495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261f2fd-662c-4699-b544-d25b7e05d0b7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:58.801872 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7261f2fd-662c-4699-b544-d25b7e05d0b7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:58.808971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082860d-1229-4329-ac75-9a47d41eb9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:58.809836 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082860d-1229-4329-ac75-9a47d41eb9db admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:58.809959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082860d-1229-4329-ac75-9a47d41eb9db admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:58.810183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e082860d-1229-4329-ac75-9a47d41eb9db admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:58.811466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082860d-1229-4329-ac75-9a47d41eb9db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:58.813120 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e082860d-1229-4329-ac75-9a47d41eb9db admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:58.815615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:58.834114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-36ffe0c1-6837-4dd2-bf3f-d89213ead353 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd96bdde52958423791386338323fbd03', 'request_id': 'req-36ffe0c1-6837-4dd2-bf3f-d89213ead353'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.838630 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1078/2134] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:23:58.840342 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082860d-1229-4329-ac75-9a47d41eb9db admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:58.843591 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-36ffe0c1-6837-4dd2-bf3f-d89213ead353 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd96bdde52958423791386338323fbd03', 'request_id': 'req-36ffe0c1-6837-4dd2-bf3f-d89213ead353'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.851489 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-36ffe0c1-6837-4dd2-bf3f-d89213ead353 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd96bdde52958423791386338323fbd03', 'request_id': 'req-36ffe0c1-6837-4dd2-bf3f-d89213ead353'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.856726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e082860d-1229-4329-ac75-9a47d41eb9db admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:58.863819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-36ffe0c1-6837-4dd2-bf3f-d89213ead353 admin admin] The token cache is being invalidate because project d96bdde52958423791386338323fbd03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:23:58.864133 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-36ffe0c1-6837-4dd2-bf3f-d89213ead353 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.864786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-36ffe0c1-6837-4dd2-bf3f-d89213ead353 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:58.867265 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1057/2135] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:58 2022] DELETE /identity/v3/projects/d96bdde52958423791386338323fbd03 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:23:58.919456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257185e4-6314-46d0-b836-5c63c94a9f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:58.920804 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257185e4-6314-46d0-b836-5c63c94a9f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:58.921094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257185e4-6314-46d0-b836-5c63c94a9f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:58.921370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257185e4-6314-46d0-b836-5c63c94a9f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:58.922091 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257185e4-6314-46d0-b836-5c63c94a9f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:58.923848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257185e4-6314-46d0-b836-5c63c94a9f22 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:58.934919 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1079/2136] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:23:58.939627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffe0c1-6837-4dd2-bf3f-d89213ead353 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:58.941413 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-36ffe0c1-6837-4dd2-bf3f-d89213ead353 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:58.957159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ffe0c1-6837-4dd2-bf3f-d89213ead353 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:58.963668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e095ef-7e2e-4e8e-97e1-f2d6d125c97b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:58.964472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e095ef-7e2e-4e8e-97e1-f2d6d125c97b admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:58.964969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e095ef-7e2e-4e8e-97e1-f2d6d125c97b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:58.965324 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e095ef-7e2e-4e8e-97e1-f2d6d125c97b admin admin] PATH_INFO: `/v3/projects/bf0ef50f465e413d9cb05b42d378a66b/users/22baa09fa5d142f08b27d500b4bc8900/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:58.992204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e095ef-7e2e-4e8e-97e1-f2d6d125c97b admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0ef50f465e413d9cb05b42d378a66b, user_id=22baa09fa5d142f08b27d500b4bc8900, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:58.995102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e095ef-7e2e-4e8e-97e1-f2d6d125c97b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:58.999760 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=84,keystone:DELETE=12,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:59.021150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1058/2137] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:23:58 2022] PUT /identity/v3/projects/bf0ef50f465e413d9cb05b42d378a66b/users/22baa09fa5d142f08b27d500b4bc8900/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:59.033678 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565987ca-e812-42f5-877c-b376be40bae1 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:59.034084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565987ca-e812-42f5-877c-b376be40bae1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:59.034481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565987ca-e812-42f5-877c-b376be40bae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:59.069271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-565987ca-e812-42f5-877c-b376be40bae1 None None] MFA Rules not processed for user `22baa09fa5d142f08b27d500b4bc8900`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:59.071935 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-565987ca-e812-42f5-877c-b376be40bae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:59.154158 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1080/2138] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:59.161790 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e095ef-7e2e-4e8e-97e1-f2d6d125c97b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:59.165946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-41e095ef-7e2e-4e8e-97e1-f2d6d125c97b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:59.225381 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e095ef-7e2e-4e8e-97e1-f2d6d125c97b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:59.229456 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49172cd9-94d9-4806-8379-d70e7095d394 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:59.230073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49172cd9-94d9-4806-8379-d70e7095d394 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:59.230356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49172cd9-94d9-4806-8379-d70e7095d394 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:59.230671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49172cd9-94d9-4806-8379-d70e7095d394 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:59.240017 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49172cd9-94d9-4806-8379-d70e7095d394 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:59.241637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49172cd9-94d9-4806-8379-d70e7095d394 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:59.252274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1059/2139] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:59.271150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565987ca-e812-42f5-877c-b376be40bae1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:59.335496 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565987ca-e812-42f5-877c-b376be40bae1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:59.340015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412c930-3c7f-4ac1-9fd0-25f72a2cc944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:59.340653 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412c930-3c7f-4ac1-9fd0-25f72a2cc944 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:59.340935 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412c930-3c7f-4ac1-9fd0-25f72a2cc944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:59.341208 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3412c930-3c7f-4ac1-9fd0-25f72a2cc944 admin admin] PATH_INFO: `/v3/users/22baa09fa5d142f08b27d500b4bc8900` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:59.342375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412c930-3c7f-4ac1-9fd0-25f72a2cc944 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22baa09fa5d142f08b27d500b4bc8900)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:59.344331 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3412c930-3c7f-4ac1-9fd0-25f72a2cc944 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:59.371851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:23:59.392552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3412c930-3c7f-4ac1-9fd0-25f72a2cc944 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22baa09fa5d142f08b27d500b4bc8900'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:59.406571 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3412c930-3c7f-4ac1-9fd0-25f72a2cc944 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22baa09fa5d142f08b27d500b4bc8900'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:59.413862 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3412c930-3c7f-4ac1-9fd0-25f72a2cc944 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22baa09fa5d142f08b27d500b4bc8900'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:59.414641 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3412c930-3c7f-4ac1-9fd0-25f72a2cc944 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22baa09fa5d142f08b27d500b4bc8900'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:59.423318 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3412c930-3c7f-4ac1-9fd0-25f72a2cc944 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22baa09fa5d142f08b27d500b4bc8900'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:59.429240 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1081/2140] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:23:59 2022] DELETE /identity/v3/users/22baa09fa5d142f08b27d500b4bc8900 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:23:59.433771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97820d43-0e71-4b10-a6e1-73bd1dc5ae52 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:59.434080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97820d43-0e71-4b10-a6e1-73bd1dc5ae52 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:59.434353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97820d43-0e71-4b10-a6e1-73bd1dc5ae52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:59.453459 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-97820d43-0e71-4b10-a6e1-73bd1dc5ae52 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:23:59.454935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-97820d43-0e71-4b10-a6e1-73bd1dc5ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:59.522640 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1060/2141] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:23:59.532210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412c930-3c7f-4ac1-9fd0-25f72a2cc944 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:59.533721 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3412c930-3c7f-4ac1-9fd0-25f72a2cc944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:59.593007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3412c930-3c7f-4ac1-9fd0-25f72a2cc944 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:59.596629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be016be9-b18f-4cc6-a88f-72294e686a8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:59.597237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be016be9-b18f-4cc6-a88f-72294e686a8c service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:59.597516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be016be9-b18f-4cc6-a88f-72294e686a8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:59.597786 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be016be9-b18f-4cc6-a88f-72294e686a8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:59.607086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be016be9-b18f-4cc6-a88f-72294e686a8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:59.609169 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be016be9-b18f-4cc6-a88f-72294e686a8c service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:59.618749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1082/2142] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:23:59.912762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97820d43-0e71-4b10-a6e1-73bd1dc5ae52 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:23:59.914644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-97820d43-0e71-4b10-a6e1-73bd1dc5ae52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:23:59.929843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97820d43-0e71-4b10-a6e1-73bd1dc5ae52 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:23:59.934660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0a7b05-5dc9-4477-8d88-ae2590f232c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:23:59.935426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a7b05-5dc9-4477-8d88-ae2590f232c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:23:59.936446 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a7b05-5dc9-4477-8d88-ae2590f232c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:23:59.936795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0a7b05-5dc9-4477-8d88-ae2590f232c9 admin admin] PATH_INFO: `/v3/projects/bf0ef50f465e413d9cb05b42d378a66b` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:23:59.938404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a7b05-5dc9-4477-8d88-ae2590f232c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0ef50f465e413d9cb05b42d378a66b)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:23:59.940917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0a7b05-5dc9-4477-8d88-ae2590f232c9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:23:59.990230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3e0a7b05-5dc9-4477-8d88-ae2590f232c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0ef50f465e413d9cb05b42d378a66b', 'request_id': 'req-3e0a7b05-5dc9-4477-8d88-ae2590f232c9'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:23:59.995757 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3e0a7b05-5dc9-4477-8d88-ae2590f232c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0ef50f465e413d9cb05b42d378a66b', 'request_id': 'req-3e0a7b05-5dc9-4477-8d88-ae2590f232c9'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:00.003762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3e0a7b05-5dc9-4477-8d88-ae2590f232c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0ef50f465e413d9cb05b42d378a66b', 'request_id': 'req-3e0a7b05-5dc9-4477-8d88-ae2590f232c9'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:00.015866 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3e0a7b05-5dc9-4477-8d88-ae2590f232c9 admin admin] The token cache is being invalidate because project bf0ef50f465e413d9cb05b42d378a66b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:00.016305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3e0a7b05-5dc9-4477-8d88-ae2590f232c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:00.017024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3e0a7b05-5dc9-4477-8d88-ae2590f232c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:00.018791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1061/2143] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:23:59 2022] DELETE /identity/v3/projects/bf0ef50f465e413d9cb05b42d378a66b => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:00.025040 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982bcd8-1515-4ae6-a551-555d1a3b352e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:00.025563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982bcd8-1515-4ae6-a551-555d1a3b352e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:00.025794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982bcd8-1515-4ae6-a551-555d1a3b352e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:00.046129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f982bcd8-1515-4ae6-a551-555d1a3b352e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:00.047340 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f982bcd8-1515-4ae6-a551-555d1a3b352e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:00.109929 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1083/2144] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:00.116887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918e1c3-cfe6-48b7-a4ec-5420a70a4138 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:00.117176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918e1c3-cfe6-48b7-a4ec-5420a70a4138 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:00.117455 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b918e1c3-cfe6-48b7-a4ec-5420a70a4138 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:00.137735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b918e1c3-cfe6-48b7-a4ec-5420a70a4138 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:00.139565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b918e1c3-cfe6-48b7-a4ec-5420a70a4138 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:00.147912 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1062/2145] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:00.152478 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982bcd8-1515-4ae6-a551-555d1a3b352e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:00.163644 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982bcd8-1515-4ae6-a551-555d1a3b352e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:00.168739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed41a9-6af4-4477-8728-bd1f7cbbaa03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:00.169354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed41a9-6af4-4477-8728-bd1f7cbbaa03 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:00.169635 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed41a9-6af4-4477-8728-bd1f7cbbaa03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:00.169912 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ed41a9-6af4-4477-8728-bd1f7cbbaa03 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:00.170647 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed41a9-6af4-4477-8728-bd1f7cbbaa03 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:24:00.170959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed41a9-6af4-4477-8728-bd1f7cbbaa03 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:00.172631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ed41a9-6af4-4477-8728-bd1f7cbbaa03 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:00.190904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1084/2146] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:24:00.196199 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918e1c3-cfe6-48b7-a4ec-5420a70a4138 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:00.206897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b918e1c3-cfe6-48b7-a4ec-5420a70a4138 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:00.212282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec98fcb-e3c4-4c13-8ae3-84c5f5f35aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:00.212900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec98fcb-e3c4-4c13-8ae3-84c5f5f35aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:00.213176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec98fcb-e3c4-4c13-8ae3-84c5f5f35aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:00.213443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec98fcb-e3c4-4c13-8ae3-84c5f5f35aa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:00.214099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec98fcb-e3c4-4c13-8ae3-84c5f5f35aa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:00.216053 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec98fcb-e3c4-4c13-8ae3-84c5f5f35aa1 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:00.232144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:00.254008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1063/2147] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:24:00 2022] POST /identity/v3/projects => generated 375 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:00.258355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed41a9-6af4-4477-8728-bd1f7cbbaa03 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:00.268690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ed41a9-6af4-4477-8728-bd1f7cbbaa03 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:00.306817 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:00.336715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbefc30-6af9-4dec-b2cb-32cfd5a31b3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:00.337335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbefc30-6af9-4dec-b2cb-32cfd5a31b3f admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:00.337617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbefc30-6af9-4dec-b2cb-32cfd5a31b3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:00.337890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbefc30-6af9-4dec-b2cb-32cfd5a31b3f admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:00.338553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbefc30-6af9-4dec-b2cb-32cfd5a31b3f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:00.340500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbefc30-6af9-4dec-b2cb-32cfd5a31b3f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:00.368941 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1085/2148] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:24:00 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:00.372897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec98fcb-e3c4-4c13-8ae3-84c5f5f35aa1 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:00.384232 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec98fcb-e3c4-4c13-8ae3-84c5f5f35aa1 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:00.389720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3e974-7684-4e03-a923-ff590735d0bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:00.390319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3e974-7684-4e03-a923-ff590735d0bb admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:00.390605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3e974-7684-4e03-a923-ff590735d0bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:00.390936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3e974-7684-4e03-a923-ff590735d0bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:00.391587 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3e974-7684-4e03-a923-ff590735d0bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:00.393400 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3e974-7684-4e03-a923-ff590735d0bb admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:00.403313 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1064/2149] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:24:00.407207 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbefc30-6af9-4dec-b2cb-32cfd5a31b3f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:00.416978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbefc30-6af9-4dec-b2cb-32cfd5a31b3f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:00.421526 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1da219-d2f3-4ccd-a7ef-a4473a835d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:00.422117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1da219-d2f3-4ccd-a7ef-a4473a835d61 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:00.422396 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1da219-d2f3-4ccd-a7ef-a4473a835d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:00.422696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1da219-d2f3-4ccd-a7ef-a4473a835d61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:00.423374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1da219-d2f3-4ccd-a7ef-a4473a835d61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:00.424944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1da219-d2f3-4ccd-a7ef-a4473a835d61 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:00.435399 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1086/2150] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:00.440076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3e974-7684-4e03-a923-ff590735d0bb admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:00.453402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3e974-7684-4e03-a923-ff590735d0bb admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:00.458450 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad576c4-c230-4ea4-b774-de4c0d350584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:00.459161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad576c4-c230-4ea4-b774-de4c0d350584 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:00.459442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad576c4-c230-4ea4-b774-de4c0d350584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:00.459714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad576c4-c230-4ea4-b774-de4c0d350584 admin admin] PATH_INFO: `/v3/projects/7ef9e729ca794303b3760f938fb7e2e7/users/33e3a5e58607406a93c5afa430cc2c72/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:00.474567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad576c4-c230-4ea4-b774-de4c0d350584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ef9e729ca794303b3760f938fb7e2e7, user_id=33e3a5e58607406a93c5afa430cc2c72, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:00.477291 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad576c4-c230-4ea4-b774-de4c0d350584 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:00.491261 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1065/2151] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:00 2022] PUT /identity/v3/projects/7ef9e729ca794303b3760f938fb7e2e7/users/33e3a5e58607406a93c5afa430cc2c72/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:00.502145 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794de0-9f15-4983-bf1c-6ef6f3958043 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:00.502462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794de0-9f15-4983-bf1c-6ef6f3958043 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:00.502797 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b794de0-9f15-4983-bf1c-6ef6f3958043 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:00.531956 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2b794de0-9f15-4983-bf1c-6ef6f3958043 None None] MFA Rules not processed for user `33e3a5e58607406a93c5afa430cc2c72`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:00.533479 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2b794de0-9f15-4983-bf1c-6ef6f3958043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:00.599028 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1087/2152] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:00.613786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad576c4-c230-4ea4-b774-de4c0d350584 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:00.617363 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6ad576c4-c230-4ea4-b774-de4c0d350584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:00.673743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad576c4-c230-4ea4-b774-de4c0d350584 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:00.677330 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341bdd64-db87-44c9-b135-4024365d33cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc213ef64924074bd16152228913ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:00.677943 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bdd64-db87-44c9-b135-4024365d33cd service glance] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:00.678223 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bdd64-db87-44c9-b135-4024365d33cd service glance] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:00.678497 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341bdd64-db87-44c9-b135-4024365d33cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:00.686760 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341bdd64-db87-44c9-b135-4024365d33cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:00.688223 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341bdd64-db87-44c9-b135-4024365d33cd service glance] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:00.697854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1066/2153] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:24:10.595977 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=51,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:10.693396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:INSERT=2,keystone:SELECT=43 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:17.396517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b794de0-9f15-4983-bf1c-6ef6f3958043 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:17.397933 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2b794de0-9f15-4983-bf1c-6ef6f3958043 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:17.463783 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b794de0-9f15-4983-bf1c-6ef6f3958043 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:17.468975 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9181e8-65f4-4a06-adb4-c9dee66af4f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:17.469612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9181e8-65f4-4a06-adb4-c9dee66af4f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:17.469886 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9181e8-65f4-4a06-adb4-c9dee66af4f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:17.470156 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9181e8-65f4-4a06-adb4-c9dee66af4f0 admin admin] PATH_INFO: `/v3/users/fa4545613ae24960bb2d0d5e8bd2a2bd` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:17.471325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9181e8-65f4-4a06-adb4-c9dee66af4f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa4545613ae24960bb2d0d5e8bd2a2bd)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:17.473233 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9181e8-65f4-4a06-adb4-c9dee66af4f0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:17.518528 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ba9181e8-65f4-4a06-adb4-c9dee66af4f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa4545613ae24960bb2d0d5e8bd2a2bd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:17.530799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ba9181e8-65f4-4a06-adb4-c9dee66af4f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa4545613ae24960bb2d0d5e8bd2a2bd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:17.537421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ba9181e8-65f4-4a06-adb4-c9dee66af4f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa4545613ae24960bb2d0d5e8bd2a2bd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:17.538081 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ba9181e8-65f4-4a06-adb4-c9dee66af4f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa4545613ae24960bb2d0d5e8bd2a2bd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:17.545180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ba9181e8-65f4-4a06-adb4-c9dee66af4f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa4545613ae24960bb2d0d5e8bd2a2bd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:17.550951 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1088/2154] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:17 2022] DELETE /identity/v3/users/fa4545613ae24960bb2d0d5e8bd2a2bd => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:17.555602 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a31dfd-ba61-4bbe-b166-72340a3927f9 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:17.556125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a31dfd-ba61-4bbe-b166-72340a3927f9 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:17.556219 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a31dfd-ba61-4bbe-b166-72340a3927f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:17.575969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-95a31dfd-ba61-4bbe-b166-72340a3927f9 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:17.577153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-95a31dfd-ba61-4bbe-b166-72340a3927f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:17.637481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1067/2155] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:17.647908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9181e8-65f4-4a06-adb4-c9dee66af4f0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:17.649373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ba9181e8-65f4-4a06-adb4-c9dee66af4f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:17.716602 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9181e8-65f4-4a06-adb4-c9dee66af4f0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:17.720495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47caa8e-5e11-4bdf-8d8e-d8028d018121 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:17.721122 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47caa8e-5e11-4bdf-8d8e-d8028d018121 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:17.721399 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47caa8e-5e11-4bdf-8d8e-d8028d018121 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:17.721670 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47caa8e-5e11-4bdf-8d8e-d8028d018121 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:17.731496 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47caa8e-5e11-4bdf-8d8e-d8028d018121 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:17.732926 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47caa8e-5e11-4bdf-8d8e-d8028d018121 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:17.742425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1089/2156] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:18.113018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a31dfd-ba61-4bbe-b166-72340a3927f9 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:18.115251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-95a31dfd-ba61-4bbe-b166-72340a3927f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:18.137975 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a31dfd-ba61-4bbe-b166-72340a3927f9 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:18.145728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a5c28-64f9-411a-989b-4be4f9963641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:18.146846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a5c28-64f9-411a-989b-4be4f9963641 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:18.147185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a5c28-64f9-411a-989b-4be4f9963641 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:18.147720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705a5c28-64f9-411a-989b-4be4f9963641 admin admin] PATH_INFO: `/v3/projects/189a9370f8b94faabb7009c002c9f642` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:18.149498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a5c28-64f9-411a-989b-4be4f9963641 admin admin] RBAC: Authorizing `identity:delete_project(project_id=189a9370f8b94faabb7009c002c9f642)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:18.151774 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705a5c28-64f9-411a-989b-4be4f9963641 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:18.198791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-705a5c28-64f9-411a-989b-4be4f9963641 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '189a9370f8b94faabb7009c002c9f642', 'request_id': 'req-705a5c28-64f9-411a-989b-4be4f9963641'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:18.204999 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-705a5c28-64f9-411a-989b-4be4f9963641 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '189a9370f8b94faabb7009c002c9f642', 'request_id': 'req-705a5c28-64f9-411a-989b-4be4f9963641'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:18.212940 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-705a5c28-64f9-411a-989b-4be4f9963641 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '189a9370f8b94faabb7009c002c9f642', 'request_id': 'req-705a5c28-64f9-411a-989b-4be4f9963641'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:18.225237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-705a5c28-64f9-411a-989b-4be4f9963641 admin admin] The token cache is being invalidate because project 189a9370f8b94faabb7009c002c9f642 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:18.225520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-705a5c28-64f9-411a-989b-4be4f9963641 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:18.226168 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-705a5c28-64f9-411a-989b-4be4f9963641 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:18.227702 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1068/2157] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:18 2022] DELETE /identity/v3/projects/189a9370f8b94faabb7009c002c9f642 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:18.232220 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47caa8e-5e11-4bdf-8d8e-d8028d018121 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:18.242335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47caa8e-5e11-4bdf-8d8e-d8028d018121 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:18.260916 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:18.301206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93d7b84-befd-46ce-9bbd-495522966943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:18.301771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d7b84-befd-46ce-9bbd-495522966943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:18.302054 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d7b84-befd-46ce-9bbd-495522966943 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:18.302328 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93d7b84-befd-46ce-9bbd-495522966943 admin admin] PATH_INFO: `/v3/users/9c3693c8a9b044b9a55725e9d9661dcd` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:18.303532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d7b84-befd-46ce-9bbd-495522966943 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c3693c8a9b044b9a55725e9d9661dcd)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:18.305470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93d7b84-befd-46ce-9bbd-495522966943 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:18.361962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a93d7b84-befd-46ce-9bbd-495522966943 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c3693c8a9b044b9a55725e9d9661dcd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:18.374235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a93d7b84-befd-46ce-9bbd-495522966943 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c3693c8a9b044b9a55725e9d9661dcd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:18.381672 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a93d7b84-befd-46ce-9bbd-495522966943 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c3693c8a9b044b9a55725e9d9661dcd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:18.382404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a93d7b84-befd-46ce-9bbd-495522966943 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c3693c8a9b044b9a55725e9d9661dcd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:18.390798 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a93d7b84-befd-46ce-9bbd-495522966943 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c3693c8a9b044b9a55725e9d9661dcd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:18.398500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1090/2158] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:18 2022] DELETE /identity/v3/users/9c3693c8a9b044b9a55725e9d9661dcd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:18.679486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a5c28-64f9-411a-989b-4be4f9963641 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:18.681018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-705a5c28-64f9-411a-989b-4be4f9963641 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:18.699004 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705a5c28-64f9-411a-989b-4be4f9963641 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:18.759392 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c9ee6-3f3e-44c3-aff8-41df600eb66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:18.760037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c9ee6-3f3e-44c3-aff8-41df600eb66f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:18.760322 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c9ee6-3f3e-44c3-aff8-41df600eb66f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:18.760597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c9ee6-3f3e-44c3-aff8-41df600eb66f admin admin] PATH_INFO: `/v3/projects/a9eedf1f3954443f84e95188051806d0` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:18.761834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c9ee6-3f3e-44c3-aff8-41df600eb66f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9eedf1f3954443f84e95188051806d0)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:18.764335 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44c9ee6-3f3e-44c3-aff8-41df600eb66f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:18.796432 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:18.815054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c44c9ee6-3f3e-44c3-aff8-41df600eb66f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9eedf1f3954443f84e95188051806d0', 'request_id': 'req-c44c9ee6-3f3e-44c3-aff8-41df600eb66f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:18.821049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c44c9ee6-3f3e-44c3-aff8-41df600eb66f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9eedf1f3954443f84e95188051806d0', 'request_id': 'req-c44c9ee6-3f3e-44c3-aff8-41df600eb66f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:18.832788 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c44c9ee6-3f3e-44c3-aff8-41df600eb66f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9eedf1f3954443f84e95188051806d0', 'request_id': 'req-c44c9ee6-3f3e-44c3-aff8-41df600eb66f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:18.846108 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c44c9ee6-3f3e-44c3-aff8-41df600eb66f admin admin] The token cache is being invalidate because project a9eedf1f3954443f84e95188051806d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:18.846455 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c44c9ee6-3f3e-44c3-aff8-41df600eb66f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:18.847110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c44c9ee6-3f3e-44c3-aff8-41df600eb66f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:18.848614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1069/2159] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:18 2022] DELETE /identity/v3/projects/a9eedf1f3954443f84e95188051806d0 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:18.853453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a55b6-5a4a-46e1-89bc-22d06871b792 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:18.853738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a55b6-5a4a-46e1-89bc-22d06871b792 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:18.854011 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328a55b6-5a4a-46e1-89bc-22d06871b792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:18.873720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-328a55b6-5a4a-46e1-89bc-22d06871b792 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:18.874942 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-328a55b6-5a4a-46e1-89bc-22d06871b792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:18.935436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1091/2160] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:18.944305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6a286-9905-42dd-bd56-6dae3994e0a4 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:18.944588 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6a286-9905-42dd-bd56-6dae3994e0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:18.944860 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e6a286-9905-42dd-bd56-6dae3994e0a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:18.965261 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b2e6a286-9905-42dd-bd56-6dae3994e0a4 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:18.967112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b2e6a286-9905-42dd-bd56-6dae3994e0a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:18.974868 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1070/2161] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:18.979038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a55b6-5a4a-46e1-89bc-22d06871b792 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:18.989126 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328a55b6-5a4a-46e1-89bc-22d06871b792 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:18.993695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950279a-1fd6-4da7-bebf-bdb3f29baca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:18.994304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950279a-1fd6-4da7-bebf-bdb3f29baca9 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:18.994602 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950279a-1fd6-4da7-bebf-bdb3f29baca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:18.994888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e950279a-1fd6-4da7-bebf-bdb3f29baca9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:18.995565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950279a-1fd6-4da7-bebf-bdb3f29baca9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:24:18.995866 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950279a-1fd6-4da7-bebf-bdb3f29baca9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:18.997643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e950279a-1fd6-4da7-bebf-bdb3f29baca9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:19.012657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1092/2162] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:24:19.017713 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6a286-9905-42dd-bd56-6dae3994e0a4 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:19.027616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e6a286-9905-42dd-bd56-6dae3994e0a4 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:19.032797 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b59f68-1e69-4a8e-b8e2-8f5c250bea64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:19.033401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b59f68-1e69-4a8e-b8e2-8f5c250bea64 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:19.033678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b59f68-1e69-4a8e-b8e2-8f5c250bea64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:19.034080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b59f68-1e69-4a8e-b8e2-8f5c250bea64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:19.034768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b59f68-1e69-4a8e-b8e2-8f5c250bea64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:19.036680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b59f68-1e69-4a8e-b8e2-8f5c250bea64 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:19.065482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1071/2163] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:24:19 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:19.069652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950279a-1fd6-4da7-bebf-bdb3f29baca9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:19.081213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e950279a-1fd6-4da7-bebf-bdb3f29baca9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:19.108289 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:19.140301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f433b-d5a1-4bf0-ad7c-50532e1f2524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:19.140912 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f433b-d5a1-4bf0-ad7c-50532e1f2524 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:19.141190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f433b-d5a1-4bf0-ad7c-50532e1f2524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:19.141462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f433b-d5a1-4bf0-ad7c-50532e1f2524 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:19.142110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f433b-d5a1-4bf0-ad7c-50532e1f2524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:19.144131 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f433b-d5a1-4bf0-ad7c-50532e1f2524 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:19.171281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1093/2164] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:24:19 2022] POST /identity/v3/users => generated 283 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:19.172418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b59f68-1e69-4a8e-b8e2-8f5c250bea64 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:19.182704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b59f68-1e69-4a8e-b8e2-8f5c250bea64 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:19.187962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2e0f5-7c6b-4d5a-a2c5-8f186b2b8d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:19.188587 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2e0f5-7c6b-4d5a-a2c5-8f186b2b8d89 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:19.188851 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2e0f5-7c6b-4d5a-a2c5-8f186b2b8d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:19.189153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a2e0f5-7c6b-4d5a-a2c5-8f186b2b8d89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:19.189848 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2e0f5-7c6b-4d5a-a2c5-8f186b2b8d89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:19.191490 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a2e0f5-7c6b-4d5a-a2c5-8f186b2b8d89 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:19.202255 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1072/2165] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:24:19.206614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f433b-d5a1-4bf0-ad7c-50532e1f2524 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:19.217234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f433b-d5a1-4bf0-ad7c-50532e1f2524 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:19.222329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4ec3f-5935-4170-b359-bfec1e66e5f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:19.223055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ec3f-5935-4170-b359-bfec1e66e5f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:19.223405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ec3f-5935-4170-b359-bfec1e66e5f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:19.223678 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4ec3f-5935-4170-b359-bfec1e66e5f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:19.224369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4ec3f-5935-4170-b359-bfec1e66e5f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:19.225962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4ec3f-5935-4170-b359-bfec1e66e5f2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:19.240650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1094/2166] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:19.245172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2e0f5-7c6b-4d5a-a2c5-8f186b2b8d89 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:19.256868 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a2e0f5-7c6b-4d5a-a2c5-8f186b2b8d89 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:19.261682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a169537-c030-4a0d-8b48-afb983ed0bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:19.262349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a169537-c030-4a0d-8b48-afb983ed0bde admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:19.262656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a169537-c030-4a0d-8b48-afb983ed0bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:19.263616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a169537-c030-4a0d-8b48-afb983ed0bde admin admin] PATH_INFO: `/v3/projects/6aa273fd6ac440caa6f34bc4c7f96a7d/users/894658ee670b44e0b867d6d0f336a0a9/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:19.278634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a169537-c030-4a0d-8b48-afb983ed0bde admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa273fd6ac440caa6f34bc4c7f96a7d, user_id=894658ee670b44e0b867d6d0f336a0a9, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:19.281283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a169537-c030-4a0d-8b48-afb983ed0bde admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:19.294963 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1073/2167] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:19 2022] PUT /identity/v3/projects/6aa273fd6ac440caa6f34bc4c7f96a7d/users/894658ee670b44e0b867d6d0f336a0a9/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:19.306373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e88fde-08a0-4000-80d1-e2f4f9fa46ca None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:19.306695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e88fde-08a0-4000-80d1-e2f4f9fa46ca None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:19.306989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e88fde-08a0-4000-80d1-e2f4f9fa46ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:19.336913 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-38e88fde-08a0-4000-80d1-e2f4f9fa46ca None None] MFA Rules not processed for user `894658ee670b44e0b867d6d0f336a0a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:19.338132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-38e88fde-08a0-4000-80d1-e2f4f9fa46ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:19.408527 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1095/2168] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:19.413042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a169537-c030-4a0d-8b48-afb983ed0bde admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:19.492395 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a169537-c030-4a0d-8b48-afb983ed0bde admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:19.497203 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b19b9-6db4-4305-9d65-17db777adf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:19.497955 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b19b9-6db4-4305-9d65-17db777adf20 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:19.498298 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b19b9-6db4-4305-9d65-17db777adf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:19.498676 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09b19b9-6db4-4305-9d65-17db777adf20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:19.499573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b19b9-6db4-4305-9d65-17db777adf20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:19.502060 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09b19b9-6db4-4305-9d65-17db777adf20 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:19.534520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1074/2169] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:24:19 2022] POST /identity/v3/projects => generated 363 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:19.535873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e88fde-08a0-4000-80d1-e2f4f9fa46ca None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:19.547674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e88fde-08a0-4000-80d1-e2f4f9fa46ca None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:19.609592 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f78ecb-40a5-43e7-b630-0c5debf7e8fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:19.610228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f78ecb-40a5-43e7-b630-0c5debf7e8fc admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:19.610540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f78ecb-40a5-43e7-b630-0c5debf7e8fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:19.610838 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f78ecb-40a5-43e7-b630-0c5debf7e8fc admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:19.611498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f78ecb-40a5-43e7-b630-0c5debf7e8fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:19.613473 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f78ecb-40a5-43e7-b630-0c5debf7e8fc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:19.644781 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1096/2170] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:24:19 2022] POST /identity/v3/users => generated 288 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:19.649065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b19b9-6db4-4305-9d65-17db777adf20 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:19.660291 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09b19b9-6db4-4305-9d65-17db777adf20 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:19.664916 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21ed15-95d6-4bfb-9076-4e96a19328db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:19.665523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21ed15-95d6-4bfb-9076-4e96a19328db admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:19.665801 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21ed15-95d6-4bfb-9076-4e96a19328db admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:19.666074 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd21ed15-95d6-4bfb-9076-4e96a19328db admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:19.666802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21ed15-95d6-4bfb-9076-4e96a19328db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:19.668426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd21ed15-95d6-4bfb-9076-4e96a19328db admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:19.680526 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1075/2171] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:19.684677 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f78ecb-40a5-43e7-b630-0c5debf7e8fc admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:19.694907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f78ecb-40a5-43e7-b630-0c5debf7e8fc admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:19.702744 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32cc18-9e56-4ed2-ab43-6cde502a3a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:19.703965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32cc18-9e56-4ed2-ab43-6cde502a3a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:19.704707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32cc18-9e56-4ed2-ab43-6cde502a3a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:19.704831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d32cc18-9e56-4ed2-ab43-6cde502a3a0b admin admin] PATH_INFO: `/v3/projects/17a2fd40d50442b7a12155d8effe1ceb/users/259aea534d2b4fa29b191b203fccca96/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:19.734112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32cc18-9e56-4ed2-ab43-6cde502a3a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a2fd40d50442b7a12155d8effe1ceb, user_id=259aea534d2b4fa29b191b203fccca96, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:19.736950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d32cc18-9e56-4ed2-ab43-6cde502a3a0b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:19.749675 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1097/2172] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:19 2022] PUT /identity/v3/projects/17a2fd40d50442b7a12155d8effe1ceb/users/259aea534d2b4fa29b191b203fccca96/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:24:19.753607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21ed15-95d6-4bfb-9076-4e96a19328db admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:19.764149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd21ed15-95d6-4bfb-9076-4e96a19328db admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:19.784073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:19.823109 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d802f-52bb-418e-b27a-254e652176be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:19.823730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d802f-52bb-418e-b27a-254e652176be admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:19.824010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d802f-52bb-418e-b27a-254e652176be admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:19.824284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d802f-52bb-418e-b27a-254e652176be admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:19.824973 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d802f-52bb-418e-b27a-254e652176be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:19.827156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d802f-52bb-418e-b27a-254e652176be admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:19.837783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1076/2173] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:19 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:24:19.842600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32cc18-9e56-4ed2-ab43-6cde502a3a0b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:19.848086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:19.854863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d32cc18-9e56-4ed2-ab43-6cde502a3a0b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:19.860037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5db85-cf45-45a8-946b-0cede1c84abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:19.860778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5db85-cf45-45a8-946b-0cede1c84abc admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:19.861065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5db85-cf45-45a8-946b-0cede1c84abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:19.861342 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5db85-cf45-45a8-946b-0cede1c84abc admin admin] PATH_INFO: `/v3/projects/17a2fd40d50442b7a12155d8effe1ceb/users/259aea534d2b4fa29b191b203fccca96/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:19.863312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5db85-cf45-45a8-946b-0cede1c84abc admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a2fd40d50442b7a12155d8effe1ceb, user_id=259aea534d2b4fa29b191b203fccca96, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:19.865933 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5db85-cf45-45a8-946b-0cede1c84abc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:19.877131 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1098/2174] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:19 2022] PUT /identity/v3/projects/17a2fd40d50442b7a12155d8effe1ceb/users/259aea534d2b4fa29b191b203fccca96/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:19.887497 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a3514-d030-446a-9436-616d474699bd None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:19.887886 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a3514-d030-446a-9436-616d474699bd None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:19.888224 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-779a3514-d030-446a-9436-616d474699bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:19.917455 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-779a3514-d030-446a-9436-616d474699bd None None] MFA Rules not processed for user `259aea534d2b4fa29b191b203fccca96`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:19.918953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-779a3514-d030-446a-9436-616d474699bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:20.006672 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1077/2175] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:19 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:20.017856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5db85-cf45-45a8-946b-0cede1c84abc admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:20.019592 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f4a5db85-cf45-45a8-946b-0cede1c84abc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:20.079319 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5db85-cf45-45a8-946b-0cede1c84abc admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:20.082930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b62eea-68d0-4b94-9a7e-8d1d62b0c767 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:20.083566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b62eea-68d0-4b94-9a7e-8d1d62b0c767 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:20.084715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b62eea-68d0-4b94-9a7e-8d1d62b0c767 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:20.085046 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b62eea-68d0-4b94-9a7e-8d1d62b0c767 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:20.095966 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b62eea-68d0-4b94-9a7e-8d1d62b0c767 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:20.097462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b62eea-68d0-4b94-9a7e-8d1d62b0c767 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:20.109115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1099/2176] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:20 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:20.528523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a3514-d030-446a-9436-616d474699bd None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:20.593164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-779a3514-d030-446a-9436-616d474699bd None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:20.597767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc21ba7-5729-4784-9daf-ab3ede1b2103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:20.598404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc21ba7-5729-4784-9daf-ab3ede1b2103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:20.598721 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc21ba7-5729-4784-9daf-ab3ede1b2103 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:20.598997 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc21ba7-5729-4784-9daf-ab3ede1b2103 admin admin] PATH_INFO: `/v3/users/894658ee670b44e0b867d6d0f336a0a9` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:20.600141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc21ba7-5729-4784-9daf-ab3ede1b2103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=894658ee670b44e0b867d6d0f336a0a9)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:20.602186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc21ba7-5729-4784-9daf-ab3ede1b2103 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:20.648103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1dc21ba7-5729-4784-9daf-ab3ede1b2103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '894658ee670b44e0b867d6d0f336a0a9'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:20.649761 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:20.657235 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1dc21ba7-5729-4784-9daf-ab3ede1b2103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '894658ee670b44e0b867d6d0f336a0a9'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:20.669339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1dc21ba7-5729-4784-9daf-ab3ede1b2103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '894658ee670b44e0b867d6d0f336a0a9'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:20.669991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1dc21ba7-5729-4784-9daf-ab3ede1b2103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '894658ee670b44e0b867d6d0f336a0a9'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:20.676785 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1dc21ba7-5729-4784-9daf-ab3ede1b2103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '894658ee670b44e0b867d6d0f336a0a9'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:20.682625 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1078/2177] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:20 2022] DELETE /identity/v3/users/894658ee670b44e0b867d6d0f336a0a9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:20.687549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8fcaa-fa0e-418c-8e9b-2125bb069275 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:20.687968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8fcaa-fa0e-418c-8e9b-2125bb069275 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:20.688085 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa8fcaa-fa0e-418c-8e9b-2125bb069275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:20.708532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-afa8fcaa-fa0e-418c-8e9b-2125bb069275 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:20.710556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-afa8fcaa-fa0e-418c-8e9b-2125bb069275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:20.775952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1100/2178] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:20.785727 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc21ba7-5729-4784-9daf-ab3ede1b2103 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:20.790047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1dc21ba7-5729-4784-9daf-ab3ede1b2103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:20.849438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc21ba7-5729-4784-9daf-ab3ede1b2103 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:20.853212 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe42094-7123-4848-9ed0-5bbf18109a94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:20.853848 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe42094-7123-4848-9ed0-5bbf18109a94 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:20.854048 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe42094-7123-4848-9ed0-5bbf18109a94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:20.854319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe42094-7123-4848-9ed0-5bbf18109a94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:20.868482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe42094-7123-4848-9ed0-5bbf18109a94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:20.869941 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe42094-7123-4848-9ed0-5bbf18109a94 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:20.880892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1079/2179] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:21.165736 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8fcaa-fa0e-418c-8e9b-2125bb069275 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:21.167287 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-afa8fcaa-fa0e-418c-8e9b-2125bb069275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:21.179384 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa8fcaa-fa0e-418c-8e9b-2125bb069275 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:21.184074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773467af-5fe1-4480-a8e7-22d070fb0216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:21.184719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773467af-5fe1-4480-a8e7-22d070fb0216 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:21.184998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773467af-5fe1-4480-a8e7-22d070fb0216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:21.185623 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773467af-5fe1-4480-a8e7-22d070fb0216 admin admin] PATH_INFO: `/v3/projects/6aa273fd6ac440caa6f34bc4c7f96a7d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:21.186431 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773467af-5fe1-4480-a8e7-22d070fb0216 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa273fd6ac440caa6f34bc4c7f96a7d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:21.188366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773467af-5fe1-4480-a8e7-22d070fb0216 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:21.237539 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-773467af-5fe1-4480-a8e7-22d070fb0216 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa273fd6ac440caa6f34bc4c7f96a7d', 'request_id': 'req-773467af-5fe1-4480-a8e7-22d070fb0216'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.243733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-773467af-5fe1-4480-a8e7-22d070fb0216 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa273fd6ac440caa6f34bc4c7f96a7d', 'request_id': 'req-773467af-5fe1-4480-a8e7-22d070fb0216'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.249365 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-773467af-5fe1-4480-a8e7-22d070fb0216 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa273fd6ac440caa6f34bc4c7f96a7d', 'request_id': 'req-773467af-5fe1-4480-a8e7-22d070fb0216'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.261543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-773467af-5fe1-4480-a8e7-22d070fb0216 admin admin] The token cache is being invalidate because project 6aa273fd6ac440caa6f34bc4c7f96a7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:21.261841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-773467af-5fe1-4480-a8e7-22d070fb0216 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.262465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-773467af-5fe1-4480-a8e7-22d070fb0216 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.264536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1101/2180] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:21 2022] DELETE /identity/v3/projects/6aa273fd6ac440caa6f34bc4c7f96a7d => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:21.268577 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe42094-7123-4848-9ed0-5bbf18109a94 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:21.278188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe42094-7123-4848-9ed0-5bbf18109a94 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:21.333844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d036b5d-8b25-471f-9661-81820578452c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:21.334480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d036b5d-8b25-471f-9661-81820578452c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:21.334790 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d036b5d-8b25-471f-9661-81820578452c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:21.335067 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d036b5d-8b25-471f-9661-81820578452c admin admin] PATH_INFO: `/v3/users/259aea534d2b4fa29b191b203fccca96` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:21.336235 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d036b5d-8b25-471f-9661-81820578452c admin admin] RBAC: Authorizing `identity:delete_user(user_id=259aea534d2b4fa29b191b203fccca96)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:21.338156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d036b5d-8b25-471f-9661-81820578452c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:21.381468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0d036b5d-8b25-471f-9661-81820578452c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '259aea534d2b4fa29b191b203fccca96'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.388361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0d036b5d-8b25-471f-9661-81820578452c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '259aea534d2b4fa29b191b203fccca96'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.401787 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:INSERT=2,keystone:DELETE=13,keystone:SELECT=85 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:21.404143 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0d036b5d-8b25-471f-9661-81820578452c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '259aea534d2b4fa29b191b203fccca96'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.405437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0d036b5d-8b25-471f-9661-81820578452c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '259aea534d2b4fa29b191b203fccca96'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.415188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-0d036b5d-8b25-471f-9661-81820578452c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '259aea534d2b4fa29b191b203fccca96'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.421628 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1080/2181] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:21 2022] DELETE /identity/v3/users/259aea534d2b4fa29b191b203fccca96 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:21.693587 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773467af-5fe1-4480-a8e7-22d070fb0216 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:21.695127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-773467af-5fe1-4480-a8e7-22d070fb0216 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:21.708715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773467af-5fe1-4480-a8e7-22d070fb0216 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:21.731383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:21.781137 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1260f7b-8e22-46b7-8acf-089b53a2d3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:21.781785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1260f7b-8e22-46b7-8acf-089b53a2d3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:21.782057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1260f7b-8e22-46b7-8acf-089b53a2d3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:21.782323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1260f7b-8e22-46b7-8acf-089b53a2d3f4 admin admin] PATH_INFO: `/v3/projects/17a2fd40d50442b7a12155d8effe1ceb` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:21.783502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1260f7b-8e22-46b7-8acf-089b53a2d3f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a2fd40d50442b7a12155d8effe1ceb)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:21.785386 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1260f7b-8e22-46b7-8acf-089b53a2d3f4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:21.833334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d1260f7b-8e22-46b7-8acf-089b53a2d3f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a2fd40d50442b7a12155d8effe1ceb', 'request_id': 'req-d1260f7b-8e22-46b7-8acf-089b53a2d3f4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.839589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d1260f7b-8e22-46b7-8acf-089b53a2d3f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a2fd40d50442b7a12155d8effe1ceb', 'request_id': 'req-d1260f7b-8e22-46b7-8acf-089b53a2d3f4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.846198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d1260f7b-8e22-46b7-8acf-089b53a2d3f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a2fd40d50442b7a12155d8effe1ceb', 'request_id': 'req-d1260f7b-8e22-46b7-8acf-089b53a2d3f4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.858907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d1260f7b-8e22-46b7-8acf-089b53a2d3f4 admin admin] The token cache is being invalidate because project 17a2fd40d50442b7a12155d8effe1ceb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:21.859188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d1260f7b-8e22-46b7-8acf-089b53a2d3f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.859798 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d1260f7b-8e22-46b7-8acf-089b53a2d3f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:21.861283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1102/2182] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:21 2022] DELETE /identity/v3/projects/17a2fd40d50442b7a12155d8effe1ceb => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:21.866167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed0946-8ab4-4271-8c0b-f7baf8f19620 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:21.866663 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed0946-8ab4-4271-8c0b-f7baf8f19620 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:21.866826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbed0946-8ab4-4271-8c0b-f7baf8f19620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:21.885873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-dbed0946-8ab4-4271-8c0b-f7baf8f19620 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:21.887097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-dbed0946-8ab4-4271-8c0b-f7baf8f19620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:21.947481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1081/2183] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:21.956177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb31d70-e44e-4f2a-b534-b0af97edc5f8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:21.956464 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb31d70-e44e-4f2a-b534-b0af97edc5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:21.956738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb31d70-e44e-4f2a-b534-b0af97edc5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:21.976662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-aeb31d70-e44e-4f2a-b534-b0af97edc5f8 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:21.977891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-aeb31d70-e44e-4f2a-b534-b0af97edc5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:21.986236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1103/2184] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:21.990600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed0946-8ab4-4271-8c0b-f7baf8f19620 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:22.003190 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbed0946-8ab4-4271-8c0b-f7baf8f19620 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:22.007728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9dd32-68fc-4313-9b16-008fd40600fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:22.008342 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9dd32-68fc-4313-9b16-008fd40600fc admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:22.008629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9dd32-68fc-4313-9b16-008fd40600fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:22.008904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d9dd32-68fc-4313-9b16-008fd40600fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:22.009599 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9dd32-68fc-4313-9b16-008fd40600fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:24:22.009899 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9dd32-68fc-4313-9b16-008fd40600fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:22.011540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d9dd32-68fc-4313-9b16-008fd40600fc admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:22.025895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1082/2185] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:24:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:24:22.030096 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb31d70-e44e-4f2a-b534-b0af97edc5f8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:22.039544 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb31d70-e44e-4f2a-b534-b0af97edc5f8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:22.045034 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb9947-f44a-4169-a0e2-120582311668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:22.045883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb9947-f44a-4169-a0e2-120582311668 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:22.046165 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb9947-f44a-4169-a0e2-120582311668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:22.046443 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb9947-f44a-4169-a0e2-120582311668 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:22.047144 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb9947-f44a-4169-a0e2-120582311668 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:22.049066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb9947-f44a-4169-a0e2-120582311668 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:22.081037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1104/2186] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:24:22 2022] POST /identity/v3/projects => generated 381 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:22.085188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9dd32-68fc-4313-9b16-008fd40600fc admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:22.096086 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d9dd32-68fc-4313-9b16-008fd40600fc admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:22.157834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1557be-efe8-4e00-8afa-1fba98ef70b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:22.158454 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1557be-efe8-4e00-8afa-1fba98ef70b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:22.158768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1557be-efe8-4e00-8afa-1fba98ef70b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:22.159041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1557be-efe8-4e00-8afa-1fba98ef70b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:22.159693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1557be-efe8-4e00-8afa-1fba98ef70b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:22.161704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1557be-efe8-4e00-8afa-1fba98ef70b9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:22.184341 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1083/2187] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:24:22 2022] POST /identity/v3/users => generated 291 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:24:22.188566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb9947-f44a-4169-a0e2-120582311668 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:22.199244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb9947-f44a-4169-a0e2-120582311668 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:22.204478 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a70820-f65d-4b15-b75e-9bdf43ffc438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:22.205098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a70820-f65d-4b15-b75e-9bdf43ffc438 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:22.205400 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a70820-f65d-4b15-b75e-9bdf43ffc438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:22.205671 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a70820-f65d-4b15-b75e-9bdf43ffc438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:22.206356 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a70820-f65d-4b15-b75e-9bdf43ffc438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:22.208057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a70820-f65d-4b15-b75e-9bdf43ffc438 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:22.221701 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1105/2188] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:22.223119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1557be-efe8-4e00-8afa-1fba98ef70b9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:22.233815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1557be-efe8-4e00-8afa-1fba98ef70b9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:22.238500 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea57c5c-6d5b-4886-afcc-5ce4519df3c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:22.239123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57c5c-6d5b-4886-afcc-5ce4519df3c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:22.239400 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57c5c-6d5b-4886-afcc-5ce4519df3c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:22.239669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea57c5c-6d5b-4886-afcc-5ce4519df3c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:22.240354 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea57c5c-6d5b-4886-afcc-5ce4519df3c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:22.241949 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea57c5c-6d5b-4886-afcc-5ce4519df3c4 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:22.252888 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1084/2189] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:22.256914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a70820-f65d-4b15-b75e-9bdf43ffc438 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:22.266904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a70820-f65d-4b15-b75e-9bdf43ffc438 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:22.271539 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f4a49-13c4-48e5-be6c-e074dd39017f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:22.272190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f4a49-13c4-48e5-be6c-e074dd39017f admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:22.272471 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f4a49-13c4-48e5-be6c-e074dd39017f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:22.272748 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94f4a49-13c4-48e5-be6c-e074dd39017f admin admin] PATH_INFO: `/v3/projects/5a146d27a40141a89cf44eb592c36516/users/b14347a8650443688cc611da9e70a024/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:22.287776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f4a49-13c4-48e5-be6c-e074dd39017f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a146d27a40141a89cf44eb592c36516, user_id=b14347a8650443688cc611da9e70a024, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:22.290430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94f4a49-13c4-48e5-be6c-e074dd39017f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:22.303981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1106/2190] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:22 2022] PUT /identity/v3/projects/5a146d27a40141a89cf44eb592c36516/users/b14347a8650443688cc611da9e70a024/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:22.315579 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edba94-b70f-46df-9c83-c4cb8cb71033 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:22.315861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edba94-b70f-46df-9c83-c4cb8cb71033 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:22.316135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06edba94-b70f-46df-9c83-c4cb8cb71033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:22.343638 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-06edba94-b70f-46df-9c83-c4cb8cb71033 None None] MFA Rules not processed for user `b14347a8650443688cc611da9e70a024`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:22.344822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-06edba94-b70f-46df-9c83-c4cb8cb71033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:22.385090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:22.408518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1085/2191] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:22.420120 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f4a49-13c4-48e5-be6c-e074dd39017f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:22.421834 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b94f4a49-13c4-48e5-be6c-e074dd39017f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:22.468501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:22.490525 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94f4a49-13c4-48e5-be6c-e074dd39017f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:22.494505 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d7501d-f354-494f-b0ce-f0e12405b6d0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:22.495166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7501d-f354-494f-b0ce-f0e12405b6d0 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:22.495448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7501d-f354-494f-b0ce-f0e12405b6d0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:22.495728 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d7501d-f354-494f-b0ce-f0e12405b6d0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:22.505465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7501d-f354-494f-b0ce-f0e12405b6d0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:22.506933 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d7501d-f354-494f-b0ce-f0e12405b6d0 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:22.517694 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1107/2192] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:26.120202 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edba94-b70f-46df-9c83-c4cb8cb71033 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:26.181631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06edba94-b70f-46df-9c83-c4cb8cb71033 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:26.186046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316a754-acda-4423-ac6a-f316a4b60ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:26.186739 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316a754-acda-4423-ac6a-f316a4b60ec4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:26.187028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316a754-acda-4423-ac6a-f316a4b60ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:26.187301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316a754-acda-4423-ac6a-f316a4b60ec4 admin admin] PATH_INFO: `/v3/users/b14347a8650443688cc611da9e70a024` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:26.188443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316a754-acda-4423-ac6a-f316a4b60ec4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b14347a8650443688cc611da9e70a024)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:26.190385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316a754-acda-4423-ac6a-f316a4b60ec4 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:26.236813 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a316a754-acda-4423-ac6a-f316a4b60ec4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b14347a8650443688cc611da9e70a024'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:26.244046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a316a754-acda-4423-ac6a-f316a4b60ec4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b14347a8650443688cc611da9e70a024'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:26.256610 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a316a754-acda-4423-ac6a-f316a4b60ec4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b14347a8650443688cc611da9e70a024'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:26.258321 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a316a754-acda-4423-ac6a-f316a4b60ec4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b14347a8650443688cc611da9e70a024'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:26.265713 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a316a754-acda-4423-ac6a-f316a4b60ec4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b14347a8650443688cc611da9e70a024'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:26.271723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1086/2193] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:26 2022] DELETE /identity/v3/users/b14347a8650443688cc611da9e70a024 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:26.276178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670405a-9dea-41aa-a302-83084aaf3fe3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:26.276719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670405a-9dea-41aa-a302-83084aaf3fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:26.276824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4670405a-9dea-41aa-a302-83084aaf3fe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:26.296062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4670405a-9dea-41aa-a302-83084aaf3fe3 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:26.297355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4670405a-9dea-41aa-a302-83084aaf3fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:26.359887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1108/2194] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:26.372386 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316a754-acda-4423-ac6a-f316a4b60ec4 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:26.373839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a316a754-acda-4423-ac6a-f316a4b60ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:26.433627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316a754-acda-4423-ac6a-f316a4b60ec4 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:26.437605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6acd8f-b6e8-4598-8674-235710df935a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:26.438305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6acd8f-b6e8-4598-8674-235710df935a service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:26.438856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6acd8f-b6e8-4598-8674-235710df935a service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:26.439046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6acd8f-b6e8-4598-8674-235710df935a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:26.449894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6acd8f-b6e8-4598-8674-235710df935a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:26.451459 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6acd8f-b6e8-4598-8674-235710df935a service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:26.473137 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1087/2195] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:26.756273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670405a-9dea-41aa-a302-83084aaf3fe3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:26.758354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4670405a-9dea-41aa-a302-83084aaf3fe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:26.782888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4670405a-9dea-41aa-a302-83084aaf3fe3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:26.790332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a1ad3-a7e1-41ee-9330-9ce78c21bbe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:26.792529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a1ad3-a7e1-41ee-9330-9ce78c21bbe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:26.793272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a1ad3-a7e1-41ee-9330-9ce78c21bbe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:26.794202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a1ad3-a7e1-41ee-9330-9ce78c21bbe7 admin admin] PATH_INFO: `/v3/projects/5a146d27a40141a89cf44eb592c36516` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:26.796034 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a1ad3-a7e1-41ee-9330-9ce78c21bbe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a146d27a40141a89cf44eb592c36516)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:26.799870 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a1ad3-a7e1-41ee-9330-9ce78c21bbe7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:26.869331 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f74a1ad3-a7e1-41ee-9330-9ce78c21bbe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a146d27a40141a89cf44eb592c36516', 'request_id': 'req-f74a1ad3-a7e1-41ee-9330-9ce78c21bbe7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:26.880775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f74a1ad3-a7e1-41ee-9330-9ce78c21bbe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a146d27a40141a89cf44eb592c36516', 'request_id': 'req-f74a1ad3-a7e1-41ee-9330-9ce78c21bbe7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:26.888617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f74a1ad3-a7e1-41ee-9330-9ce78c21bbe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a146d27a40141a89cf44eb592c36516', 'request_id': 'req-f74a1ad3-a7e1-41ee-9330-9ce78c21bbe7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:26.910244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f74a1ad3-a7e1-41ee-9330-9ce78c21bbe7 admin admin] The token cache is being invalidate because project 5a146d27a40141a89cf44eb592c36516 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:26.910747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f74a1ad3-a7e1-41ee-9330-9ce78c21bbe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:26.912493 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f74a1ad3-a7e1-41ee-9330-9ce78c21bbe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:26.914754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1109/2196] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:26 2022] DELETE /identity/v3/projects/5a146d27a40141a89cf44eb592c36516 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:26.919697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27609a7a-9e7e-4df9-b09e-cc25484fb47a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:26.919985 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27609a7a-9e7e-4df9-b09e-cc25484fb47a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:26.920583 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27609a7a-9e7e-4df9-b09e-cc25484fb47a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:26.931077 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:26.944875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-27609a7a-9e7e-4df9-b09e-cc25484fb47a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:26.946097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-27609a7a-9e7e-4df9-b09e-cc25484fb47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:27.010542 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1088/2197] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:27.018457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c8713-ea28-414e-b558-bc89ce17d581 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:27.019534 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c8713-ea28-414e-b558-bc89ce17d581 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:27.019534 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170c8713-ea28-414e-b558-bc89ce17d581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:27.042081 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-170c8713-ea28-414e-b558-bc89ce17d581 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:27.043358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-170c8713-ea28-414e-b558-bc89ce17d581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:27.053086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1110/2198] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:27.057572 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27609a7a-9e7e-4df9-b09e-cc25484fb47a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:27.068939 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27609a7a-9e7e-4df9-b09e-cc25484fb47a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:27.073894 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0a2c1-7fc4-4422-aacc-4d7104baac0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:27.074496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0a2c1-7fc4-4422-aacc-4d7104baac0f admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:27.074810 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0a2c1-7fc4-4422-aacc-4d7104baac0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:27.075084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd0a2c1-7fc4-4422-aacc-4d7104baac0f admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:27.076152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0a2c1-7fc4-4422-aacc-4d7104baac0f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:24:27.076152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0a2c1-7fc4-4422-aacc-4d7104baac0f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:27.077713 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd0a2c1-7fc4-4422-aacc-4d7104baac0f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:27.090236 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1089/2199] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:24:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:24:27.094503 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c8713-ea28-414e-b558-bc89ce17d581 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:27.103995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170c8713-ea28-414e-b558-bc89ce17d581 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:27.109266 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d826a4-4c38-47a6-a934-b7d95ea1c41b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:27.109874 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d826a4-4c38-47a6-a934-b7d95ea1c41b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:27.110152 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d826a4-4c38-47a6-a934-b7d95ea1c41b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:27.110427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d826a4-4c38-47a6-a934-b7d95ea1c41b admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:27.111161 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d826a4-4c38-47a6-a934-b7d95ea1c41b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:27.113056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d826a4-4c38-47a6-a934-b7d95ea1c41b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:27.142657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1111/2200] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:24:27 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:27.145963 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0a2c1-7fc4-4422-aacc-4d7104baac0f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:27.164633 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd0a2c1-7fc4-4422-aacc-4d7104baac0f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:27.229257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200803d2-b4d5-408b-b03b-b330ec7bf528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:27.229896 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200803d2-b4d5-408b-b03b-b330ec7bf528 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:27.230177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200803d2-b4d5-408b-b03b-b330ec7bf528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:27.230449 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200803d2-b4d5-408b-b03b-b330ec7bf528 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:27.231162 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200803d2-b4d5-408b-b03b-b330ec7bf528 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:27.233116 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200803d2-b4d5-408b-b03b-b330ec7bf528 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:27.256319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1090/2201] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:24:27 2022] POST /identity/v3/users => generated 286 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:27.261209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d826a4-4c38-47a6-a934-b7d95ea1c41b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:27.271552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d826a4-4c38-47a6-a934-b7d95ea1c41b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:27.276335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b803b04-984a-47a5-8308-533293a9a1ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:27.277014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b803b04-984a-47a5-8308-533293a9a1ba admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:27.277362 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b803b04-984a-47a5-8308-533293a9a1ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:27.277800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b803b04-984a-47a5-8308-533293a9a1ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:27.278516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b803b04-984a-47a5-8308-533293a9a1ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:27.280694 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b803b04-984a-47a5-8308-533293a9a1ba admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:27.293469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1112/2202] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:27.297523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200803d2-b4d5-408b-b03b-b330ec7bf528 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:27.308614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200803d2-b4d5-408b-b03b-b330ec7bf528 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:27.314199 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa04fb8-8eb4-4ad8-8cc3-cda51f0bab43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:27.314911 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa04fb8-8eb4-4ad8-8cc3-cda51f0bab43 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:27.315205 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa04fb8-8eb4-4ad8-8cc3-cda51f0bab43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:27.315673 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa04fb8-8eb4-4ad8-8cc3-cda51f0bab43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:27.316187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa04fb8-8eb4-4ad8-8cc3-cda51f0bab43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:27.318014 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa04fb8-8eb4-4ad8-8cc3-cda51f0bab43 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:27.329749 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1091/2203] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:27.334103 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b803b04-984a-47a5-8308-533293a9a1ba admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:27.349446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b803b04-984a-47a5-8308-533293a9a1ba admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:27.354125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e95132-e8e0-4e26-a867-623e271e1b75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:27.354822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e95132-e8e0-4e26-a867-623e271e1b75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:27.355102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e95132-e8e0-4e26-a867-623e271e1b75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:27.355374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e95132-e8e0-4e26-a867-623e271e1b75 admin admin] PATH_INFO: `/v3/projects/b8a9930d08704b24b55650221fceb492/users/c98eee32d2334ed5a54180320b1da881/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:27.370176 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e95132-e8e0-4e26-a867-623e271e1b75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8a9930d08704b24b55650221fceb492, user_id=c98eee32d2334ed5a54180320b1da881, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:27.373000 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e95132-e8e0-4e26-a867-623e271e1b75 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:27.387116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1113/2204] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:27 2022] PUT /identity/v3/projects/b8a9930d08704b24b55650221fceb492/users/c98eee32d2334ed5a54180320b1da881/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:24:27.398099 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa2e3a-4873-4cd5-b95e-9252af4b0cc5 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:27.398389 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa2e3a-4873-4cd5-b95e-9252af4b0cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:27.398708 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77aa2e3a-4873-4cd5-b95e-9252af4b0cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:27.427821 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-77aa2e3a-4873-4cd5-b95e-9252af4b0cc5 None None] MFA Rules not processed for user `c98eee32d2334ed5a54180320b1da881`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:27.429053 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-77aa2e3a-4873-4cd5-b95e-9252af4b0cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:27.493323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:27.497948 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1092/2205] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:27.509539 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e95132-e8e0-4e26-a867-623e271e1b75 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:27.511327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-04e95132-e8e0-4e26-a867-623e271e1b75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:27.517788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:27.572784 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e95132-e8e0-4e26-a867-623e271e1b75 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:27.576552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934d5571-9437-4923-be46-bf6efc15caf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:27.577166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d5571-9437-4923-be46-bf6efc15caf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:27.577479 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d5571-9437-4923-be46-bf6efc15caf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:27.577807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934d5571-9437-4923-be46-bf6efc15caf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:27.586612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d5571-9437-4923-be46-bf6efc15caf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:27.588218 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934d5571-9437-4923-be46-bf6efc15caf3 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:27.597876 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1114/2206] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:27.622963 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa2e3a-4873-4cd5-b95e-9252af4b0cc5 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:27.686787 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77aa2e3a-4873-4cd5-b95e-9252af4b0cc5 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:27.691422 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870a095-420f-41af-bd81-9292f227efc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:27.692068 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870a095-420f-41af-bd81-9292f227efc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:27.692347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870a095-420f-41af-bd81-9292f227efc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:27.692621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870a095-420f-41af-bd81-9292f227efc3 admin admin] PATH_INFO: `/v3/users/c98eee32d2334ed5a54180320b1da881` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:27.693794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870a095-420f-41af-bd81-9292f227efc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c98eee32d2334ed5a54180320b1da881)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:27.695770 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870a095-420f-41af-bd81-9292f227efc3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:27.747709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4870a095-420f-41af-bd81-9292f227efc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c98eee32d2334ed5a54180320b1da881'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:27.757372 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4870a095-420f-41af-bd81-9292f227efc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c98eee32d2334ed5a54180320b1da881'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:27.772691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4870a095-420f-41af-bd81-9292f227efc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c98eee32d2334ed5a54180320b1da881'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:27.773811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4870a095-420f-41af-bd81-9292f227efc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c98eee32d2334ed5a54180320b1da881'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:27.781449 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4870a095-420f-41af-bd81-9292f227efc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c98eee32d2334ed5a54180320b1da881'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:27.788091 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1093/2207] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:27 2022] DELETE /identity/v3/users/c98eee32d2334ed5a54180320b1da881 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:27.792529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48656945-e1c5-4c0b-8328-01f3f89424c7 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:27.792823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48656945-e1c5-4c0b-8328-01f3f89424c7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:27.793106 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48656945-e1c5-4c0b-8328-01f3f89424c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:27.813182 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-48656945-e1c5-4c0b-8328-01f3f89424c7 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:27.814460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-48656945-e1c5-4c0b-8328-01f3f89424c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:27.893799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1115/2208] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:27.908139 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870a095-420f-41af-bd81-9292f227efc3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:27.909639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4870a095-420f-41af-bd81-9292f227efc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:27.984006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870a095-420f-41af-bd81-9292f227efc3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:27.990125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c08b8-fe99-4ad2-ac42-0964855d77ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:27.990785 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c08b8-fe99-4ad2-ac42-0964855d77ac service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:27.991097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c08b8-fe99-4ad2-ac42-0964855d77ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:27.991365 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122c08b8-fe99-4ad2-ac42-0964855d77ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:28.007298 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c08b8-fe99-4ad2-ac42-0964855d77ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:28.009027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122c08b8-fe99-4ad2-ac42-0964855d77ac service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:28.023952 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1094/2209] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:28.144264 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b0dfe-0792-4935-bae6-c4a11319c2a0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:28.144753 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b0dfe-0792-4935-bae6-c4a11319c2a0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:28.144955 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214b0dfe-0792-4935-bae6-c4a11319c2a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:28.165025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-214b0dfe-0792-4935-bae6-c4a11319c2a0 None None] MFA Rules not processed for user `666b3c9d23604bf0aefc4f09374f92c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:28.166325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-214b0dfe-0792-4935-bae6-c4a11319c2a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:28.245805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1116/2210] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:28.319254 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c08b8-fe99-4ad2-ac42-0964855d77ac service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:28.320772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-122c08b8-fe99-4ad2-ac42-0964855d77ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:28.334745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122c08b8-fe99-4ad2-ac42-0964855d77ac service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:28.340285 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56ea75-1b40-482a-b9ea-7293b707d8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:28.341521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56ea75-1b40-482a-b9ea-7293b707d8b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:28.341958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56ea75-1b40-482a-b9ea-7293b707d8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:28.342174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56ea75-1b40-482a-b9ea-7293b707d8b0 admin admin] PATH_INFO: `/v3/projects/b8a9930d08704b24b55650221fceb492` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:28.344213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56ea75-1b40-482a-b9ea-7293b707d8b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8a9930d08704b24b55650221fceb492)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:28.356090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56ea75-1b40-482a-b9ea-7293b707d8b0 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:28.374674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:28.408771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bc56ea75-1b40-482a-b9ea-7293b707d8b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8a9930d08704b24b55650221fceb492', 'request_id': 'req-bc56ea75-1b40-482a-b9ea-7293b707d8b0'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:28.423094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bc56ea75-1b40-482a-b9ea-7293b707d8b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8a9930d08704b24b55650221fceb492', 'request_id': 'req-bc56ea75-1b40-482a-b9ea-7293b707d8b0'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:28.430520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bc56ea75-1b40-482a-b9ea-7293b707d8b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8a9930d08704b24b55650221fceb492', 'request_id': 'req-bc56ea75-1b40-482a-b9ea-7293b707d8b0'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:28.442700 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bc56ea75-1b40-482a-b9ea-7293b707d8b0 admin admin] The token cache is being invalidate because project b8a9930d08704b24b55650221fceb492 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:28.442989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bc56ea75-1b40-482a-b9ea-7293b707d8b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:28.443759 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-bc56ea75-1b40-482a-b9ea-7293b707d8b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:28.445273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1095/2211] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:28 2022] DELETE /identity/v3/projects/b8a9930d08704b24b55650221fceb492 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:28.450241 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b9bd5-d1b3-4a1c-8858-36d14a1eefa8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:28.450738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b9bd5-d1b3-4a1c-8858-36d14a1eefa8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:28.451732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878b9bd5-d1b3-4a1c-8858-36d14a1eefa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:28.474806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-878b9bd5-d1b3-4a1c-8858-36d14a1eefa8 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:28.476028 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-878b9bd5-d1b3-4a1c-8858-36d14a1eefa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:28.523582 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:28.537154 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1117/2212] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:28.545692 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fe651-b2bc-42b8-b2a7-a625151d4acb None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:28.546627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fe651-b2bc-42b8-b2a7-a625151d4acb None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:28.546914 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5fe651-b2bc-42b8-b2a7-a625151d4acb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:28.568144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-ff5fe651-b2bc-42b8-b2a7-a625151d4acb None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:28.574706 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ff5fe651-b2bc-42b8-b2a7-a625151d4acb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:28.583817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1096/2213] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:28.587871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b9bd5-d1b3-4a1c-8858-36d14a1eefa8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:28.598178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878b9bd5-d1b3-4a1c-8858-36d14a1eefa8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:28.602892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5de1dd-bd02-4edc-88b9-5cae29e7faff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:28.603503 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5de1dd-bd02-4edc-88b9-5cae29e7faff admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:28.603785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5de1dd-bd02-4edc-88b9-5cae29e7faff admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:28.604059 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5de1dd-bd02-4edc-88b9-5cae29e7faff admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:28.604758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5de1dd-bd02-4edc-88b9-5cae29e7faff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:24:28.605065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5de1dd-bd02-4edc-88b9-5cae29e7faff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:28.606704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5de1dd-bd02-4edc-88b9-5cae29e7faff admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:28.619266 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1118/2214] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:24:28.624085 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fe651-b2bc-42b8-b2a7-a625151d4acb None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:28.634009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5fe651-b2bc-42b8-b2a7-a625151d4acb None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:28.638725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2c757-9191-4b64-b15e-d3eb5e72a8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:28.639324 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2c757-9191-4b64-b15e-d3eb5e72a8b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:28.639603 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2c757-9191-4b64-b15e-d3eb5e72a8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:28.639902 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab2c757-9191-4b64-b15e-d3eb5e72a8b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:28.640548 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2c757-9191-4b64-b15e-d3eb5e72a8b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:28.642454 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab2c757-9191-4b64-b15e-d3eb5e72a8b3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:28.671890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1097/2215] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:24:28 2022] POST /identity/v3/projects => generated 391 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:28.676248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5de1dd-bd02-4edc-88b9-5cae29e7faff admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:28.686100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5de1dd-bd02-4edc-88b9-5cae29e7faff admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:28.745009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c606b-27fd-4478-b396-026b5b6b1d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:28.745630 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c606b-27fd-4478-b396-026b5b6b1d2c admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:28.745913 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c606b-27fd-4478-b396-026b5b6b1d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:28.746183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2c606b-27fd-4478-b396-026b5b6b1d2c admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:28.746893 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c606b-27fd-4478-b396-026b5b6b1d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:28.748832 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2c606b-27fd-4478-b396-026b5b6b1d2c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:28.770857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1119/2216] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:24:28 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:28.774754 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2c757-9191-4b64-b15e-d3eb5e72a8b3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:28.785403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab2c757-9191-4b64-b15e-d3eb5e72a8b3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:28.790153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1728b8-46a9-4e62-87c4-901bb29e6a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:28.790822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1728b8-46a9-4e62-87c4-901bb29e6a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:28.791108 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1728b8-46a9-4e62-87c4-901bb29e6a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:28.791386 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1728b8-46a9-4e62-87c4-901bb29e6a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:28.792123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1728b8-46a9-4e62-87c4-901bb29e6a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:28.793797 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1728b8-46a9-4e62-87c4-901bb29e6a75 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:28.804077 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1098/2217] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:28.808335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c606b-27fd-4478-b396-026b5b6b1d2c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:28.818856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2c606b-27fd-4478-b396-026b5b6b1d2c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:28.823727 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b637678-c69d-4bbb-a640-a9fa5e3dc785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:28.824325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b637678-c69d-4bbb-a640-a9fa5e3dc785 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:28.824606 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b637678-c69d-4bbb-a640-a9fa5e3dc785 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:28.824878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b637678-c69d-4bbb-a640-a9fa5e3dc785 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:28.825566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b637678-c69d-4bbb-a640-a9fa5e3dc785 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:28.827427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b637678-c69d-4bbb-a640-a9fa5e3dc785 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:28.838511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1120/2218] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:28.843515 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1728b8-46a9-4e62-87c4-901bb29e6a75 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:28.854182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1728b8-46a9-4e62-87c4-901bb29e6a75 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:28.859092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a183d-792a-449f-8d8f-3a0fa9f730cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:28.859813 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a183d-792a-449f-8d8f-3a0fa9f730cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:28.860206 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a183d-792a-449f-8d8f-3a0fa9f730cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:28.860624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a183d-792a-449f-8d8f-3a0fa9f730cd admin admin] PATH_INFO: `/v3/projects/217bcbb7c0504e4091e713fe4573cb0f/users/a44dcf71f1124d31ad16f91396eb5e77/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:28.876630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a183d-792a-449f-8d8f-3a0fa9f730cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=217bcbb7c0504e4091e713fe4573cb0f, user_id=a44dcf71f1124d31ad16f91396eb5e77, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:28.879350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a183d-792a-449f-8d8f-3a0fa9f730cd admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:28.894292 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1099/2219] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:28 2022] PUT /identity/v3/projects/217bcbb7c0504e4091e713fe4573cb0f/users/a44dcf71f1124d31ad16f91396eb5e77/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:28.904015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879204ff-b5b5-4da1-b581-058afa0084ea None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:28.904304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879204ff-b5b5-4da1-b581-058afa0084ea None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:28.904580 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879204ff-b5b5-4da1-b581-058afa0084ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:28.942736 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-879204ff-b5b5-4da1-b581-058afa0084ea None None] MFA Rules not processed for user `a44dcf71f1124d31ad16f91396eb5e77`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:28.944243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-879204ff-b5b5-4da1-b581-058afa0084ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:29.017064 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1121/2220] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:29.028087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a183d-792a-449f-8d8f-3a0fa9f730cd admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:29.029802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-185a183d-792a-449f-8d8f-3a0fa9f730cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:29.088780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a183d-792a-449f-8d8f-3a0fa9f730cd admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:29.092512 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93771d22-aad6-4e24-ace4-36a975446ff9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:29.093732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93771d22-aad6-4e24-ace4-36a975446ff9 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:29.094027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93771d22-aad6-4e24-ace4-36a975446ff9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:29.094363 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93771d22-aad6-4e24-ace4-36a975446ff9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:29.103324 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93771d22-aad6-4e24-ace4-36a975446ff9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:29.104768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93771d22-aad6-4e24-ace4-36a975446ff9 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:29.114417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1100/2221] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:29 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:31.430432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879204ff-b5b5-4da1-b581-058afa0084ea None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:31.431977 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-879204ff-b5b5-4da1-b581-058afa0084ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:31.481585 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:31.500021 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879204ff-b5b5-4da1-b581-058afa0084ea None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:31.504982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa1ce7-1c72-46e0-b22f-d877a00dc5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:31.505569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1ce7-1c72-46e0-b22f-d877a00dc5a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:31.505907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1ce7-1c72-46e0-b22f-d877a00dc5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:31.506138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fa1ce7-1c72-46e0-b22f-d877a00dc5a7 admin admin] PATH_INFO: `/v3/users/8daf9af7c68448dc93fdbf5acf5e4a35` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:31.507438 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa1ce7-1c72-46e0-b22f-d877a00dc5a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8daf9af7c68448dc93fdbf5acf5e4a35)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:31.509445 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fa1ce7-1c72-46e0-b22f-d877a00dc5a7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:31.568070 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d6fa1ce7-1c72-46e0-b22f-d877a00dc5a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8daf9af7c68448dc93fdbf5acf5e4a35'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:31.584632 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d6fa1ce7-1c72-46e0-b22f-d877a00dc5a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8daf9af7c68448dc93fdbf5acf5e4a35'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:31.592518 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d6fa1ce7-1c72-46e0-b22f-d877a00dc5a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8daf9af7c68448dc93fdbf5acf5e4a35'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:31.593305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d6fa1ce7-1c72-46e0-b22f-d877a00dc5a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8daf9af7c68448dc93fdbf5acf5e4a35'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:31.601938 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d6fa1ce7-1c72-46e0-b22f-d877a00dc5a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8daf9af7c68448dc93fdbf5acf5e4a35'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:31.609463 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1122/2222] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:31 2022] DELETE /identity/v3/users/8daf9af7c68448dc93fdbf5acf5e4a35 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:24:31.614151 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cacc19-9d23-474c-970f-89f602f1e17a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:31.614684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cacc19-9d23-474c-970f-89f602f1e17a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:31.614853 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cacc19-9d23-474c-970f-89f602f1e17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:31.635350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e6cacc19-9d23-474c-970f-89f602f1e17a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:31.636584 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e6cacc19-9d23-474c-970f-89f602f1e17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:31.680388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:31.702714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1101/2223] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:31.713498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa1ce7-1c72-46e0-b22f-d877a00dc5a7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:31.715134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d6fa1ce7-1c72-46e0-b22f-d877a00dc5a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:31.785282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fa1ce7-1c72-46e0-b22f-d877a00dc5a7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:31.789895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0102279-9ff9-49ea-a91c-8ba47e00068d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:31.790514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0102279-9ff9-49ea-a91c-8ba47e00068d service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:31.791077 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0102279-9ff9-49ea-a91c-8ba47e00068d service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:31.791357 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0102279-9ff9-49ea-a91c-8ba47e00068d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:31.804377 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0102279-9ff9-49ea-a91c-8ba47e00068d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:31.806752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0102279-9ff9-49ea-a91c-8ba47e00068d service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:31.822197 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1123/2224] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:24:32.121878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cacc19-9d23-474c-970f-89f602f1e17a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:32.123324 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e6cacc19-9d23-474c-970f-89f602f1e17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:32.140646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cacc19-9d23-474c-970f-89f602f1e17a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:32.145673 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178d0c82-2e45-4619-a398-8aa125a89e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:32.146321 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d0c82-2e45-4619-a398-8aa125a89e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:32.146619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d0c82-2e45-4619-a398-8aa125a89e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:32.146897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178d0c82-2e45-4619-a398-8aa125a89e58 admin admin] PATH_INFO: `/v3/projects/7702504382904b2b963d338b88818c57` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:32.148178 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d0c82-2e45-4619-a398-8aa125a89e58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7702504382904b2b963d338b88818c57)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:32.150176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178d0c82-2e45-4619-a398-8aa125a89e58 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:32.168894 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0102279-9ff9-49ea-a91c-8ba47e00068d service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:32.170109 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c0102279-9ff9-49ea-a91c-8ba47e00068d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:32.183817 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0102279-9ff9-49ea-a91c-8ba47e00068d service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:32.189424 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1899d38d-a860-4458-a402-8ad099c4d23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:32.190067 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899d38d-a860-4458-a402-8ad099c4d23c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:32.190406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899d38d-a860-4458-a402-8ad099c4d23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:32.190719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1899d38d-a860-4458-a402-8ad099c4d23c admin admin] PATH_INFO: `/v3/users/33e3a5e58607406a93c5afa430cc2c72` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:32.191928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899d38d-a860-4458-a402-8ad099c4d23c admin admin] RBAC: Authorizing `identity:delete_user(user_id=33e3a5e58607406a93c5afa430cc2c72)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:32.193852 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1899d38d-a860-4458-a402-8ad099c4d23c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:32.208511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-178d0c82-2e45-4619-a398-8aa125a89e58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7702504382904b2b963d338b88818c57', 'request_id': 'req-178d0c82-2e45-4619-a398-8aa125a89e58'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:32.214422 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-178d0c82-2e45-4619-a398-8aa125a89e58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7702504382904b2b963d338b88818c57', 'request_id': 'req-178d0c82-2e45-4619-a398-8aa125a89e58'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:32.222288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-178d0c82-2e45-4619-a398-8aa125a89e58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7702504382904b2b963d338b88818c57', 'request_id': 'req-178d0c82-2e45-4619-a398-8aa125a89e58'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:32.235430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-178d0c82-2e45-4619-a398-8aa125a89e58 admin admin] The token cache is being invalidate because project 7702504382904b2b963d338b88818c57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:32.235722 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-178d0c82-2e45-4619-a398-8aa125a89e58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:32.236401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-178d0c82-2e45-4619-a398-8aa125a89e58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:32.238158 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1102/2225] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:32 2022] DELETE /identity/v3/projects/7702504382904b2b963d338b88818c57 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:32.243018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae203d-f6d0-4bc3-a094-399a3895e312 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:32.243349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae203d-f6d0-4bc3-a094-399a3895e312 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:32.243846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eae203d-f6d0-4bc3-a094-399a3895e312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:32.251666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1899d38d-a860-4458-a402-8ad099c4d23c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33e3a5e58607406a93c5afa430cc2c72'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:32.264157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1899d38d-a860-4458-a402-8ad099c4d23c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33e3a5e58607406a93c5afa430cc2c72'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:32.265083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0eae203d-f6d0-4bc3-a094-399a3895e312 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:32.265507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:32.266725 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0eae203d-f6d0-4bc3-a094-399a3895e312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:32.274975 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1899d38d-a860-4458-a402-8ad099c4d23c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33e3a5e58607406a93c5afa430cc2c72'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:32.275683 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1899d38d-a860-4458-a402-8ad099c4d23c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33e3a5e58607406a93c5afa430cc2c72'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:32.284088 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1899d38d-a860-4458-a402-8ad099c4d23c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33e3a5e58607406a93c5afa430cc2c72'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:32.290733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1124/2226] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:32 2022] DELETE /identity/v3/users/33e3a5e58607406a93c5afa430cc2c72 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:24:32.296985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d848f-f076-4aac-906d-587b63cb9ef8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:32.297276 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d848f-f076-4aac-906d-587b63cb9ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:32.297550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650d848f-f076-4aac-906d-587b63cb9ef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:32.317732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-650d848f-f076-4aac-906d-587b63cb9ef8 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:32.318928 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-650d848f-f076-4aac-906d-587b63cb9ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:32.341815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1103/2227] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:32.343692 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4760f-2214-4fac-ac1e-7e0c857ecb67 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:32.344076 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4760f-2214-4fac-ac1e-7e0c857ecb67 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:32.344493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b4760f-2214-4fac-ac1e-7e0c857ecb67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:32.367031 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-c7b4760f-2214-4fac-ac1e-7e0c857ecb67 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:32.368676 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c7b4760f-2214-4fac-ac1e-7e0c857ecb67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:32.392884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1125/2228] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:32.402824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d848f-f076-4aac-906d-587b63cb9ef8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:32.404724 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-650d848f-f076-4aac-906d-587b63cb9ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:32.447704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1104/2229] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:32.452421 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4760f-2214-4fac-ac1e-7e0c857ecb67 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:32.462867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b4760f-2214-4fac-ac1e-7e0c857ecb67 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:32.467791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca89fb9-0e5a-4020-8ddf-2281d310a632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:32.468418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca89fb9-0e5a-4020-8ddf-2281d310a632 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:32.468731 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca89fb9-0e5a-4020-8ddf-2281d310a632 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:32.468994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca89fb9-0e5a-4020-8ddf-2281d310a632 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:32.469898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca89fb9-0e5a-4020-8ddf-2281d310a632 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:24:32.470020 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca89fb9-0e5a-4020-8ddf-2281d310a632 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:32.471648 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca89fb9-0e5a-4020-8ddf-2281d310a632 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:32.474298 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:32.485104 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1105/2230] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:24:32.488113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650d848f-f076-4aac-906d-587b63cb9ef8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:32.490641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca89fb9-0e5a-4020-8ddf-2281d310a632 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:32.492496 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aab69-0880-49cf-996a-5a9d1cae69c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:32.493118 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aab69-0880-49cf-996a-5a9d1cae69c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:32.493449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aab69-0880-49cf-996a-5a9d1cae69c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:32.493728 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096aab69-0880-49cf-996a-5a9d1cae69c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:32.502453 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca89fb9-0e5a-4020-8ddf-2281d310a632 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:32.503828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096aab69-0880-49cf-996a-5a9d1cae69c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:32.505343 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096aab69-0880-49cf-996a-5a9d1cae69c1 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:32.507135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd7391-3d25-427a-b45f-3ccf94da7fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:32.507751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd7391-3d25-427a-b45f-3ccf94da7fdf admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:32.508061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd7391-3d25-427a-b45f-3ccf94da7fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:32.508333 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbd7391-3d25-427a-b45f-3ccf94da7fdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:32.508987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd7391-3d25-427a-b45f-3ccf94da7fdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:32.510925 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbd7391-3d25-427a-b45f-3ccf94da7fdf admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:32.515368 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1126/2231] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:24:32.542998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1106/2232] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:24:32 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:24:32.544936 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aab69-0880-49cf-996a-5a9d1cae69c1 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:32.555857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096aab69-0880-49cf-996a-5a9d1cae69c1 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:32.616645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7533816-5d15-4f24-84f5-0484ac0e1001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:32.617184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7533816-5d15-4f24-84f5-0484ac0e1001 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:32.617464 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7533816-5d15-4f24-84f5-0484ac0e1001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:32.617738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7533816-5d15-4f24-84f5-0484ac0e1001 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:32.618515 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7533816-5d15-4f24-84f5-0484ac0e1001 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:32.620485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7533816-5d15-4f24-84f5-0484ac0e1001 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:32.646108 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1127/2233] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:24:32 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:32.647623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd7391-3d25-427a-b45f-3ccf94da7fdf admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:32.658523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbd7391-3d25-427a-b45f-3ccf94da7fdf admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:32.663191 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672746ef-1332-46b8-b5b9-534be306d262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:32.663803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672746ef-1332-46b8-b5b9-534be306d262 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:32.664084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672746ef-1332-46b8-b5b9-534be306d262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:32.664359 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672746ef-1332-46b8-b5b9-534be306d262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:32.665054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672746ef-1332-46b8-b5b9-534be306d262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:32.666767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672746ef-1332-46b8-b5b9-534be306d262 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:32.679241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1107/2234] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:32.683264 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7533816-5d15-4f24-84f5-0484ac0e1001 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:32.694545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7533816-5d15-4f24-84f5-0484ac0e1001 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:32.699581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b810f72-79f1-4e4e-bacd-10b0badc9af1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:32.700199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b810f72-79f1-4e4e-bacd-10b0badc9af1 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:32.700481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b810f72-79f1-4e4e-bacd-10b0badc9af1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:32.700759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b810f72-79f1-4e4e-bacd-10b0badc9af1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:32.701457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b810f72-79f1-4e4e-bacd-10b0badc9af1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:32.703436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b810f72-79f1-4e4e-bacd-10b0badc9af1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:32.718195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1128/2235] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:24:32.719613 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672746ef-1332-46b8-b5b9-534be306d262 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:32.730213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672746ef-1332-46b8-b5b9-534be306d262 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:32.735642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68191103-48e1-40ec-bfdf-0ead1cb5196c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:32.736349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68191103-48e1-40ec-bfdf-0ead1cb5196c admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:32.736622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68191103-48e1-40ec-bfdf-0ead1cb5196c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:32.736897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68191103-48e1-40ec-bfdf-0ead1cb5196c admin admin] PATH_INFO: `/v3/projects/a8ef69e81ff8494084a72d8f9bd03875/users/f2f38a5a9c9243b7bd135fb8b5eb8b10/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:32.751677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68191103-48e1-40ec-bfdf-0ead1cb5196c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a8ef69e81ff8494084a72d8f9bd03875, user_id=f2f38a5a9c9243b7bd135fb8b5eb8b10, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:32.754337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68191103-48e1-40ec-bfdf-0ead1cb5196c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:32.768081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1108/2236] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:32 2022] PUT /identity/v3/projects/a8ef69e81ff8494084a72d8f9bd03875/users/f2f38a5a9c9243b7bd135fb8b5eb8b10/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:24:32.779339 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f189663-7a84-4f98-a723-d49cae76d02c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:32.779631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f189663-7a84-4f98-a723-d49cae76d02c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:32.779913 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f189663-7a84-4f98-a723-d49cae76d02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:32.789759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:32.811826 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7f189663-7a84-4f98-a723-d49cae76d02c None None] MFA Rules not processed for user `f2f38a5a9c9243b7bd135fb8b5eb8b10`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:32.813125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7f189663-7a84-4f98-a723-d49cae76d02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:32.814549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68191103-48e1-40ec-bfdf-0ead1cb5196c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:32.816286 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-68191103-48e1-40ec-bfdf-0ead1cb5196c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:32.884797 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1129/2237] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:32 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:32.887641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68191103-48e1-40ec-bfdf-0ead1cb5196c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:32.892760 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67cce6-80bb-4d5a-ad42-046108ac677e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:32.893432 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67cce6-80bb-4d5a-ad42-046108ac677e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:32.893707 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67cce6-80bb-4d5a-ad42-046108ac677e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:32.894232 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67cce6-80bb-4d5a-ad42-046108ac677e admin admin] PATH_INFO: `/v3/projects/7ef9e729ca794303b3760f938fb7e2e7` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:32.895198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f189663-7a84-4f98-a723-d49cae76d02c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:32.895312 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67cce6-80bb-4d5a-ad42-046108ac677e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ef9e729ca794303b3760f938fb7e2e7)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:32.896584 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7f189663-7a84-4f98-a723-d49cae76d02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:32.897164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67cce6-80bb-4d5a-ad42-046108ac677e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:32.948933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4b67cce6-80bb-4d5a-ad42-046108ac677e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ef9e729ca794303b3760f938fb7e2e7', 'request_id': 'req-4b67cce6-80bb-4d5a-ad42-046108ac677e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:32.954842 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f189663-7a84-4f98-a723-d49cae76d02c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:32.955834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4b67cce6-80bb-4d5a-ad42-046108ac677e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ef9e729ca794303b3760f938fb7e2e7', 'request_id': 'req-4b67cce6-80bb-4d5a-ad42-046108ac677e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:32.972769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4b67cce6-80bb-4d5a-ad42-046108ac677e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ef9e729ca794303b3760f938fb7e2e7', 'request_id': 'req-4b67cce6-80bb-4d5a-ad42-046108ac677e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:32.988891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4b67cce6-80bb-4d5a-ad42-046108ac677e admin admin] The token cache is being invalidate because project 7ef9e729ca794303b3760f938fb7e2e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:32.989167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4b67cce6-80bb-4d5a-ad42-046108ac677e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:32.990935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4b67cce6-80bb-4d5a-ad42-046108ac677e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:32.996036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1109/2238] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:32 2022] DELETE /identity/v3/projects/7ef9e729ca794303b3760f938fb7e2e7 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:32.998087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92582c9-a9f1-4d46-88ab-179ebe585f85 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:32.998087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92582c9-a9f1-4d46-88ab-179ebe585f85 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:32.998324 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92582c9-a9f1-4d46-88ab-179ebe585f85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:33.017480 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc45e9-ad6c-4243-8a3a-06869365e4c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:33.018566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc45e9-ad6c-4243-8a3a-06869365e4c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:33.018874 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc45e9-ad6c-4243-8a3a-06869365e4c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:33.018987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f92582c9-a9f1-4d46-88ab-179ebe585f85 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:33.019146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fc45e9-ad6c-4243-8a3a-06869365e4c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:33.020206 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f92582c9-a9f1-4d46-88ab-179ebe585f85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:33.021789 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-54fc45e9-ad6c-4243-8a3a-06869365e4c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:33.046984 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:33.090637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1110/2239] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:33.098350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc45e9-ad6c-4243-8a3a-06869365e4c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:33.099493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2212e3-08eb-4049-aa21-bfccba3e3e78 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:33.099778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2212e3-08eb-4049-aa21-bfccba3e3e78 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:33.099975 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fc45e9-ad6c-4243-8a3a-06869365e4c9 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:33.100088 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2212e3-08eb-4049-aa21-bfccba3e3e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:33.111502 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1130/2240] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:24:33.123419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1f2212e3-08eb-4049-aa21-bfccba3e3e78 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:33.125022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1f2212e3-08eb-4049-aa21-bfccba3e3e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:33.138408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1111/2241] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:33.143266 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc45e9-ad6c-4243-8a3a-06869365e4c9 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:33.151831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:33.159069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fc45e9-ad6c-4243-8a3a-06869365e4c9 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:33.165932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fa7d7-bcd5-4f8c-90fb-d5a6a15ce009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:33.166562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fa7d7-bcd5-4f8c-90fb-d5a6a15ce009 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:33.166874 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fa7d7-bcd5-4f8c-90fb-d5a6a15ce009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:33.167343 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481fa7d7-bcd5-4f8c-90fb-d5a6a15ce009 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:33.174256 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fa7d7-bcd5-4f8c-90fb-d5a6a15ce009 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:24:33.174256 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fa7d7-bcd5-4f8c-90fb-d5a6a15ce009 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:33.174256 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481fa7d7-bcd5-4f8c-90fb-d5a6a15ce009 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:33.191561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1131/2242] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:24:33.198427 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2212e3-08eb-4049-aa21-bfccba3e3e78 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:33.208600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2212e3-08eb-4049-aa21-bfccba3e3e78 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:33.213512 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7253bff-de34-410f-b9f9-8e355dfc94c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:33.214121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7253bff-de34-410f-b9f9-8e355dfc94c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:33.214400 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7253bff-de34-410f-b9f9-8e355dfc94c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:33.214711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7253bff-de34-410f-b9f9-8e355dfc94c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:33.215366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7253bff-de34-410f-b9f9-8e355dfc94c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:33.217297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7253bff-de34-410f-b9f9-8e355dfc94c2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:33.248877 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1112/2243] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:24:33 2022] POST /identity/v3/projects => generated 375 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:33.253542 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fa7d7-bcd5-4f8c-90fb-d5a6a15ce009 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:33.265112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481fa7d7-bcd5-4f8c-90fb-d5a6a15ce009 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:33.322285 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4f961-14a7-49e9-b6fe-6296a3f66268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:33.322937 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4f961-14a7-49e9-b6fe-6296a3f66268 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:33.323245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4f961-14a7-49e9-b6fe-6296a3f66268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:33.323544 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a4f961-14a7-49e9-b6fe-6296a3f66268 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:33.324176 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4f961-14a7-49e9-b6fe-6296a3f66268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:33.326110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a4f961-14a7-49e9-b6fe-6296a3f66268 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:33.349249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1132/2244] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:24:33 2022] POST /identity/v3/users => generated 288 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:24:33.354064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7253bff-de34-410f-b9f9-8e355dfc94c2 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:33.366523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7253bff-de34-410f-b9f9-8e355dfc94c2 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:33.371463 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdbb7f-a5e1-4fb9-8628-972e524641fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:33.372079 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdbb7f-a5e1-4fb9-8628-972e524641fe admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:33.372363 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdbb7f-a5e1-4fb9-8628-972e524641fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:33.372718 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbdbb7f-a5e1-4fb9-8628-972e524641fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:33.373323 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdbb7f-a5e1-4fb9-8628-972e524641fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:33.375001 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbdbb7f-a5e1-4fb9-8628-972e524641fe admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:33.385211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1113/2245] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:24:33.389356 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4f961-14a7-49e9-b6fe-6296a3f66268 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:33.399603 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a4f961-14a7-49e9-b6fe-6296a3f66268 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:33.404413 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48f6f8-79eb-44eb-9636-2911d46b75fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:33.405014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48f6f8-79eb-44eb-9636-2911d46b75fd admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:33.405824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48f6f8-79eb-44eb-9636-2911d46b75fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:33.406100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48f6f8-79eb-44eb-9636-2911d46b75fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:33.406875 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48f6f8-79eb-44eb-9636-2911d46b75fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:33.408466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48f6f8-79eb-44eb-9636-2911d46b75fd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:33.423611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1133/2246] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:33.424622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdbb7f-a5e1-4fb9-8628-972e524641fe admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:33.438090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbdbb7f-a5e1-4fb9-8628-972e524641fe admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:33.443141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a114046-b51a-42d8-a687-bb6165797ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:33.444002 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a114046-b51a-42d8-a687-bb6165797ab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:33.444338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a114046-b51a-42d8-a687-bb6165797ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:33.444731 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a114046-b51a-42d8-a687-bb6165797ab8 admin admin] PATH_INFO: `/v3/projects/a994cb2a680746ee9fa1fa3207bae095/users/3415627434e34bbabc49ac4b8313262e/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:33.460885 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a114046-b51a-42d8-a687-bb6165797ab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a994cb2a680746ee9fa1fa3207bae095, user_id=3415627434e34bbabc49ac4b8313262e, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:33.463717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a114046-b51a-42d8-a687-bb6165797ab8 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:33.487562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1114/2247] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:33 2022] PUT /identity/v3/projects/a994cb2a680746ee9fa1fa3207bae095/users/3415627434e34bbabc49ac4b8313262e/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:24:33.499446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adee0e0-a3b4-40d8-9be0-cf3d38ce6831 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:33.499987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adee0e0-a3b4-40d8-9be0-cf3d38ce6831 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:33.499987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adee0e0-a3b4-40d8-9be0-cf3d38ce6831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:33.540934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2adee0e0-a3b4-40d8-9be0-cf3d38ce6831 None None] MFA Rules not processed for user `3415627434e34bbabc49ac4b8313262e`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:33.542349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2adee0e0-a3b4-40d8-9be0-cf3d38ce6831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:33.616861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1134/2248] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:33.621542 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a114046-b51a-42d8-a687-bb6165797ab8 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:33.692938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a114046-b51a-42d8-a687-bb6165797ab8 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:33.697567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5366b-ddcd-4e63-8e53-071912092eca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:33.698219 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5366b-ddcd-4e63-8e53-071912092eca admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:33.698499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5366b-ddcd-4e63-8e53-071912092eca admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:33.698803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d5366b-ddcd-4e63-8e53-071912092eca admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:33.699451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5366b-ddcd-4e63-8e53-071912092eca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:33.701358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d5366b-ddcd-4e63-8e53-071912092eca admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:33.730106 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1115/2249] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:24:33 2022] POST /identity/v3/projects => generated 373 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:33.734090 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adee0e0-a3b4-40d8-9be0-cf3d38ce6831 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:33.744837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adee0e0-a3b4-40d8-9be0-cf3d38ce6831 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:33.800889 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3cdaf-8584-469b-a089-d3645276f90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:33.801494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3cdaf-8584-469b-a089-d3645276f90b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:33.801775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3cdaf-8584-469b-a089-d3645276f90b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:33.802049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa3cdaf-8584-469b-a089-d3645276f90b admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:33.802732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3cdaf-8584-469b-a089-d3645276f90b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:33.804662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa3cdaf-8584-469b-a089-d3645276f90b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:33.812604 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:33.826253 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1135/2250] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:24:33 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:33.831290 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5366b-ddcd-4e63-8e53-071912092eca admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:33.841926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d5366b-ddcd-4e63-8e53-071912092eca admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:33.847039 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2410a9-e710-4118-bcbe-50af7e163e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:33.847637 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2410a9-e710-4118-bcbe-50af7e163e7e admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:33.847922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2410a9-e710-4118-bcbe-50af7e163e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:33.848187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2410a9-e710-4118-bcbe-50af7e163e7e admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:33.848869 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2410a9-e710-4118-bcbe-50af7e163e7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:33.850468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2410a9-e710-4118-bcbe-50af7e163e7e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:33.861739 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1116/2251] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:33.866223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3cdaf-8584-469b-a089-d3645276f90b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:33.876563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa3cdaf-8584-469b-a089-d3645276f90b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:33.881455 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7e5eb-d175-4d02-88df-af57c5394951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:33.882117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7e5eb-d175-4d02-88df-af57c5394951 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:33.882398 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7e5eb-d175-4d02-88df-af57c5394951 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:33.882712 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c7e5eb-d175-4d02-88df-af57c5394951 admin admin] PATH_INFO: `/v3/projects/15cc9ca19db542beba167afad564d232/users/ecf0ee59d64a44daadce49bea3c70363/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:33.900488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7e5eb-d175-4d02-88df-af57c5394951 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15cc9ca19db542beba167afad564d232, user_id=ecf0ee59d64a44daadce49bea3c70363, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:33.903663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c7e5eb-d175-4d02-88df-af57c5394951 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:33.916905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1136/2252] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:33 2022] PUT /identity/v3/projects/15cc9ca19db542beba167afad564d232/users/ecf0ee59d64a44daadce49bea3c70363/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:33.921335 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2410a9-e710-4118-bcbe-50af7e163e7e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:33.931515 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2410a9-e710-4118-bcbe-50af7e163e7e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:33.970369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:33.989732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456db62d-3d9b-406e-afc5-d5a28bbcf183 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:33.990344 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456db62d-3d9b-406e-afc5-d5a28bbcf183 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:33.990645 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456db62d-3d9b-406e-afc5-d5a28bbcf183 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:33.990920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456db62d-3d9b-406e-afc5-d5a28bbcf183 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:33.991601 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456db62d-3d9b-406e-afc5-d5a28bbcf183 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:33.993205 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456db62d-3d9b-406e-afc5-d5a28bbcf183 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:34.003123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1117/2253] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:34.007305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7e5eb-d175-4d02-88df-af57c5394951 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:34.018055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c7e5eb-d175-4d02-88df-af57c5394951 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:34.022839 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbdc68-f422-4fa8-8b30-24d22ac228a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:34.023485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbdc68-f422-4fa8-8b30-24d22ac228a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:34.023761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbdc68-f422-4fa8-8b30-24d22ac228a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:34.024032 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdbdc68-f422-4fa8-8b30-24d22ac228a9 admin admin] PATH_INFO: `/v3/projects/15cc9ca19db542beba167afad564d232/users/ecf0ee59d64a44daadce49bea3c70363/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:34.025992 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbdc68-f422-4fa8-8b30-24d22ac228a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15cc9ca19db542beba167afad564d232, user_id=ecf0ee59d64a44daadce49bea3c70363, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:34.028635 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdbdc68-f422-4fa8-8b30-24d22ac228a9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:34.039381 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1137/2254] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:34 2022] PUT /identity/v3/projects/15cc9ca19db542beba167afad564d232/users/ecf0ee59d64a44daadce49bea3c70363/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:34.051130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301acf14-9da5-4aad-a0fe-e7d828686688 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:34.051436 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301acf14-9da5-4aad-a0fe-e7d828686688 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:34.051739 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301acf14-9da5-4aad-a0fe-e7d828686688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:34.080899 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-301acf14-9da5-4aad-a0fe-e7d828686688 None None] MFA Rules not processed for user `ecf0ee59d64a44daadce49bea3c70363`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:34.082096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-301acf14-9da5-4aad-a0fe-e7d828686688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:34.149791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1118/2255] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:34 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:34.160797 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbdc68-f422-4fa8-8b30-24d22ac228a9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:34.162472 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cfdbdc68-f422-4fa8-8b30-24d22ac228a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:34.223455 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdbdc68-f422-4fa8-8b30-24d22ac228a9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:34.227369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8ce3a-1999-4a13-b3f5-79a7a3db29d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:34.228094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8ce3a-1999-4a13-b3f5-79a7a3db29d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:34.228376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8ce3a-1999-4a13-b3f5-79a7a3db29d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:34.228783 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8ce3a-1999-4a13-b3f5-79a7a3db29d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:34.288509 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8ce3a-1999-4a13-b3f5-79a7a3db29d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:34.289939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8ce3a-1999-4a13-b3f5-79a7a3db29d1 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:34.298958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1138/2256] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:36.864433 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301acf14-9da5-4aad-a0fe-e7d828686688 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:36.932072 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301acf14-9da5-4aad-a0fe-e7d828686688 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:36.936679 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77079e08-5a0b-47f3-9f7f-f4683e7c6f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:36.937564 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77079e08-5a0b-47f3-9f7f-f4683e7c6f54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:36.937840 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77079e08-5a0b-47f3-9f7f-f4683e7c6f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:36.938137 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77079e08-5a0b-47f3-9f7f-f4683e7c6f54 admin admin] PATH_INFO: `/v3/users/3415627434e34bbabc49ac4b8313262e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:36.939392 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77079e08-5a0b-47f3-9f7f-f4683e7c6f54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3415627434e34bbabc49ac4b8313262e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:36.941320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77079e08-5a0b-47f3-9f7f-f4683e7c6f54 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:36.998010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-77079e08-5a0b-47f3-9f7f-f4683e7c6f54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3415627434e34bbabc49ac4b8313262e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:37.007784 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-77079e08-5a0b-47f3-9f7f-f4683e7c6f54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3415627434e34bbabc49ac4b8313262e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:37.016362 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:37.023102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-77079e08-5a0b-47f3-9f7f-f4683e7c6f54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3415627434e34bbabc49ac4b8313262e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:37.024011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-77079e08-5a0b-47f3-9f7f-f4683e7c6f54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3415627434e34bbabc49ac4b8313262e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:37.032997 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-77079e08-5a0b-47f3-9f7f-f4683e7c6f54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3415627434e34bbabc49ac4b8313262e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:37.039240 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1119/2257] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:36 2022] DELETE /identity/v3/users/3415627434e34bbabc49ac4b8313262e => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:37.043697 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4040-e800-4563-b40d-b26ad4cca2bd None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:37.044203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4040-e800-4563-b40d-b26ad4cca2bd None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:37.044362 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0a4040-e800-4563-b40d-b26ad4cca2bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:37.066863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2f0a4040-e800-4563-b40d-b26ad4cca2bd None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:37.068167 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2f0a4040-e800-4563-b40d-b26ad4cca2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:37.180685 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1139/2258] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:37.190865 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77079e08-5a0b-47f3-9f7f-f4683e7c6f54 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:37.192413 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-77079e08-5a0b-47f3-9f7f-f4683e7c6f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:37.276609 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77079e08-5a0b-47f3-9f7f-f4683e7c6f54 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:37.280661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb12ea-9b49-40cb-8a0d-5294552a97e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:37.281350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb12ea-9b49-40cb-8a0d-5294552a97e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:37.281792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb12ea-9b49-40cb-8a0d-5294552a97e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:37.282068 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eb12ea-9b49-40cb-8a0d-5294552a97e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:37.298375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb12ea-9b49-40cb-8a0d-5294552a97e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:37.300221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eb12ea-9b49-40cb-8a0d-5294552a97e3 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:37.312489 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1120/2259] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:37.588525 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a4040-e800-4563-b40d-b26ad4cca2bd None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:37.590009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2f0a4040-e800-4563-b40d-b26ad4cca2bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:37.603394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0a4040-e800-4563-b40d-b26ad4cca2bd None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:37.608611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef05e6-9a95-4345-ba81-28a71858a5f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:37.609330 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef05e6-9a95-4345-ba81-28a71858a5f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:37.609720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef05e6-9a95-4345-ba81-28a71858a5f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:37.610063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef05e6-9a95-4345-ba81-28a71858a5f6 admin admin] PATH_INFO: `/v3/projects/a994cb2a680746ee9fa1fa3207bae095` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:37.611389 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef05e6-9a95-4345-ba81-28a71858a5f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a994cb2a680746ee9fa1fa3207bae095)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:37.613450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef05e6-9a95-4345-ba81-28a71858a5f6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:37.615229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:37.670344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-daef05e6-9a95-4345-ba81-28a71858a5f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a994cb2a680746ee9fa1fa3207bae095', 'request_id': 'req-daef05e6-9a95-4345-ba81-28a71858a5f6'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:37.676833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-daef05e6-9a95-4345-ba81-28a71858a5f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a994cb2a680746ee9fa1fa3207bae095', 'request_id': 'req-daef05e6-9a95-4345-ba81-28a71858a5f6'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:37.682844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-daef05e6-9a95-4345-ba81-28a71858a5f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a994cb2a680746ee9fa1fa3207bae095', 'request_id': 'req-daef05e6-9a95-4345-ba81-28a71858a5f6'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:37.695767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-daef05e6-9a95-4345-ba81-28a71858a5f6 admin admin] The token cache is being invalidate because project a994cb2a680746ee9fa1fa3207bae095 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:37.696158 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-daef05e6-9a95-4345-ba81-28a71858a5f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:37.696860 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-daef05e6-9a95-4345-ba81-28a71858a5f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:37.701491 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1140/2260] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:37 2022] DELETE /identity/v3/projects/a994cb2a680746ee9fa1fa3207bae095 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:37.703628 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb12ea-9b49-40cb-8a0d-5294552a97e3 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:37.715176 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eb12ea-9b49-40cb-8a0d-5294552a97e3 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:37.776819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81656e51-211f-4ebc-9d39-140a8e4dd397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:37.777461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81656e51-211f-4ebc-9d39-140a8e4dd397 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:37.777739 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81656e51-211f-4ebc-9d39-140a8e4dd397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:37.778010 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81656e51-211f-4ebc-9d39-140a8e4dd397 admin admin] PATH_INFO: `/v3/users/ecf0ee59d64a44daadce49bea3c70363` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:37.779196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81656e51-211f-4ebc-9d39-140a8e4dd397 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecf0ee59d64a44daadce49bea3c70363)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:37.781764 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81656e51-211f-4ebc-9d39-140a8e4dd397 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:37.832245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-81656e51-211f-4ebc-9d39-140a8e4dd397 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecf0ee59d64a44daadce49bea3c70363'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:37.840967 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-81656e51-211f-4ebc-9d39-140a8e4dd397 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecf0ee59d64a44daadce49bea3c70363'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:37.855150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-81656e51-211f-4ebc-9d39-140a8e4dd397 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecf0ee59d64a44daadce49bea3c70363'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:37.855915 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-81656e51-211f-4ebc-9d39-140a8e4dd397 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecf0ee59d64a44daadce49bea3c70363'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:37.864055 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-81656e51-211f-4ebc-9d39-140a8e4dd397 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecf0ee59d64a44daadce49bea3c70363'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:37.870619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1121/2261] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:37 2022] DELETE /identity/v3/users/ecf0ee59d64a44daadce49bea3c70363 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:38.180759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef05e6-9a95-4345-ba81-28a71858a5f6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:38.182939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-daef05e6-9a95-4345-ba81-28a71858a5f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:38.197531 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef05e6-9a95-4345-ba81-28a71858a5f6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:38.271817 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19e8638-f616-40c1-86fa-1d8089944b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:38.272714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e8638-f616-40c1-86fa-1d8089944b3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:38.273031 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e8638-f616-40c1-86fa-1d8089944b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:38.273339 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19e8638-f616-40c1-86fa-1d8089944b3c admin admin] PATH_INFO: `/v3/projects/15cc9ca19db542beba167afad564d232` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:38.274929 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e8638-f616-40c1-86fa-1d8089944b3c admin admin] RBAC: Authorizing `identity:delete_project(project_id=15cc9ca19db542beba167afad564d232)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:38.278210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19e8638-f616-40c1-86fa-1d8089944b3c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:38.352271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c19e8638-f616-40c1-86fa-1d8089944b3c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15cc9ca19db542beba167afad564d232', 'request_id': 'req-c19e8638-f616-40c1-86fa-1d8089944b3c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:38.360965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c19e8638-f616-40c1-86fa-1d8089944b3c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15cc9ca19db542beba167afad564d232', 'request_id': 'req-c19e8638-f616-40c1-86fa-1d8089944b3c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:38.370153 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c19e8638-f616-40c1-86fa-1d8089944b3c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15cc9ca19db542beba167afad564d232', 'request_id': 'req-c19e8638-f616-40c1-86fa-1d8089944b3c'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:38.392248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c19e8638-f616-40c1-86fa-1d8089944b3c admin admin] The token cache is being invalidate because project 15cc9ca19db542beba167afad564d232 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:38.392995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c19e8638-f616-40c1-86fa-1d8089944b3c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:38.393869 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c19e8638-f616-40c1-86fa-1d8089944b3c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:38.399634 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1141/2262] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:38 2022] DELETE /identity/v3/projects/15cc9ca19db542beba167afad564d232 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:38.400795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a351cc2-ef5a-4ce9-840e-2d8024754e3e None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:38.401090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a351cc2-ef5a-4ce9-840e-2d8024754e3e None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:38.401376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a351cc2-ef5a-4ce9-840e-2d8024754e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:38.409895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:38.426665 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-6a351cc2-ef5a-4ce9-840e-2d8024754e3e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:38.428360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6a351cc2-ef5a-4ce9-840e-2d8024754e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:38.517509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1122/2263] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:38.525666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d61ff4-26cb-4be7-9bb7-c426393315e9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:38.526059 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d61ff4-26cb-4be7-9bb7-c426393315e9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:38.526456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d61ff4-26cb-4be7-9bb7-c426393315e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:38.551043 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-71d61ff4-26cb-4be7-9bb7-c426393315e9 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:38.552260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-71d61ff4-26cb-4be7-9bb7-c426393315e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:38.560253 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1142/2264] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:38.564882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a351cc2-ef5a-4ce9-840e-2d8024754e3e None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:38.574707 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a351cc2-ef5a-4ce9-840e-2d8024754e3e None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:38.580200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082acd8f-50da-4709-bfd5-8b37ddcef1e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:38.580869 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082acd8f-50da-4709-bfd5-8b37ddcef1e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:38.581211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082acd8f-50da-4709-bfd5-8b37ddcef1e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:38.581490 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-082acd8f-50da-4709-bfd5-8b37ddcef1e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:38.582192 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082acd8f-50da-4709-bfd5-8b37ddcef1e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:24:38.582526 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082acd8f-50da-4709-bfd5-8b37ddcef1e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:38.584179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-082acd8f-50da-4709-bfd5-8b37ddcef1e3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:38.596412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1123/2265] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:24:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:24:38.600688 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d61ff4-26cb-4be7-9bb7-c426393315e9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:38.610172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d61ff4-26cb-4be7-9bb7-c426393315e9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:38.614861 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b43ed-cf60-4f08-8aad-6549cec04106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:38.615464 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b43ed-cf60-4f08-8aad-6549cec04106 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:38.615746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b43ed-cf60-4f08-8aad-6549cec04106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:38.616016 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b43ed-cf60-4f08-8aad-6549cec04106 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:38.616681 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b43ed-cf60-4f08-8aad-6549cec04106 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:38.618572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b43ed-cf60-4f08-8aad-6549cec04106 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:38.630259 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:38.653179 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1143/2266] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:24:38 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:38.657647 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082acd8f-50da-4709-bfd5-8b37ddcef1e3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:38.667838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-082acd8f-50da-4709-bfd5-8b37ddcef1e3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:38.729858 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaecc18-dcbd-44f4-9d9e-e300e570203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:38.730486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaecc18-dcbd-44f4-9d9e-e300e570203e admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:38.730800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaecc18-dcbd-44f4-9d9e-e300e570203e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:38.731077 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaecc18-dcbd-44f4-9d9e-e300e570203e admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:38.731741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaecc18-dcbd-44f4-9d9e-e300e570203e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:38.733737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aaecc18-dcbd-44f4-9d9e-e300e570203e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:38.756818 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1124/2267] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:24:38 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:38.760962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b43ed-cf60-4f08-8aad-6549cec04106 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:38.772372 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b43ed-cf60-4f08-8aad-6549cec04106 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:38.783010 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266de00c-87d9-4eaa-929d-acb1157f173c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:38.783010 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266de00c-87d9-4eaa-929d-acb1157f173c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:38.783010 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266de00c-87d9-4eaa-929d-acb1157f173c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:38.783010 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266de00c-87d9-4eaa-929d-acb1157f173c admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:38.783401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266de00c-87d9-4eaa-929d-acb1157f173c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:38.783401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266de00c-87d9-4eaa-929d-acb1157f173c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:38.797487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1144/2268] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:38.803691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaecc18-dcbd-44f4-9d9e-e300e570203e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:38.814991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaecc18-dcbd-44f4-9d9e-e300e570203e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:38.819709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ccf55-4a75-472f-83e3-32e7a85505e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:38.820322 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ccf55-4a75-472f-83e3-32e7a85505e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:38.820603 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ccf55-4a75-472f-83e3-32e7a85505e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:38.820878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ccf55-4a75-472f-83e3-32e7a85505e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:38.821573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ccf55-4a75-472f-83e3-32e7a85505e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:38.823260 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7ccf55-4a75-472f-83e3-32e7a85505e7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:38.835196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1125/2269] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:38.839448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266de00c-87d9-4eaa-929d-acb1157f173c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:38.849762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266de00c-87d9-4eaa-929d-acb1157f173c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:38.854627 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5b826-7598-449a-9486-605744096b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:38.855281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5b826-7598-449a-9486-605744096b5f admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:38.855564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5b826-7598-449a-9486-605744096b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:38.855840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5b826-7598-449a-9486-605744096b5f admin admin] PATH_INFO: `/v3/projects/b6a0f6ea084d404ba1ecd17aa890a34e/users/a6b3e61f41824f8bbb971f2d84b79677/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:38.871054 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5b826-7598-449a-9486-605744096b5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b6a0f6ea084d404ba1ecd17aa890a34e, user_id=a6b3e61f41824f8bbb971f2d84b79677, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:38.874226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d5b826-7598-449a-9486-605744096b5f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:38.887474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1145/2270] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:38 2022] PUT /identity/v3/projects/b6a0f6ea084d404ba1ecd17aa890a34e/users/a6b3e61f41824f8bbb971f2d84b79677/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:38.898198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78d7ef-ba4b-45a3-b57f-d9a9f72c8428 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:38.898645 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78d7ef-ba4b-45a3-b57f-d9a9f72c8428 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:38.898751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b78d7ef-ba4b-45a3-b57f-d9a9f72c8428 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:38.927150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1b78d7ef-ba4b-45a3-b57f-d9a9f72c8428 None None] MFA Rules not processed for user `a6b3e61f41824f8bbb971f2d84b79677`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:38.928362 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1b78d7ef-ba4b-45a3-b57f-d9a9f72c8428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:38.995647 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:39.001696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1126/2271] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:38 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:39.014987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5b826-7598-449a-9486-605744096b5f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:39.016713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f0d5b826-7598-449a-9486-605744096b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:39.086429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5b826-7598-449a-9486-605744096b5f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:39.090648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c560647f-58e2-4e9d-8005-cc352150aa1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:39.091597 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560647f-58e2-4e9d-8005-cc352150aa1c service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:39.092121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560647f-58e2-4e9d-8005-cc352150aa1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:39.093040 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c560647f-58e2-4e9d-8005-cc352150aa1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:39.103221 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560647f-58e2-4e9d-8005-cc352150aa1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:39.104675 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c560647f-58e2-4e9d-8005-cc352150aa1c service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:39.114113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1146/2272] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:39 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:40.739103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78d7ef-ba4b-45a3-b57f-d9a9f72c8428 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:40.740602 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1b78d7ef-ba4b-45a3-b57f-d9a9f72c8428 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:40.821810 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b78d7ef-ba4b-45a3-b57f-d9a9f72c8428 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:40.832267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b570e6-dffc-48f2-9523-a0a5d11deaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:40.832928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b570e6-dffc-48f2-9523-a0a5d11deaf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:40.833214 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b570e6-dffc-48f2-9523-a0a5d11deaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:40.833488 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b570e6-dffc-48f2-9523-a0a5d11deaf2 admin admin] PATH_INFO: `/v3/users/a44dcf71f1124d31ad16f91396eb5e77` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:40.835086 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b570e6-dffc-48f2-9523-a0a5d11deaf2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a44dcf71f1124d31ad16f91396eb5e77)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:40.837097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b570e6-dffc-48f2-9523-a0a5d11deaf2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:40.894312 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-37b570e6-dffc-48f2-9523-a0a5d11deaf2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a44dcf71f1124d31ad16f91396eb5e77'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:40.907717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-37b570e6-dffc-48f2-9523-a0a5d11deaf2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a44dcf71f1124d31ad16f91396eb5e77'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:40.922919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-37b570e6-dffc-48f2-9523-a0a5d11deaf2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a44dcf71f1124d31ad16f91396eb5e77'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:40.923954 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-37b570e6-dffc-48f2-9523-a0a5d11deaf2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a44dcf71f1124d31ad16f91396eb5e77'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:40.932031 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-37b570e6-dffc-48f2-9523-a0a5d11deaf2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a44dcf71f1124d31ad16f91396eb5e77'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:40.942376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1127/2273] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:40 2022] DELETE /identity/v3/users/a44dcf71f1124d31ad16f91396eb5e77 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:40.944555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4859b8-0263-431b-9583-ec0c743a970a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:40.945136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4859b8-0263-431b-9583-ec0c743a970a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:40.945398 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4859b8-0263-431b-9583-ec0c743a970a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:40.968369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0c4859b8-0263-431b-9583-ec0c743a970a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:40.970267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0c4859b8-0263-431b-9583-ec0c743a970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:41.035957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1147/2274] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:41.047249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b570e6-dffc-48f2-9523-a0a5d11deaf2 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:41.048844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-37b570e6-dffc-48f2-9523-a0a5d11deaf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:41.124062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b570e6-dffc-48f2-9523-a0a5d11deaf2 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:41.128472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f01b556-88a4-4000-a2f6-6bcf3dc25387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:41.129129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01b556-88a4-4000-a2f6-6bcf3dc25387 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:41.129407 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01b556-88a4-4000-a2f6-6bcf3dc25387 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:41.129747 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f01b556-88a4-4000-a2f6-6bcf3dc25387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:41.141116 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01b556-88a4-4000-a2f6-6bcf3dc25387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:41.143673 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f01b556-88a4-4000-a2f6-6bcf3dc25387 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:41.157514 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1128/2275] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:41.657243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4859b8-0263-431b-9583-ec0c743a970a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:41.659089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0c4859b8-0263-431b-9583-ec0c743a970a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:41.680668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4859b8-0263-431b-9583-ec0c743a970a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:41.686957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4305e0b-ad63-4a52-b072-f11f44733efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:41.688445 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305e0b-ad63-4a52-b072-f11f44733efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:41.688796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305e0b-ad63-4a52-b072-f11f44733efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:41.689142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4305e0b-ad63-4a52-b072-f11f44733efd admin admin] PATH_INFO: `/v3/projects/217bcbb7c0504e4091e713fe4573cb0f` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:41.690551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4305e0b-ad63-4a52-b072-f11f44733efd admin admin] RBAC: Authorizing `identity:delete_project(project_id=217bcbb7c0504e4091e713fe4573cb0f)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:41.692612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4305e0b-ad63-4a52-b072-f11f44733efd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:41.767130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d4305e0b-ad63-4a52-b072-f11f44733efd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '217bcbb7c0504e4091e713fe4573cb0f', 'request_id': 'req-d4305e0b-ad63-4a52-b072-f11f44733efd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:41.775117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d4305e0b-ad63-4a52-b072-f11f44733efd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '217bcbb7c0504e4091e713fe4573cb0f', 'request_id': 'req-d4305e0b-ad63-4a52-b072-f11f44733efd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:41.776706 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:41.782976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d4305e0b-ad63-4a52-b072-f11f44733efd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '217bcbb7c0504e4091e713fe4573cb0f', 'request_id': 'req-d4305e0b-ad63-4a52-b072-f11f44733efd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:41.799394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d4305e0b-ad63-4a52-b072-f11f44733efd admin admin] The token cache is being invalidate because project 217bcbb7c0504e4091e713fe4573cb0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:41.799977 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d4305e0b-ad63-4a52-b072-f11f44733efd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:41.800742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d4305e0b-ad63-4a52-b072-f11f44733efd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:41.802849 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1148/2276] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:41 2022] DELETE /identity/v3/projects/217bcbb7c0504e4091e713fe4573cb0f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:41.808315 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f410b-4b26-4896-ba54-9ef84071ab24 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:41.809200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f410b-4b26-4896-ba54-9ef84071ab24 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:41.809473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575f410b-4b26-4896-ba54-9ef84071ab24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:41.832167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-575f410b-4b26-4896-ba54-9ef84071ab24 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:41.833755 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-575f410b-4b26-4896-ba54-9ef84071ab24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:41.848663 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:41.910516 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1129/2277] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:41.919620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904859d-2953-48ef-a6df-9962eb677cf6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:41.919906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904859d-2953-48ef-a6df-9962eb677cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:41.920213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a904859d-2953-48ef-a6df-9962eb677cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:41.943503 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a904859d-2953-48ef-a6df-9962eb677cf6 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:41.944800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a904859d-2953-48ef-a6df-9962eb677cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:41.954010 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1149/2278] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:41.958314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f410b-4b26-4896-ba54-9ef84071ab24 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:41.970990 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575f410b-4b26-4896-ba54-9ef84071ab24 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:41.976428 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64fd55-6269-4d64-9dde-1b1e7ec64f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:41.977049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64fd55-6269-4d64-9dde-1b1e7ec64f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:41.977330 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64fd55-6269-4d64-9dde-1b1e7ec64f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:41.977805 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e64fd55-6269-4d64-9dde-1b1e7ec64f11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:41.984034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64fd55-6269-4d64-9dde-1b1e7ec64f11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:24:41.984034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64fd55-6269-4d64-9dde-1b1e7ec64f11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:41.984034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e64fd55-6269-4d64-9dde-1b1e7ec64f11 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:41.997967 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1130/2279] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:24:42.002063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904859d-2953-48ef-a6df-9962eb677cf6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:42.012475 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a904859d-2953-48ef-a6df-9962eb677cf6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:42.017329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98898de7-18e9-4acf-a6fa-58789a5fb21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:42.018138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98898de7-18e9-4acf-a6fa-58789a5fb21b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:42.018618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98898de7-18e9-4acf-a6fa-58789a5fb21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:42.018897 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98898de7-18e9-4acf-a6fa-58789a5fb21b admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:42.019573 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98898de7-18e9-4acf-a6fa-58789a5fb21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:42.021486 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98898de7-18e9-4acf-a6fa-58789a5fb21b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:42.051829 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1150/2280] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:24:42 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:42.056346 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64fd55-6269-4d64-9dde-1b1e7ec64f11 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:42.067186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e64fd55-6269-4d64-9dde-1b1e7ec64f11 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:42.125193 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346a809-b120-43c9-bc24-9eb04bb905d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:42.125814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346a809-b120-43c9-bc24-9eb04bb905d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:42.126120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346a809-b120-43c9-bc24-9eb04bb905d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:42.126392 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a346a809-b120-43c9-bc24-9eb04bb905d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:42.127089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346a809-b120-43c9-bc24-9eb04bb905d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:42.129016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a346a809-b120-43c9-bc24-9eb04bb905d0 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:42.151538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1131/2281] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:24:42 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:42.155577 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98898de7-18e9-4acf-a6fa-58789a5fb21b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:42.166833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98898de7-18e9-4acf-a6fa-58789a5fb21b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:42.172051 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab59ab-32d5-40d9-b8dc-2aee80d4ccad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:42.172680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab59ab-32d5-40d9-b8dc-2aee80d4ccad admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:42.172953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab59ab-32d5-40d9-b8dc-2aee80d4ccad admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:42.173238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ab59ab-32d5-40d9-b8dc-2aee80d4ccad admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:42.173908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab59ab-32d5-40d9-b8dc-2aee80d4ccad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:42.175515 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ab59ab-32d5-40d9-b8dc-2aee80d4ccad admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:42.188275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1151/2282] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:24:42.192253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346a809-b120-43c9-bc24-9eb04bb905d0 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:42.203545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a346a809-b120-43c9-bc24-9eb04bb905d0 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:42.208491 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a22d9f-a3b7-4d99-9d65-b1cda6c6e87b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:42.209104 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a22d9f-a3b7-4d99-9d65-b1cda6c6e87b admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:42.209386 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a22d9f-a3b7-4d99-9d65-b1cda6c6e87b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:42.209661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a22d9f-a3b7-4d99-9d65-b1cda6c6e87b admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:42.210508 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a22d9f-a3b7-4d99-9d65-b1cda6c6e87b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:42.211999 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a22d9f-a3b7-4d99-9d65-b1cda6c6e87b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:42.223561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1132/2283] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:42.227947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab59ab-32d5-40d9-b8dc-2aee80d4ccad admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:42.239308 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ab59ab-32d5-40d9-b8dc-2aee80d4ccad admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:42.245470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5570d5ec-07b0-4056-8efb-3c6fdd329d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:42.246286 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570d5ec-07b0-4056-8efb-3c6fdd329d78 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:42.246725 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570d5ec-07b0-4056-8efb-3c6fdd329d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:42.247135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5570d5ec-07b0-4056-8efb-3c6fdd329d78 admin admin] PATH_INFO: `/v3/projects/1ab2b13f3cfe4f4b8a699a95f6d27f6a/users/b9be112d07e14bf6b43e764e01a38884/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:42.264964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570d5ec-07b0-4056-8efb-3c6fdd329d78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ab2b13f3cfe4f4b8a699a95f6d27f6a, user_id=b9be112d07e14bf6b43e764e01a38884, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:42.265114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a22d9f-a3b7-4d99-9d65-b1cda6c6e87b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:42.266902 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-48a22d9f-a3b7-4d99-9d65-b1cda6c6e87b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:42.268016 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5570d5ec-07b0-4056-8efb-3c6fdd329d78 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:42.282394 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a22d9f-a3b7-4d99-9d65-b1cda6c6e87b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:42.283885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1152/2284] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:42 2022] PUT /identity/v3/projects/1ab2b13f3cfe4f4b8a699a95f6d27f6a/users/b9be112d07e14bf6b43e764e01a38884/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:42.294090 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2a401-dfaf-4926-a828-bd59462f64d7 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:42.294377 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2a401-dfaf-4926-a828-bd59462f64d7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:42.294701 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d2a401-dfaf-4926-a828-bd59462f64d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:42.326924 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-13d2a401-dfaf-4926-a828-bd59462f64d7 None None] MFA Rules not processed for user `b9be112d07e14bf6b43e764e01a38884`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:42.328546 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-13d2a401-dfaf-4926-a828-bd59462f64d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:42.360900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19513e78-b0bc-45db-a027-36836b20d20c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:42.361553 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19513e78-b0bc-45db-a027-36836b20d20c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:42.361835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19513e78-b0bc-45db-a027-36836b20d20c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:42.362112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19513e78-b0bc-45db-a027-36836b20d20c admin admin] PATH_INFO: `/v3/users/a6b3e61f41824f8bbb971f2d84b79677` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:42.363345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19513e78-b0bc-45db-a027-36836b20d20c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6b3e61f41824f8bbb971f2d84b79677)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:42.365301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19513e78-b0bc-45db-a027-36836b20d20c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:42.404018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:42.428546 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1153/2285] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:42.432904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-19513e78-b0bc-45db-a027-36836b20d20c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6b3e61f41824f8bbb971f2d84b79677'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:42.441613 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2a401-dfaf-4926-a828-bd59462f64d7 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:42.443499 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-13d2a401-dfaf-4926-a828-bd59462f64d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:42.447717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-19513e78-b0bc-45db-a027-36836b20d20c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6b3e61f41824f8bbb971f2d84b79677'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:42.475541 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-19513e78-b0bc-45db-a027-36836b20d20c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6b3e61f41824f8bbb971f2d84b79677'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:42.477473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-19513e78-b0bc-45db-a027-36836b20d20c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6b3e61f41824f8bbb971f2d84b79677'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:42.488913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-19513e78-b0bc-45db-a027-36836b20d20c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6b3e61f41824f8bbb971f2d84b79677'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:42.496424 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1133/2286] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:42 2022] DELETE /identity/v3/users/a6b3e61f41824f8bbb971f2d84b79677 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:24:42.501587 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8e88f-564d-4a34-af2a-d360a89d1275 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:42.501895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8e88f-564d-4a34-af2a-d360a89d1275 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:42.502727 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8e88f-564d-4a34-af2a-d360a89d1275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:42.527640 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d2a401-dfaf-4926-a828-bd59462f64d7 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:42.533079 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-89e8e88f-564d-4a34-af2a-d360a89d1275 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:42.534162 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-89e8e88f-564d-4a34-af2a-d360a89d1275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:42.559797 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:42.591376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6ea8d-edf7-4af7-95f9-293413885428 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:42.592001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6ea8d-edf7-4af7-95f9-293413885428 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:42.592813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6ea8d-edf7-4af7-95f9-293413885428 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:42.593086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6ea8d-edf7-4af7-95f9-293413885428 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:42.595595 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bdf6ea8d-edf7-4af7-95f9-293413885428 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:42.618512 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1134/2287] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:42.629856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8e88f-564d-4a34-af2a-d360a89d1275 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:42.631543 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-89e8e88f-564d-4a34-af2a-d360a89d1275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:42.668939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6ea8d-edf7-4af7-95f9-293413885428 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:42.670839 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6ea8d-edf7-4af7-95f9-293413885428 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:42.681172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1154/2288] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:42 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:24:42.695708 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8e88f-564d-4a34-af2a-d360a89d1275 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:42.699929 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce78b01-371f-4255-b3ac-3fba3232775a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:42.700585 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce78b01-371f-4255-b3ac-3fba3232775a service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:42.700959 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce78b01-371f-4255-b3ac-3fba3232775a service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:42.701216 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce78b01-371f-4255-b3ac-3fba3232775a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:42.713215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce78b01-371f-4255-b3ac-3fba3232775a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:42.714390 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce78b01-371f-4255-b3ac-3fba3232775a service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:42.724968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1135/2289] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:24:43.008660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6ea8d-edf7-4af7-95f9-293413885428 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:43.010340 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bdf6ea8d-edf7-4af7-95f9-293413885428 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:43.025229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6ea8d-edf7-4af7-95f9-293413885428 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:43.030609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99bb9e5-5452-46f7-99aa-75af573974f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:43.031249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bb9e5-5452-46f7-99aa-75af573974f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:43.031535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bb9e5-5452-46f7-99aa-75af573974f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:43.031812 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99bb9e5-5452-46f7-99aa-75af573974f7 admin admin] PATH_INFO: `/v3/projects/b6a0f6ea084d404ba1ecd17aa890a34e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:43.033181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bb9e5-5452-46f7-99aa-75af573974f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b6a0f6ea084d404ba1ecd17aa890a34e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:43.035090 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99bb9e5-5452-46f7-99aa-75af573974f7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:43.089657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b99bb9e5-5452-46f7-99aa-75af573974f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b6a0f6ea084d404ba1ecd17aa890a34e', 'request_id': 'req-b99bb9e5-5452-46f7-99aa-75af573974f7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:43.096786 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b99bb9e5-5452-46f7-99aa-75af573974f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b6a0f6ea084d404ba1ecd17aa890a34e', 'request_id': 'req-b99bb9e5-5452-46f7-99aa-75af573974f7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:43.103343 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b99bb9e5-5452-46f7-99aa-75af573974f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b6a0f6ea084d404ba1ecd17aa890a34e', 'request_id': 'req-b99bb9e5-5452-46f7-99aa-75af573974f7'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:43.119660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b99bb9e5-5452-46f7-99aa-75af573974f7 admin admin] The token cache is being invalidate because project b6a0f6ea084d404ba1ecd17aa890a34e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:43.119952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b99bb9e5-5452-46f7-99aa-75af573974f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:43.120612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b99bb9e5-5452-46f7-99aa-75af573974f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:43.122743 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1155/2290] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:43 2022] DELETE /identity/v3/projects/b6a0f6ea084d404ba1ecd17aa890a34e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:43.128301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196b4e3-d93e-4df6-a8a6-71991182743b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:43.128766 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196b4e3-d93e-4df6-a8a6-71991182743b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:43.129184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2196b4e3-d93e-4df6-a8a6-71991182743b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:43.157462 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2196b4e3-d93e-4df6-a8a6-71991182743b None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:43.157462 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2196b4e3-d93e-4df6-a8a6-71991182743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:43.203145 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:43.219584 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1136/2291] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:43.228456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b182e-6c89-4664-bf97-3bb53ba98d3a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:43.228739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b182e-6c89-4664-bf97-3bb53ba98d3a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:43.229012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74b182e-6c89-4664-bf97-3bb53ba98d3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:43.248804 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d74b182e-6c89-4664-bf97-3bb53ba98d3a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:43.250061 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d74b182e-6c89-4664-bf97-3bb53ba98d3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:43.257986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1156/2292] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:43.262372 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196b4e3-d93e-4df6-a8a6-71991182743b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:43.272755 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2196b4e3-d93e-4df6-a8a6-71991182743b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:43.277397 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cabc66-2a00-491e-a91e-9487a2fcaae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:43.277953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cabc66-2a00-491e-a91e-9487a2fcaae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:43.278233 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cabc66-2a00-491e-a91e-9487a2fcaae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:43.278511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cabc66-2a00-491e-a91e-9487a2fcaae0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:43.279241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cabc66-2a00-491e-a91e-9487a2fcaae0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:24:43.279573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cabc66-2a00-491e-a91e-9487a2fcaae0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:43.281186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cabc66-2a00-491e-a91e-9487a2fcaae0 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:43.292616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1137/2293] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:24:43.296826 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b182e-6c89-4664-bf97-3bb53ba98d3a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:43.305994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74b182e-6c89-4664-bf97-3bb53ba98d3a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:43.310553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87f691-c6ad-4df7-a31e-a5bfa951d26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:43.311778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87f691-c6ad-4df7-a31e-a5bfa951d26f admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:43.312051 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87f691-c6ad-4df7-a31e-a5bfa951d26f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:43.312318 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87f691-c6ad-4df7-a31e-a5bfa951d26f admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:43.312978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87f691-c6ad-4df7-a31e-a5bfa951d26f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:43.314889 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87f691-c6ad-4df7-a31e-a5bfa951d26f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:43.342627 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1157/2294] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:24:43 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:43.346818 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cabc66-2a00-491e-a91e-9487a2fcaae0 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:43.356792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cabc66-2a00-491e-a91e-9487a2fcaae0 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:43.415065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a88252-f3c4-42b2-bd8b-671b2bc81041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:43.415686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a88252-f3c4-42b2-bd8b-671b2bc81041 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:43.417465 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a88252-f3c4-42b2-bd8b-671b2bc81041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:43.417753 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a88252-f3c4-42b2-bd8b-671b2bc81041 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:43.418416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a88252-f3c4-42b2-bd8b-671b2bc81041 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:43.422815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a88252-f3c4-42b2-bd8b-671b2bc81041 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:43.444471 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1138/2295] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:24:43 2022] POST /identity/v3/users => generated 284 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:43.448791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87f691-c6ad-4df7-a31e-a5bfa951d26f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:43.459964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87f691-c6ad-4df7-a31e-a5bfa951d26f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:43.464723 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5a26e-03f5-4558-bc59-9a8b43e7073f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:43.465330 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5a26e-03f5-4558-bc59-9a8b43e7073f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:43.465612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5a26e-03f5-4558-bc59-9a8b43e7073f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:43.465882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc5a26e-03f5-4558-bc59-9a8b43e7073f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:43.466569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5a26e-03f5-4558-bc59-9a8b43e7073f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:43.468216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc5a26e-03f5-4558-bc59-9a8b43e7073f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:43.478553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1158/2296] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:43.483163 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a88252-f3c4-42b2-bd8b-671b2bc81041 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:43.494288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a88252-f3c4-42b2-bd8b-671b2bc81041 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:43.499616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e8973-d71f-4f3e-88aa-6c3846374f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:43.500217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e8973-d71f-4f3e-88aa-6c3846374f18 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:43.500490 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e8973-d71f-4f3e-88aa-6c3846374f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:43.500753 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752e8973-d71f-4f3e-88aa-6c3846374f18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:43.501469 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e8973-d71f-4f3e-88aa-6c3846374f18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:43.503095 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752e8973-d71f-4f3e-88aa-6c3846374f18 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:43.513402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1139/2297] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:43.517523 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5a26e-03f5-4558-bc59-9a8b43e7073f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:43.527667 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc5a26e-03f5-4558-bc59-9a8b43e7073f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:43.532210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21597a6-7e5f-406c-a707-88870968e35e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:43.532884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21597a6-7e5f-406c-a707-88870968e35e admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:43.533162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21597a6-7e5f-406c-a707-88870968e35e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:43.533434 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21597a6-7e5f-406c-a707-88870968e35e admin admin] PATH_INFO: `/v3/projects/0fddac42bd224a63a8bf1e7959b4ca60/users/6cf492ec172240ce8a9e8158ebd472ea/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:43.548617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21597a6-7e5f-406c-a707-88870968e35e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fddac42bd224a63a8bf1e7959b4ca60, user_id=6cf492ec172240ce8a9e8158ebd472ea, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:43.551308 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21597a6-7e5f-406c-a707-88870968e35e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:43.560104 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:43.567470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1159/2298] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:43 2022] PUT /identity/v3/projects/0fddac42bd224a63a8bf1e7959b4ca60/users/6cf492ec172240ce8a9e8158ebd472ea/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:43.581069 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e8973-d71f-4f3e-88aa-6c3846374f18 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:43.583043 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-752e8973-d71f-4f3e-88aa-6c3846374f18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:43.596998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752e8973-d71f-4f3e-88aa-6c3846374f18 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:43.637760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb34bb-2264-4380-b094-0ebfd4c651c4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:43.638029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb34bb-2264-4380-b094-0ebfd4c651c4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:43.638313 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acb34bb-2264-4380-b094-0ebfd4c651c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:43.660843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cc0728-af03-4408-812e-90c15e01b7df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:43.661483 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc0728-af03-4408-812e-90c15e01b7df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:43.661758 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc0728-af03-4408-812e-90c15e01b7df admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:43.662025 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc0728-af03-4408-812e-90c15e01b7df admin admin] PATH_INFO: `/v3/users/f2f38a5a9c9243b7bd135fb8b5eb8b10` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:43.663207 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc0728-af03-4408-812e-90c15e01b7df admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2f38a5a9c9243b7bd135fb8b5eb8b10)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:43.665116 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cc0728-af03-4408-812e-90c15e01b7df admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:43.665967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2acb34bb-2264-4380-b094-0ebfd4c651c4 None None] MFA Rules not processed for user `6cf492ec172240ce8a9e8158ebd472ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:43.667458 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2acb34bb-2264-4380-b094-0ebfd4c651c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:43.738626 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-85cc0728-af03-4408-812e-90c15e01b7df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2f38a5a9c9243b7bd135fb8b5eb8b10'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:43.749256 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-85cc0728-af03-4408-812e-90c15e01b7df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2f38a5a9c9243b7bd135fb8b5eb8b10'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:43.751831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:43.754615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1160/2299] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:43 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:43.767470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb34bb-2264-4380-b094-0ebfd4c651c4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:43.768419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-85cc0728-af03-4408-812e-90c15e01b7df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2f38a5a9c9243b7bd135fb8b5eb8b10'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:43.769310 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-85cc0728-af03-4408-812e-90c15e01b7df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2f38a5a9c9243b7bd135fb8b5eb8b10'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:43.769690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2acb34bb-2264-4380-b094-0ebfd4c651c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:43.780460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-85cc0728-af03-4408-812e-90c15e01b7df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2f38a5a9c9243b7bd135fb8b5eb8b10'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:43.787396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1140/2300] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:43 2022] DELETE /identity/v3/users/f2f38a5a9c9243b7bd135fb8b5eb8b10 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:24:43.791559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d16b6-58ba-4ddb-9d2a-79432f04168c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:43.791844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d16b6-58ba-4ddb-9d2a-79432f04168c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:43.792114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2d16b6-58ba-4ddb-9d2a-79432f04168c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:43.812003 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-aa2d16b6-58ba-4ddb-9d2a-79432f04168c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:43.813221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-aa2d16b6-58ba-4ddb-9d2a-79432f04168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:43.837687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acb34bb-2264-4380-b094-0ebfd4c651c4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:43.884593 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1141/2301] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:43.893329 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c087c8-8570-4748-a108-aaaa5dd84b9c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc213ef64924074bd16152228913ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:43.893942 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c087c8-8570-4748-a108-aaaa5dd84b9c service glance] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:43.894269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c087c8-8570-4748-a108-aaaa5dd84b9c service glance] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:43.894446 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d16b6-58ba-4ddb-9d2a-79432f04168c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:43.894543 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c087c8-8570-4748-a108-aaaa5dd84b9c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:43.895814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-aa2d16b6-58ba-4ddb-9d2a-79432f04168c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:43.896262 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e2c087c8-8570-4748-a108-aaaa5dd84b9c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:43.960997 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2d16b6-58ba-4ddb-9d2a-79432f04168c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:43.964702 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c087c8-8570-4748-a108-aaaa5dd84b9c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:43.965221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955724b-b294-4c4e-9acd-7a7c40254f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:43.965841 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955724b-b294-4c4e-9acd-7a7c40254f74 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:43.966120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955724b-b294-4c4e-9acd-7a7c40254f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:43.966390 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f955724b-b294-4c4e-9acd-7a7c40254f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:43.967690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c087c8-8570-4748-a108-aaaa5dd84b9c service glance] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:43.971830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:43.978270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955724b-b294-4c4e-9acd-7a7c40254f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:43.980025 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f955724b-b294-4c4e-9acd-7a7c40254f74 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:43.987485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1161/2302] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:43 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:24:43.994619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1142/2303] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:44.288811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c087c8-8570-4748-a108-aaaa5dd84b9c service glance] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:44.290540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e2c087c8-8570-4748-a108-aaaa5dd84b9c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:44.322652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c087c8-8570-4748-a108-aaaa5dd84b9c service glance] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:44.330406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d837b3d1-fd77-4567-b089-385e9622994b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:44.331162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837b3d1-fd77-4567-b089-385e9622994b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:44.331448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837b3d1-fd77-4567-b089-385e9622994b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:44.332648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d837b3d1-fd77-4567-b089-385e9622994b admin admin] PATH_INFO: `/v3/projects/a8ef69e81ff8494084a72d8f9bd03875` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:44.333866 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837b3d1-fd77-4567-b089-385e9622994b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a8ef69e81ff8494084a72d8f9bd03875)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:44.335993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d837b3d1-fd77-4567-b089-385e9622994b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:44.398841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d837b3d1-fd77-4567-b089-385e9622994b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a8ef69e81ff8494084a72d8f9bd03875', 'request_id': 'req-d837b3d1-fd77-4567-b089-385e9622994b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:44.409367 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d837b3d1-fd77-4567-b089-385e9622994b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a8ef69e81ff8494084a72d8f9bd03875', 'request_id': 'req-d837b3d1-fd77-4567-b089-385e9622994b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:44.417705 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d837b3d1-fd77-4567-b089-385e9622994b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a8ef69e81ff8494084a72d8f9bd03875', 'request_id': 'req-d837b3d1-fd77-4567-b089-385e9622994b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:44.439221 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d837b3d1-fd77-4567-b089-385e9622994b admin admin] The token cache is being invalidate because project a8ef69e81ff8494084a72d8f9bd03875 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:44.439511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d837b3d1-fd77-4567-b089-385e9622994b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:44.440131 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d837b3d1-fd77-4567-b089-385e9622994b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:44.441694 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1162/2304] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:44 2022] DELETE /identity/v3/projects/a8ef69e81ff8494084a72d8f9bd03875 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:47.768034 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955724b-b294-4c4e-9acd-7a7c40254f74 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:47.769402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f955724b-b294-4c4e-9acd-7a7c40254f74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:47.781951 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f955724b-b294-4c4e-9acd-7a7c40254f74 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:47.837491 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73803c5d-c35b-4036-aae0-b9e1fe03bf67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:47.838125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73803c5d-c35b-4036-aae0-b9e1fe03bf67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:47.838407 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73803c5d-c35b-4036-aae0-b9e1fe03bf67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:47.838711 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73803c5d-c35b-4036-aae0-b9e1fe03bf67 admin admin] PATH_INFO: `/v3/users/b9be112d07e14bf6b43e764e01a38884` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:47.839994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73803c5d-c35b-4036-aae0-b9e1fe03bf67 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9be112d07e14bf6b43e764e01a38884)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:47.841935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73803c5d-c35b-4036-aae0-b9e1fe03bf67 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:47.862223 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:47.887159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-73803c5d-c35b-4036-aae0-b9e1fe03bf67 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9be112d07e14bf6b43e764e01a38884'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:47.894416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-73803c5d-c35b-4036-aae0-b9e1fe03bf67 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9be112d07e14bf6b43e764e01a38884'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:47.906509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-73803c5d-c35b-4036-aae0-b9e1fe03bf67 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9be112d07e14bf6b43e764e01a38884'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:47.907172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-73803c5d-c35b-4036-aae0-b9e1fe03bf67 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9be112d07e14bf6b43e764e01a38884'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:47.914156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-73803c5d-c35b-4036-aae0-b9e1fe03bf67 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9be112d07e14bf6b43e764e01a38884'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:47.920148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1143/2305] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:24:47 2022] DELETE /identity/v3/users/b9be112d07e14bf6b43e764e01a38884 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:47.925219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1233a-265e-4340-945b-b907aa13aa27 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:47.925702 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1233a-265e-4340-945b-b907aa13aa27 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:47.925807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e1233a-265e-4340-945b-b907aa13aa27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:47.945243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-26e1233a-265e-4340-945b-b907aa13aa27 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:47.946428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-26e1233a-265e-4340-945b-b907aa13aa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:48.013249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1163/2306] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:24:48.023243 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73803c5d-c35b-4036-aae0-b9e1fe03bf67 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:48.024582 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-73803c5d-c35b-4036-aae0-b9e1fe03bf67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:48.082812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73803c5d-c35b-4036-aae0-b9e1fe03bf67 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:48.086465 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fd50b7-d9d6-44a1-9860-32d14cea03e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:48.087137 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd50b7-d9d6-44a1-9860-32d14cea03e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:48.087417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd50b7-d9d6-44a1-9860-32d14cea03e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:48.087689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fd50b7-d9d6-44a1-9860-32d14cea03e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:48.097047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd50b7-d9d6-44a1-9860-32d14cea03e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:48.098488 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fd50b7-d9d6-44a1-9860-32d14cea03e0 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:48.107834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1144/2307] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:48.383527 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1233a-265e-4340-945b-b907aa13aa27 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:48.384983 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-26e1233a-265e-4340-945b-b907aa13aa27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:48.399427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e1233a-265e-4340-945b-b907aa13aa27 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:48.404339 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5df1971-0906-46c4-961e-6ac3fdea45af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:48.405216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df1971-0906-46c4-961e-6ac3fdea45af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:48.405495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df1971-0906-46c4-961e-6ac3fdea45af admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:48.405764 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5df1971-0906-46c4-961e-6ac3fdea45af admin admin] PATH_INFO: `/v3/projects/1ab2b13f3cfe4f4b8a699a95f6d27f6a` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:48.407024 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df1971-0906-46c4-961e-6ac3fdea45af admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ab2b13f3cfe4f4b8a699a95f6d27f6a)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:48.408895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5df1971-0906-46c4-961e-6ac3fdea45af admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:48.458978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f5df1971-0906-46c4-961e-6ac3fdea45af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ab2b13f3cfe4f4b8a699a95f6d27f6a', 'request_id': 'req-f5df1971-0906-46c4-961e-6ac3fdea45af'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:48.467236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f5df1971-0906-46c4-961e-6ac3fdea45af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ab2b13f3cfe4f4b8a699a95f6d27f6a', 'request_id': 'req-f5df1971-0906-46c4-961e-6ac3fdea45af'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:48.473506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f5df1971-0906-46c4-961e-6ac3fdea45af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ab2b13f3cfe4f4b8a699a95f6d27f6a', 'request_id': 'req-f5df1971-0906-46c4-961e-6ac3fdea45af'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:48.487486 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f5df1971-0906-46c4-961e-6ac3fdea45af admin admin] The token cache is being invalidate because project 1ab2b13f3cfe4f4b8a699a95f6d27f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:24:48.487980 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f5df1971-0906-46c4-961e-6ac3fdea45af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:48.488856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-f5df1971-0906-46c4-961e-6ac3fdea45af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:24:48.491465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1164/2308] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:24:48 2022] DELETE /identity/v3/projects/1ab2b13f3cfe4f4b8a699a95f6d27f6a => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:48.497306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3421a-5cca-4777-9307-6535d14c5ddf None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:48.497584 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3421a-5cca-4777-9307-6535d14c5ddf None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:48.497834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a3421a-5cca-4777-9307-6535d14c5ddf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:48.520043 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b0a3421a-5cca-4777-9307-6535d14c5ddf None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:48.521271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b0a3421a-5cca-4777-9307-6535d14c5ddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:48.589734 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1145/2309] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:48.597626 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f0065-261e-41c4-a2bf-deb528beb574 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:48.598068 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f0065-261e-41c4-a2bf-deb528beb574 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:48.598401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7f0065-261e-41c4-a2bf-deb528beb574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:48.611097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:48.628714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ea7f0065-261e-41c4-a2bf-deb528beb574 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:48.629927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ea7f0065-261e-41c4-a2bf-deb528beb574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:48.638097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1165/2310] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:48.642356 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3421a-5cca-4777-9307-6535d14c5ddf None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:48.652110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a3421a-5cca-4777-9307-6535d14c5ddf None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:48.656714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557c258-e2bc-4b28-900f-55583a21c575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:48.657320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557c258-e2bc-4b28-900f-55583a21c575 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:48.657600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557c258-e2bc-4b28-900f-55583a21c575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:48.657875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557c258-e2bc-4b28-900f-55583a21c575 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:48.658563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557c258-e2bc-4b28-900f-55583a21c575 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:24:48.658896 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557c258-e2bc-4b28-900f-55583a21c575 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:48.660505 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557c258-e2bc-4b28-900f-55583a21c575 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:48.672457 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1146/2311] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:24:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:24:48.676984 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f0065-261e-41c4-a2bf-deb528beb574 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:48.686176 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7f0065-261e-41c4-a2bf-deb528beb574 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:48.691999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91854c-883b-4606-95b7-974138817083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:48.692598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91854c-883b-4606-95b7-974138817083 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:48.692925 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91854c-883b-4606-95b7-974138817083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:48.693199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee91854c-883b-4606-95b7-974138817083 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:48.693856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91854c-883b-4606-95b7-974138817083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:48.697008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee91854c-883b-4606-95b7-974138817083 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:48.736788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1166/2312] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:24:48 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:48.739704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557c258-e2bc-4b28-900f-55583a21c575 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:48.752680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557c258-e2bc-4b28-900f-55583a21c575 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:48.799583 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:48.834329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5217c-dd17-4da8-b8e3-cc2af040287d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:48.834982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5217c-dd17-4da8-b8e3-cc2af040287d admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:48.835259 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5217c-dd17-4da8-b8e3-cc2af040287d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:48.835529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c5217c-dd17-4da8-b8e3-cc2af040287d admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:48.836171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5217c-dd17-4da8-b8e3-cc2af040287d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:48.838128 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c5217c-dd17-4da8-b8e3-cc2af040287d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:48.860342 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1147/2313] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:24:48 2022] POST /identity/v3/users => generated 287 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:48.864452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91854c-883b-4606-95b7-974138817083 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:48.875420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee91854c-883b-4606-95b7-974138817083 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:48.880484 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad3480-9b0b-4bea-bbf4-248c528f1d0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:48.881084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad3480-9b0b-4bea-bbf4-248c528f1d0a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:48.881391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad3480-9b0b-4bea-bbf4-248c528f1d0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:48.881658 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ad3480-9b0b-4bea-bbf4-248c528f1d0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:48.882338 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad3480-9b0b-4bea-bbf4-248c528f1d0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:48.883977 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ad3480-9b0b-4bea-bbf4-248c528f1d0a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:48.894951 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1167/2314] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:48.898942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5217c-dd17-4da8-b8e3-cc2af040287d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:48.908991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c5217c-dd17-4da8-b8e3-cc2af040287d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:48.913795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1aacc4-3de3-4272-87dd-811315beb55c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:48.914430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aacc4-3de3-4272-87dd-811315beb55c admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:48.914775 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aacc4-3de3-4272-87dd-811315beb55c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:48.915053 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1aacc4-3de3-4272-87dd-811315beb55c admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:48.915888 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1aacc4-3de3-4272-87dd-811315beb55c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:48.918348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1aacc4-3de3-4272-87dd-811315beb55c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:48.930834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1148/2315] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:48.934977 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad3480-9b0b-4bea-bbf4-248c528f1d0a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:48.947664 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ad3480-9b0b-4bea-bbf4-248c528f1d0a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:48.953070 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb99daf-af93-4b16-96f4-f2b987b36560 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:48.953790 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb99daf-af93-4b16-96f4-f2b987b36560 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:48.954072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb99daf-af93-4b16-96f4-f2b987b36560 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:48.954347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb99daf-af93-4b16-96f4-f2b987b36560 admin admin] PATH_INFO: `/v3/projects/9e29a746ab1c4a7a9566d4096aa29bf6/users/272b9bd66acc4415bf3a056e719433fe/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:48.969725 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb99daf-af93-4b16-96f4-f2b987b36560 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e29a746ab1c4a7a9566d4096aa29bf6, user_id=272b9bd66acc4415bf3a056e719433fe, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:48.972419 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb99daf-af93-4b16-96f4-f2b987b36560 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:48.988127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1168/2316] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:48 2022] PUT /identity/v3/projects/9e29a746ab1c4a7a9566d4096aa29bf6/users/272b9bd66acc4415bf3a056e719433fe/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:24:48.994815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34f9a9-1983-4997-8860-1a1f3f3e54a7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:48.995106 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34f9a9-1983-4997-8860-1a1f3f3e54a7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:48.995378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe34f9a9-1983-4997-8860-1a1f3f3e54a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:49.016300 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-fe34f9a9-1983-4997-8860-1a1f3f3e54a7 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:49.017754 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fe34f9a9-1983-4997-8860-1a1f3f3e54a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:49.081881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1149/2317] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:49.091967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb99daf-af93-4b16-96f4-f2b987b36560 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:49.093732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7bb99daf-af93-4b16-96f4-f2b987b36560 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:49.163791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb99daf-af93-4b16-96f4-f2b987b36560 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:49.167624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ec4ba-21a5-42d2-9803-e888c465af1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:49.168240 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ec4ba-21a5-42d2-9803-e888c465af1f service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:49.168558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ec4ba-21a5-42d2-9803-e888c465af1f service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:49.168822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467ec4ba-21a5-42d2-9803-e888c465af1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:49.179752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ec4ba-21a5-42d2-9803-e888c465af1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:49.181185 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467ec4ba-21a5-42d2-9803-e888c465af1f service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:49.191750 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1169/2318] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:24:53.352580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28ceb3-7111-4813-8f59-a727c5847436 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:53.353113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28ceb3-7111-4813-8f59-a727c5847436 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:53.353325 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28ceb3-7111-4813-8f59-a727c5847436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:53.383904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-bf28ceb3-7111-4813-8f59-a727c5847436 None None] MFA Rules not processed for user `272b9bd66acc4415bf3a056e719433fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:53.385155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bf28ceb3-7111-4813-8f59-a727c5847436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:53.455509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1150/2319] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:53 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:53.460005 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ec4ba-21a5-42d2-9803-e888c465af1f service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:53.470171 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467ec4ba-21a5-42d2-9803-e888c465af1f service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:53.474863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a9913-6a18-40e1-8f62-d2b8989b9472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:53.475478 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a9913-6a18-40e1-8f62-d2b8989b9472 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:53.475759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a9913-6a18-40e1-8f62-d2b8989b9472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:53.476033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a9913-6a18-40e1-8f62-d2b8989b9472 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:53.476694 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a9913-6a18-40e1-8f62-d2b8989b9472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:53.478637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a9913-6a18-40e1-8f62-d2b8989b9472 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:53.508067 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1170/2320] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:24:53 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:24:53.512096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28ceb3-7111-4813-8f59-a727c5847436 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:53.524219 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28ceb3-7111-4813-8f59-a727c5847436 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:53.558892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:53.597285 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c6c66-1087-4c3f-afc0-0991ee683bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:53.597933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c6c66-1087-4c3f-afc0-0991ee683bb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:53.598214 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c6c66-1087-4c3f-afc0-0991ee683bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:53.598493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c6c66-1087-4c3f-afc0-0991ee683bb5 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:53.599205 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c6c66-1087-4c3f-afc0-0991ee683bb5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:53.601256 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c6c66-1087-4c3f-afc0-0991ee683bb5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:53.626504 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1151/2321] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:24:53 2022] POST /identity/v3/users => generated 293 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:24:53.631152 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a9913-6a18-40e1-8f62-d2b8989b9472 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:53.643799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a9913-6a18-40e1-8f62-d2b8989b9472 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:53.649803 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c8020-81ee-4e7f-a926-96d9faec665b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:53.650530 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c8020-81ee-4e7f-a926-96d9faec665b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:53.650793 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c8020-81ee-4e7f-a926-96d9faec665b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:53.651114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0c8020-81ee-4e7f-a926-96d9faec665b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:53.651816 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c8020-81ee-4e7f-a926-96d9faec665b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:53.653518 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0c8020-81ee-4e7f-a926-96d9faec665b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:53.665226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1171/2322] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:53.669548 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c6c66-1087-4c3f-afc0-0991ee683bb5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:53.680676 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c6c66-1087-4c3f-afc0-0991ee683bb5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:53.686150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31bfa4-6314-4adc-b497-1782ed20dc2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:53.687524 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31bfa4-6314-4adc-b497-1782ed20dc2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:53.687802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31bfa4-6314-4adc-b497-1782ed20dc2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:53.688077 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca31bfa4-6314-4adc-b497-1782ed20dc2b admin admin] PATH_INFO: `/v3/projects/f781628fbfe64369b0ce078d141960bc/users/8a93a7a7dd7941a693beb73f55508e19/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:53.704414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31bfa4-6314-4adc-b497-1782ed20dc2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f781628fbfe64369b0ce078d141960bc, user_id=8a93a7a7dd7941a693beb73f55508e19, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:53.707159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca31bfa4-6314-4adc-b497-1782ed20dc2b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:53.721436 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1152/2323] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:53 2022] PUT /identity/v3/projects/f781628fbfe64369b0ce078d141960bc/users/8a93a7a7dd7941a693beb73f55508e19/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:24:53.725588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c8020-81ee-4e7f-a926-96d9faec665b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:53.737532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0c8020-81ee-4e7f-a926-96d9faec665b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:53.819545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec5c12-b47a-4f2c-a1a9-a8b2687f83ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:53.820173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec5c12-b47a-4f2c-a1a9-a8b2687f83ab admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:53.820453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec5c12-b47a-4f2c-a1a9-a8b2687f83ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:53.820724 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec5c12-b47a-4f2c-a1a9-a8b2687f83ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:53.821422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec5c12-b47a-4f2c-a1a9-a8b2687f83ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:53.823079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ec5c12-b47a-4f2c-a1a9-a8b2687f83ab admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:53.833959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1172/2324] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:24:53 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:24:53.838127 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31bfa4-6314-4adc-b497-1782ed20dc2b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:53.848938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca31bfa4-6314-4adc-b497-1782ed20dc2b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:53.854021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae940ca-497a-4a67-9472-23b711604b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:53.854807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae940ca-497a-4a67-9472-23b711604b8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:53.855090 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae940ca-497a-4a67-9472-23b711604b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:53.855504 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae940ca-497a-4a67-9472-23b711604b8b admin admin] PATH_INFO: `/v3/projects/f781628fbfe64369b0ce078d141960bc/users/8a93a7a7dd7941a693beb73f55508e19/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:53.862454 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae940ca-497a-4a67-9472-23b711604b8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=f781628fbfe64369b0ce078d141960bc, user_id=8a93a7a7dd7941a693beb73f55508e19, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:53.869780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae940ca-497a-4a67-9472-23b711604b8b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:53.883971 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1153/2325] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:24:53 2022] PUT /identity/v3/projects/f781628fbfe64369b0ce078d141960bc/users/8a93a7a7dd7941a693beb73f55508e19/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:24:58.642958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee6187-9822-408c-9747-220c817fdb30 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:58.643540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee6187-9822-408c-9747-220c817fdb30 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:58.643540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ee6187-9822-408c-9747-220c817fdb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:58.657214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:24:58.684611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e2ee6187-9822-408c-9747-220c817fdb30 None None] MFA Rules not processed for user `8a93a7a7dd7941a693beb73f55508e19`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:24:58.685850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e2ee6187-9822-408c-9747-220c817fdb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:58.811885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1173/2326] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:24:58 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:24:58.831751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae940ca-497a-4a67-9472-23b711604b8b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:24:58.834183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2ae940ca-497a-4a67-9472-23b711604b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:24:58.923744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae940ca-497a-4a67-9472-23b711604b8b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:24:58.929406 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0378db-02bd-4b46-88f4-006d9d72d762 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:24:58.930031 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0378db-02bd-4b46-88f4-006d9d72d762 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:24:58.930311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0378db-02bd-4b46-88f4-006d9d72d762 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:24:58.930595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0378db-02bd-4b46-88f4-006d9d72d762 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:24:58.991479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0378db-02bd-4b46-88f4-006d9d72d762 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:24:58.993110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0378db-02bd-4b46-88f4-006d9d72d762 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:24:59.003728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1154/2327] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:24:58 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:25:00.257666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecda69-fe28-4063-bd25-ba7a6f53d28a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:00.258239 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecda69-fe28-4063-bd25-ba7a6f53d28a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:00.258239 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fecda69-fe28-4063-bd25-ba7a6f53d28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:00.281805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7fecda69-fe28-4063-bd25-ba7a6f53d28a None None] MFA Rules not processed for user `272b9bd66acc4415bf3a056e719433fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:00.283245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7fecda69-fe28-4063-bd25-ba7a6f53d28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:00.292741 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1174/2328] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:25:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:25:08.998846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=84,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:10.274838 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=34 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:17.247621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0378db-02bd-4b46-88f4-006d9d72d762 service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:17.249089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0a0378db-02bd-4b46-88f4-006d9d72d762 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:17.335565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0378db-02bd-4b46-88f4-006d9d72d762 service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:17.342112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79408bcd-8437-4781-9f50-f77105bdba52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:17.342811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79408bcd-8437-4781-9f50-f77105bdba52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:17.343092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79408bcd-8437-4781-9f50-f77105bdba52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:17.343487 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79408bcd-8437-4781-9f50-f77105bdba52 admin admin] PATH_INFO: `/v3/users/6cf492ec172240ce8a9e8158ebd472ea` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:17.344716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79408bcd-8437-4781-9f50-f77105bdba52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cf492ec172240ce8a9e8158ebd472ea)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:17.346759 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79408bcd-8437-4781-9f50-f77105bdba52 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:17.398611 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-79408bcd-8437-4781-9f50-f77105bdba52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cf492ec172240ce8a9e8158ebd472ea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:17.408622 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-79408bcd-8437-4781-9f50-f77105bdba52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cf492ec172240ce8a9e8158ebd472ea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:17.423557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-79408bcd-8437-4781-9f50-f77105bdba52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cf492ec172240ce8a9e8158ebd472ea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:17.424267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-79408bcd-8437-4781-9f50-f77105bdba52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cf492ec172240ce8a9e8158ebd472ea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:17.432408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-79408bcd-8437-4781-9f50-f77105bdba52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cf492ec172240ce8a9e8158ebd472ea'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:17.438822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1155/2329] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:25:17 2022] DELETE /identity/v3/users/6cf492ec172240ce8a9e8158ebd472ea => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:25:17.443371 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112691-a24e-48ca-b175-5ba829b5599e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:17.443885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112691-a24e-48ca-b175-5ba829b5599e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:17.443997 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c112691-a24e-48ca-b175-5ba829b5599e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:17.464800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9c112691-a24e-48ca-b175-5ba829b5599e None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:17.466128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9c112691-a24e-48ca-b175-5ba829b5599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:17.526123 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1175/2330] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:25:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:25:17.536559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79408bcd-8437-4781-9f50-f77105bdba52 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:17.537958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-79408bcd-8437-4781-9f50-f77105bdba52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:17.608453 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79408bcd-8437-4781-9f50-f77105bdba52 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:17.612116 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc89858-12fd-43bc-9491-2ab4fa0ae2bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:17.613073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc89858-12fd-43bc-9491-2ab4fa0ae2bd service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:17.613073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc89858-12fd-43bc-9491-2ab4fa0ae2bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:17.613270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc89858-12fd-43bc-9491-2ab4fa0ae2bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:17.623706 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc89858-12fd-43bc-9491-2ab4fa0ae2bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:17.625184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc89858-12fd-43bc-9491-2ab4fa0ae2bd service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:17.635699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1156/2331] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:25:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:25:18.012795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c112691-a24e-48ca-b175-5ba829b5599e None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:18.016487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9c112691-a24e-48ca-b175-5ba829b5599e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:18.028581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c112691-a24e-48ca-b175-5ba829b5599e None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:18.033824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c575dbe-0dec-4bec-8cd3-fa10a15276d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:18.034487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c575dbe-0dec-4bec-8cd3-fa10a15276d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:18.034796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c575dbe-0dec-4bec-8cd3-fa10a15276d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:18.035069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c575dbe-0dec-4bec-8cd3-fa10a15276d1 admin admin] PATH_INFO: `/v3/projects/0fddac42bd224a63a8bf1e7959b4ca60` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:18.036236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c575dbe-0dec-4bec-8cd3-fa10a15276d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fddac42bd224a63a8bf1e7959b4ca60)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:18.038139 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c575dbe-0dec-4bec-8cd3-fa10a15276d1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:18.090058 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3c575dbe-0dec-4bec-8cd3-fa10a15276d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fddac42bd224a63a8bf1e7959b4ca60', 'request_id': 'req-3c575dbe-0dec-4bec-8cd3-fa10a15276d1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:18.096439 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3c575dbe-0dec-4bec-8cd3-fa10a15276d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fddac42bd224a63a8bf1e7959b4ca60', 'request_id': 'req-3c575dbe-0dec-4bec-8cd3-fa10a15276d1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:18.102011 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3c575dbe-0dec-4bec-8cd3-fa10a15276d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fddac42bd224a63a8bf1e7959b4ca60', 'request_id': 'req-3c575dbe-0dec-4bec-8cd3-fa10a15276d1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:18.115127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3c575dbe-0dec-4bec-8cd3-fa10a15276d1 admin admin] The token cache is being invalidate because project 0fddac42bd224a63a8bf1e7959b4ca60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:25:18.115415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3c575dbe-0dec-4bec-8cd3-fa10a15276d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:18.116065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3c575dbe-0dec-4bec-8cd3-fa10a15276d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:25:18.117619 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1176/2332] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:25:18 2022] DELETE /identity/v3/projects/0fddac42bd224a63a8bf1e7959b4ca60 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:25:18.123203 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac3364-e0f1-46de-a892-848479a98b11 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:18.123494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac3364-e0f1-46de-a892-848479a98b11 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:18.123774 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ac3364-e0f1-46de-a892-848479a98b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:18.143597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-04ac3364-e0f1-46de-a892-848479a98b11 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:18.144812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-04ac3364-e0f1-46de-a892-848479a98b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:18.162091 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:18.207121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1157/2333] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:25:18.215197 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da7331-a065-424e-b0d7-2983780e830c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:18.215483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da7331-a065-424e-b0d7-2983780e830c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:18.215789 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da7331-a065-424e-b0d7-2983780e830c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:18.235971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e6da7331-a065-424e-b0d7-2983780e830c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:18.237162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e6da7331-a065-424e-b0d7-2983780e830c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:18.245432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1177/2334] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:25:18.250378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac3364-e0f1-46de-a892-848479a98b11 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:18.260241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ac3364-e0f1-46de-a892-848479a98b11 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:18.265399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcc167-6757-4568-9d4a-27796d10c906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:18.266021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcc167-6757-4568-9d4a-27796d10c906 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:18.266300 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcc167-6757-4568-9d4a-27796d10c906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:18.266570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcc167-6757-4568-9d4a-27796d10c906 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:18.267291 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcc167-6757-4568-9d4a-27796d10c906 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:25:18.267591 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcc167-6757-4568-9d4a-27796d10c906 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:18.269197 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fcc167-6757-4568-9d4a-27796d10c906 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:18.280920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1158/2335] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:25:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:25:18.285328 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da7331-a065-424e-b0d7-2983780e830c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:18.294808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da7331-a065-424e-b0d7-2983780e830c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:18.299529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7a1d5-2c0a-41ae-b4f6-a3eb21efa8db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:18.300163 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7a1d5-2c0a-41ae-b4f6-a3eb21efa8db admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:18.300441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7a1d5-2c0a-41ae-b4f6-a3eb21efa8db admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:18.301677 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f7a1d5-2c0a-41ae-b4f6-a3eb21efa8db admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:18.302345 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7a1d5-2c0a-41ae-b4f6-a3eb21efa8db admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:18.304275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f7a1d5-2c0a-41ae-b4f6-a3eb21efa8db admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:18.333936 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1178/2336] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:25:18 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:25:18.338291 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcc167-6757-4568-9d4a-27796d10c906 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:18.348501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcc167-6757-4568-9d4a-27796d10c906 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:18.405560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3c7d9-8def-4108-b985-903a4e1a9f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:18.406185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3c7d9-8def-4108-b985-903a4e1a9f06 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:18.406465 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3c7d9-8def-4108-b985-903a4e1a9f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:18.406778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3c7d9-8def-4108-b985-903a4e1a9f06 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:18.407451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3c7d9-8def-4108-b985-903a4e1a9f06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:18.409394 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc3c7d9-8def-4108-b985-903a4e1a9f06 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:18.431138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1159/2337] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:25:18 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:25:18.435835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7a1d5-2c0a-41ae-b4f6-a3eb21efa8db admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:18.446039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f7a1d5-2c0a-41ae-b4f6-a3eb21efa8db admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:18.450888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138ac0d-f14a-491e-802f-07bd6bd20859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:18.451489 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138ac0d-f14a-491e-802f-07bd6bd20859 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:18.451767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138ac0d-f14a-491e-802f-07bd6bd20859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:18.452301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b138ac0d-f14a-491e-802f-07bd6bd20859 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:18.452978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138ac0d-f14a-491e-802f-07bd6bd20859 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:18.454557 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b138ac0d-f14a-491e-802f-07bd6bd20859 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:18.464511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1179/2338] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:25:18.468522 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3c7d9-8def-4108-b985-903a4e1a9f06 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:18.478861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3c7d9-8def-4108-b985-903a4e1a9f06 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:18.484069 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d409627b-e09c-4a00-a8df-8b902055b110 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:18.484678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409627b-e09c-4a00-a8df-8b902055b110 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:18.484956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409627b-e09c-4a00-a8df-8b902055b110 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:18.485229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d409627b-e09c-4a00-a8df-8b902055b110 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:18.485922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409627b-e09c-4a00-a8df-8b902055b110 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:18.487579 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d409627b-e09c-4a00-a8df-8b902055b110 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:18.499050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1160/2339] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:25:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:25:18.503316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138ac0d-f14a-491e-802f-07bd6bd20859 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:18.513291 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b138ac0d-f14a-491e-802f-07bd6bd20859 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:18.517918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04b3c0-0e26-4ac1-9201-b332c5e059e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:18.518623 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04b3c0-0e26-4ac1-9201-b332c5e059e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:18.518905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04b3c0-0e26-4ac1-9201-b332c5e059e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:18.519173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db04b3c0-0e26-4ac1-9201-b332c5e059e0 admin admin] PATH_INFO: `/v3/projects/890799b9312440c2b993e7db9f5b4d57/users/1138cc04064443c098f4c2e87b02dd0a/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:18.534383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04b3c0-0e26-4ac1-9201-b332c5e059e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=890799b9312440c2b993e7db9f5b4d57, user_id=1138cc04064443c098f4c2e87b02dd0a, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:18.536515 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db04b3c0-0e26-4ac1-9201-b332c5e059e0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:18.549815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1180/2340] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:25:18 2022] PUT /identity/v3/projects/890799b9312440c2b993e7db9f5b4d57/users/1138cc04064443c098f4c2e87b02dd0a/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:25:18.554935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecfbe0-710f-458b-8944-4dffbcf4baf6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:18.555244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecfbe0-710f-458b-8944-4dffbcf4baf6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:18.555502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdecfbe0-710f-458b-8944-4dffbcf4baf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:18.574824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-bdecfbe0-710f-458b-8944-4dffbcf4baf6 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:18.576062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bdecfbe0-710f-458b-8944-4dffbcf4baf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:18.637189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1161/2341] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:25:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:25:18.654429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04b3c0-0e26-4ac1-9201-b332c5e059e0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:18.656738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-db04b3c0-0e26-4ac1-9201-b332c5e059e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:18.682694 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:18.739722 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db04b3c0-0e26-4ac1-9201-b332c5e059e0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:18.745267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266a014-d990-4e45-899b-23196c220f53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:18.745892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266a014-d990-4e45-899b-23196c220f53 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:18.746323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266a014-d990-4e45-899b-23196c220f53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:18.746888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7266a014-d990-4e45-899b-23196c220f53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:18.763974 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266a014-d990-4e45-899b-23196c220f53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:18.766433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7266a014-d990-4e45-899b-23196c220f53 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:18.784092 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1181/2342] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:25:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:25:19.588653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92191b2-bccf-4973-aadb-59c065e1eaca None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:19.589426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92191b2-bccf-4973-aadb-59c065e1eaca None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:19.589426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92191b2-bccf-4973-aadb-59c065e1eaca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:19.619730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e92191b2-bccf-4973-aadb-59c065e1eaca None None] MFA Rules not processed for user `1138cc04064443c098f4c2e87b02dd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:19.620960 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e92191b2-bccf-4973-aadb-59c065e1eaca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:19.639299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:19.711571 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1162/2343] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:25:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:25:19.724518 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266a014-d990-4e45-899b-23196c220f53 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:19.726915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7266a014-d990-4e45-899b-23196c220f53 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:19.809616 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7266a014-d990-4e45-899b-23196c220f53 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:19.813915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa914a-dcfc-4574-8560-a49b3d9d474b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:19.814528 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa914a-dcfc-4574-8560-a49b3d9d474b service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:19.814841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa914a-dcfc-4574-8560-a49b3d9d474b service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:19.815115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48aa914a-dcfc-4574-8560-a49b3d9d474b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:19.823414 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa914a-dcfc-4574-8560-a49b3d9d474b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:19.824844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48aa914a-dcfc-4574-8560-a49b3d9d474b service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:19.835701 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1182/2344] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:25:19 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:25:21.217424 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410310d-bd42-4b55-9b0a-c551f9ed1802 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:21.217983 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410310d-bd42-4b55-9b0a-c551f9ed1802 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:21.217983 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d410310d-bd42-4b55-9b0a-c551f9ed1802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:21.238023 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d410310d-bd42-4b55-9b0a-c551f9ed1802 None None] MFA Rules not processed for user `1138cc04064443c098f4c2e87b02dd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:21.239282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d410310d-bd42-4b55-9b0a-c551f9ed1802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:21.246293 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1163/2345] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:25:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:25:22.344151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa914a-dcfc-4574-8560-a49b3d9d474b service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:22.345676 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-48aa914a-dcfc-4574-8560-a49b3d9d474b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:22.416824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48aa914a-dcfc-4574-8560-a49b3d9d474b service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:22.423625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0742d3f6-9b38-4d13-9926-5e4474dd1914 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210ee6c390849e7a630a677ec52e966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:22.424282 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742d3f6-9b38-4d13-9926-5e4474dd1914 service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:22.424603 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742d3f6-9b38-4d13-9926-5e4474dd1914 service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:22.424877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0742d3f6-9b38-4d13-9926-5e4474dd1914 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:22.427120 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0742d3f6-9b38-4d13-9926-5e4474dd1914 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:22.439707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742d3f6-9b38-4d13-9926-5e4474dd1914 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:22.441306 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0742d3f6-9b38-4d13-9926-5e4474dd1914 service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:22.451295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1183/2346] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:25:22 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:25:31.232047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=22 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:32.447006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=75 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:40.946495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410310d-bd42-4b55-9b0a-c551f9ed1802 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:40.956517 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d410310d-bd42-4b55-9b0a-c551f9ed1802 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:40.960004 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29253ed-4424-40fa-b9c7-683c3e49fc2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:40.960605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29253ed-4424-40fa-b9c7-683c3e49fc2f service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:40.960884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29253ed-4424-40fa-b9c7-683c3e49fc2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:40.961153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29253ed-4424-40fa-b9c7-683c3e49fc2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:40.962960 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a29253ed-4424-40fa-b9c7-683c3e49fc2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:41.026407 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29253ed-4424-40fa-b9c7-683c3e49fc2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:41.027892 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29253ed-4424-40fa-b9c7-683c3e49fc2f service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:41.038211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1164/2347] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:25:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:25:44.806248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a21e9-6da3-4d16-be3b-e821bd02ef94 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:44.806807 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a21e9-6da3-4d16-be3b-e821bd02ef94 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:44.806891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a21e9-6da3-4d16-be3b-e821bd02ef94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:44.827695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-212a21e9-6da3-4d16-be3b-e821bd02ef94 None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:25:44.828924 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-212a21e9-6da3-4d16-be3b-e821bd02ef94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:44.884937 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1184/2348] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 1 14:25:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:25:44.927818 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29253ed-4424-40fa-b9c7-683c3e49fc2f service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:25:44.929229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a29253ed-4424-40fa-b9c7-683c3e49fc2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:25:45.010153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29253ed-4424-40fa-b9c7-683c3e49fc2f service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:25:45.015876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e990b1cb-5aa5-4d6c-93c6-f8c54b5ba1f7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:25:45.016502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990b1cb-5aa5-4d6c-93c6-f8c54b5ba1f7 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:25:45.016783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990b1cb-5aa5-4d6c-93c6-f8c54b5ba1f7 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:25:45.017060 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e990b1cb-5aa5-4d6c-93c6-f8c54b5ba1f7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:25:45.025763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990b1cb-5aa5-4d6c-93c6-f8c54b5ba1f7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:25:45.027412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e990b1cb-5aa5-4d6c-93c6-f8c54b5ba1f7 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:25:45.035441 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1165/2349] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:25:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:25:54.878078 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=25 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:25:55.032218 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=62 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:05.192230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa622be-69a3-4ec4-a52f-bc7812a72cab None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:05.192948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa622be-69a3-4ec4-a52f-bc7812a72cab None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:05.192948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa622be-69a3-4ec4-a52f-bc7812a72cab None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:05.194631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1185/2350] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 1 14:26:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:26:05.202717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691492e-d52c-485b-8275-97481eb1ff69 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:05.203270 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691492e-d52c-485b-8275-97481eb1ff69 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:05.203386 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7691492e-d52c-485b-8275-97481eb1ff69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:05.223508 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7691492e-d52c-485b-8275-97481eb1ff69 None None] MFA Rules not processed for user `e856fd5aff914cfb8b8dd86b39c89bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:05.224771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7691492e-d52c-485b-8275-97481eb1ff69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:05.293888 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1166/2351] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 1 14:26:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:05.306734 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa622be-69a3-4ec4-a52f-bc7812a72cab None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:05.309002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-caa622be-69a3-4ec4-a52f-bc7812a72cab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:05.369602 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa622be-69a3-4ec4-a52f-bc7812a72cab None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:05.373727 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6efca-f8d6-4dad-946a-bd4aba0bb122 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc213ef64924074bd16152228913ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:05.374335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6efca-f8d6-4dad-946a-bd4aba0bb122 service glance] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:05.374646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6efca-f8d6-4dad-946a-bd4aba0bb122 service glance] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:05.374921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d6efca-f8d6-4dad-946a-bd4aba0bb122 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:05.384865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6efca-f8d6-4dad-946a-bd4aba0bb122 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:05.386306 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d6efca-f8d6-4dad-946a-bd4aba0bb122 service glance] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:05.394650 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d42e76-7660-457a-92f2-ba6d2c3f0c84 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:05.394945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d42e76-7660-457a-92f2-ba6d2c3f0c84 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:05.395226 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d42e76-7660-457a-92f2-ba6d2c3f0c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:05.397198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1186/2352] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:05.414889 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d8d42e76-7660-457a-92f2-ba6d2c3f0c84 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:05.416084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d8d42e76-7660-457a-92f2-ba6d2c3f0c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:05.424648 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1167/2353] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Aug 1 14:26:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:26:05.445822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6efca-f8d6-4dad-946a-bd4aba0bb122 service glance] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:05.447186 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-30d6efca-f8d6-4dad-946a-bd4aba0bb122 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:05.463303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d6efca-f8d6-4dad-946a-bd4aba0bb122 service glance] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:05.469271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd92c9-d340-48ce-bfd5-5bfa3a7822f7 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:05.469441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7d35c-0933-4bb0-9f5d-223b92445994 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:05.469578 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd92c9-d340-48ce-bfd5-5bfa3a7822f7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:05.470208 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7d35c-0933-4bb0-9f5d-223b92445994 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:05.470560 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7d35c-0933-4bb0-9f5d-223b92445994 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:05.470932 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d7d35c-0933-4bb0-9f5d-223b92445994 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:05.473337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbd92c9-d340-48ce-bfd5-5bfa3a7822f7 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:05.477024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1168/2354] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 1 14:26:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 01 14:26:05.483506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ce90b-0682-4303-80ca-04c8730011d5 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:05.484124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ce90b-0682-4303-80ca-04c8730011d5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:05.484464 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5ce90b-0682-4303-80ca-04c8730011d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:05.485024 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7d35c-0933-4bb0-9f5d-223b92445994 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:05.486514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d7d35c-0933-4bb0-9f5d-223b92445994 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:05.497684 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1187/2355] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:05.504289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8a5ce90b-0682-4303-80ca-04c8730011d5 None None] MFA Rules not processed for user `33fcc673845943fc96bc18f011639716`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:05.505476 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8a5ce90b-0682-4303-80ca-04c8730011d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:05.512081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1169/2356] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 1 14:26:05 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:26:05.523879 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7d35c-0933-4bb0-9f5d-223b92445994 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:05.533300 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d7d35c-0933-4bb0-9f5d-223b92445994 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:05.537007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb264cd0-21f2-4428-87cf-838b13a6d353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:05.537608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb264cd0-21f2-4428-87cf-838b13a6d353 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:05.537887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb264cd0-21f2-4428-87cf-838b13a6d353 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:05.538158 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb264cd0-21f2-4428-87cf-838b13a6d353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:05.546082 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb264cd0-21f2-4428-87cf-838b13a6d353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:05.547518 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb264cd0-21f2-4428-87cf-838b13a6d353 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:05.555600 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1188/2357] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 32 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:05.640836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667711-3c6e-4162-96c5-f5157428e0a8 None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:05.641255 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667711-3c6e-4162-96c5-f5157428e0a8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:05.641609 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35667711-3c6e-4162-96c5-f5157428e0a8 None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:05.643114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1170/2358] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 1 14:26:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:26:05.648597 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f8df5-81fe-485c-beea-43c22a4ee887 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:05.648891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f8df5-81fe-485c-beea-43c22a4ee887 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:05.649169 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28f8df5-81fe-485c-beea-43c22a4ee887 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:05.670552 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e28f8df5-81fe-485c-beea-43c22a4ee887 None None] MFA Rules not processed for user `e856fd5aff914cfb8b8dd86b39c89bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:05.671820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e28f8df5-81fe-485c-beea-43c22a4ee887 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:05.682526 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1189/2359] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 1 14:26:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:05.693953 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667711-3c6e-4162-96c5-f5157428e0a8 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:05.705408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35667711-3c6e-4162-96c5-f5157428e0a8 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:05.709340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a832274-e395-423e-ac20-9d32447b4aaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:05.709948 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832274-e395-423e-ac20-9d32447b4aaf service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:05.710229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832274-e395-423e-ac20-9d32447b4aaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:05.710505 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a832274-e395-423e-ac20-9d32447b4aaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:05.723033 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a832274-e395-423e-ac20-9d32447b4aaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:05.724515 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a832274-e395-423e-ac20-9d32447b4aaf service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:05.736005 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1171/2360] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:05 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:26:09.475873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15754f-35df-4c62-9dfd-609d90617ed5 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:09.475873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15754f-35df-4c62-9dfd-609d90617ed5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:09.476572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd15754f-35df-4c62-9dfd-609d90617ed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:09.497941 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-cd15754f-35df-4c62-9dfd-609d90617ed5 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:09.499189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cd15754f-35df-4c62-9dfd-609d90617ed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:09.507866 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1190/2361] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Aug 1 14:26:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:09.529935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a832274-e395-423e-ac20-9d32447b4aaf service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:09.541276 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a832274-e395-423e-ac20-9d32447b4aaf service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:09.547715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f934830-0645-41a8-bdbd-bdd449807547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:09.548364 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f934830-0645-41a8-bdbd-bdd449807547 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:09.548640 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f934830-0645-41a8-bdbd-bdd449807547 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:09.549033 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f934830-0645-41a8-bdbd-bdd449807547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:09.557744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f934830-0645-41a8-bdbd-bdd449807547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:09.559416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f934830-0645-41a8-bdbd-bdd449807547 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:09.569075 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1172/2362] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:26:12.213335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea872cb-8573-4019-b21a-8a4fe3593ce5 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:12.213823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea872cb-8573-4019-b21a-8a4fe3593ce5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:12.214533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea872cb-8573-4019-b21a-8a4fe3593ce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:12.235125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fea872cb-8573-4019-b21a-8a4fe3593ce5 None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:12.236327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fea872cb-8573-4019-b21a-8a4fe3593ce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:12.243749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1191/2363] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 1 14:26:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:12.264795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f934830-0645-41a8-bdbd-bdd449807547 service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:12.276146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f934830-0645-41a8-bdbd-bdd449807547 service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:12.281683 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849d62c-4e76-4650-9d90-dba08640dbc3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:12.282316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849d62c-4e76-4650-9d90-dba08640dbc3 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:12.282618 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849d62c-4e76-4650-9d90-dba08640dbc3 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:12.282900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0849d62c-4e76-4650-9d90-dba08640dbc3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:12.291652 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849d62c-4e76-4650-9d90-dba08640dbc3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:12.293280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0849d62c-4e76-4650-9d90-dba08640dbc3 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:12.302497 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1173/2364] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:26:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:26:13.878431 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7504a-a43b-458f-8e1e-3737c64fe4ed None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:13.879114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7504a-a43b-458f-8e1e-3737c64fe4ed None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:13.879536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7504a-a43b-458f-8e1e-3737c64fe4ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:13.899643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b1a7504a-a43b-458f-8e1e-3737c64fe4ed None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:13.900850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b1a7504a-a43b-458f-8e1e-3737c64fe4ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:13.909216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1192/2365] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Aug 1 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:13.932562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849d62c-4e76-4650-9d90-dba08640dbc3 service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:13.933976 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0849d62c-4e76-4650-9d90-dba08640dbc3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:13.951501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0849d62c-4e76-4650-9d90-dba08640dbc3 service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:13.965225 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c679f2d-6df6-484f-9531-b71a4c0368eb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:13.966267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c679f2d-6df6-484f-9531-b71a4c0368eb service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:13.966917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c679f2d-6df6-484f-9531-b71a4c0368eb service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:13.967472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c679f2d-6df6-484f-9531-b71a4c0368eb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:13.979108 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c679f2d-6df6-484f-9531-b71a4c0368eb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:13.981583 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c679f2d-6df6-484f-9531-b71a4c0368eb service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:13.992165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1174/2366] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:26:23.894151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=50 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:23.987850 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=61 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:34.469864 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384b8e4-b277-495d-98bf-d2ae0e025615 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:34.470405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384b8e4-b277-495d-98bf-d2ae0e025615 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:34.470526 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4384b8e4-b277-495d-98bf-d2ae0e025615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:34.490441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4384b8e4-b277-495d-98bf-d2ae0e025615 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:34.491680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4384b8e4-b277-495d-98bf-d2ae0e025615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:34.503832 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1193/2367] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Aug 1 14:26:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:34.528601 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c679f2d-6df6-484f-9531-b71a4c0368eb service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:34.539724 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c679f2d-6df6-484f-9531-b71a4c0368eb service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:34.545717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9dfed-c6c8-4037-8cea-3bb8182e968d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:34.546319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9dfed-c6c8-4037-8cea-3bb8182e968d service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:34.546621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9dfed-c6c8-4037-8cea-3bb8182e968d service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:34.546900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf9dfed-c6c8-4037-8cea-3bb8182e968d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:34.554985 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9dfed-c6c8-4037-8cea-3bb8182e968d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:34.556579 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf9dfed-c6c8-4037-8cea-3bb8182e968d service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:34.566403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1175/2368] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:37.465678 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583d747-33d6-4033-afa0-a8645d0b6e3d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:37.466134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583d747-33d6-4033-afa0-a8645d0b6e3d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:37.466237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583d747-33d6-4033-afa0-a8645d0b6e3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:37.503677 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5583d747-33d6-4033-afa0-a8645d0b6e3d None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:37.505033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5583d747-33d6-4033-afa0-a8645d0b6e3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:37.516038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1194/2369] 10.222.0.70 () {58 vars in 967 bytes} [Mon Aug 1 14:26:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:37.531312 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9dfed-c6c8-4037-8cea-3bb8182e968d service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:37.546731 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf9dfed-c6c8-4037-8cea-3bb8182e968d service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:37.555403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ab6f0-d437-49e2-81cc-165467f9a2f8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:37.556059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ab6f0-d437-49e2-81cc-165467f9a2f8 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:37.556342 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ab6f0-d437-49e2-81cc-165467f9a2f8 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:37.556616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ab6f0-d437-49e2-81cc-165467f9a2f8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:37.566032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ab6f0-d437-49e2-81cc-165467f9a2f8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:37.567661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873ab6f0-d437-49e2-81cc-165467f9a2f8 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:37.576093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1176/2370] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:26:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 01 14:26:40.701213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7430930-9550-45da-aaa0-07b884c24016 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:40.701703 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7430930-9550-45da-aaa0-07b884c24016 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:40.701799 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7430930-9550-45da-aaa0-07b884c24016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:40.720978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a7430930-9550-45da-aaa0-07b884c24016 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:40.722151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a7430930-9550-45da-aaa0-07b884c24016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:40.730747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1195/2371] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Aug 1 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:40.761775 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ab6f0-d437-49e2-81cc-165467f9a2f8 service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:40.773671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873ab6f0-d437-49e2-81cc-165467f9a2f8 service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:40.779102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9f07-8e5d-41b0-a9d5-3882cd085f65 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:40.779702 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9f07-8e5d-41b0-a9d5-3882cd085f65 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:40.779979 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9f07-8e5d-41b0-a9d5-3882cd085f65 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:40.780250 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e9f07-8e5d-41b0-a9d5-3882cd085f65 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:40.790502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e9f07-8e5d-41b0-a9d5-3882cd085f65 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:40.792763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e9f07-8e5d-41b0-a9d5-3882cd085f65 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:40.802318 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1177/2372] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:44.894110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2e4b1-1111-401c-ae43-0625f7dc09f9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:44.894624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2e4b1-1111-401c-ae43-0625f7dc09f9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:44.894736 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b2e4b1-1111-401c-ae43-0625f7dc09f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:44.914063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-65b2e4b1-1111-401c-ae43-0625f7dc09f9 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:26:44.915358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-65b2e4b1-1111-401c-ae43-0625f7dc09f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:26:44.924767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1196/2373] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Aug 1 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:26:44.950726 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9f07-8e5d-41b0-a9d5-3882cd085f65 service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:26:44.961870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e9f07-8e5d-41b0-a9d5-3882cd085f65 service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:26:44.967922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7896a-3b68-4893-90a8-1b0ecfbe6c60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:26:44.968523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7896a-3b68-4893-90a8-1b0ecfbe6c60 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:26:44.968803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7896a-3b68-4893-90a8-1b0ecfbe6c60 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:26:44.969077 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7896a-3b68-4893-90a8-1b0ecfbe6c60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:26:44.977320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7896a-3b68-4893-90a8-1b0ecfbe6c60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:26:44.979015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7896a-3b68-4893-90a8-1b0ecfbe6c60 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:26:44.989337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1178/2374] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:26:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:26:54.908967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=12 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:26:54.984936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=24 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:00.073327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119742b0-447a-4a6f-9100-585f1a7f8cb9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:00.073784 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119742b0-447a-4a6f-9100-585f1a7f8cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:00.073897 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-119742b0-447a-4a6f-9100-585f1a7f8cb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:00.092982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-119742b0-447a-4a6f-9100-585f1a7f8cb9 None None] MFA Rules not processed for user `666b3c9d23604bf0aefc4f09374f92c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:00.094175 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-119742b0-447a-4a6f-9100-585f1a7f8cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:00.150940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1197/2375] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:27:00 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:03.366026 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175485ba-1591-4f7b-b3c6-494eaac10609 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:03.366534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175485ba-1591-4f7b-b3c6-494eaac10609 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:03.366676 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175485ba-1591-4f7b-b3c6-494eaac10609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:03.386302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-175485ba-1591-4f7b-b3c6-494eaac10609 None None] MFA Rules not processed for user `1138cc04064443c098f4c2e87b02dd0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:03.387545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-175485ba-1591-4f7b-b3c6-494eaac10609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:03.394307 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1179/2376] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:27:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:10.142178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=25 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:13.381018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:16.028519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119742b0-447a-4a6f-9100-585f1a7f8cb9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:16.029922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-119742b0-447a-4a6f-9100-585f1a7f8cb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:16.041725 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-119742b0-447a-4a6f-9100-585f1a7f8cb9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:16.045238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ea030-a9c0-4612-9403-0282420fdbed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:16.045836 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea030-a9c0-4612-9403-0282420fdbed service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:16.046114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea030-a9c0-4612-9403-0282420fdbed service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:16.046390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2ea030-a9c0-4612-9403-0282420fdbed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:16.048143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ca2ea030-a9c0-4612-9403-0282420fdbed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:16.061444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ea030-a9c0-4612-9403-0282420fdbed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:16.062922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca2ea030-a9c0-4612-9403-0282420fdbed service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:16.074806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1198/2377] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:18.657689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95c7a0-2fe4-408e-9347-580ea52674d9 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:18.658238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95c7a0-2fe4-408e-9347-580ea52674d9 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:18.658351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95c7a0-2fe4-408e-9347-580ea52674d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:18.677617 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-cd95c7a0-2fe4-408e-9347-580ea52674d9 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:18.678873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cd95c7a0-2fe4-408e-9347-580ea52674d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:18.687190 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1180/2378] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Aug 1 14:27:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:18.714015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ea030-a9c0-4612-9403-0282420fdbed service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:18.725964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca2ea030-a9c0-4612-9403-0282420fdbed service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:18.731999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95455a4-024f-4d44-9fca-1ff79ce9aace service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:18.732609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95455a4-024f-4d44-9fca-1ff79ce9aace service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:18.732887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95455a4-024f-4d44-9fca-1ff79ce9aace service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:18.733189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95455a4-024f-4d44-9fca-1ff79ce9aace service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:18.741483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95455a4-024f-4d44-9fca-1ff79ce9aace service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:18.743733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95455a4-024f-4d44-9fca-1ff79ce9aace service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:18.753054 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1199/2379] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:22.925773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8188773-72f6-4643-a7e7-37f5f8f71236 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:22.926281 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8188773-72f6-4643-a7e7-37f5f8f71236 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:22.926281 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8188773-72f6-4643-a7e7-37f5f8f71236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:22.945433 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e8188773-72f6-4643-a7e7-37f5f8f71236 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:22.946804 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e8188773-72f6-4643-a7e7-37f5f8f71236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:22.955030 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1181/2380] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Aug 1 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:22.981171 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95455a4-024f-4d44-9fca-1ff79ce9aace service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:22.993005 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95455a4-024f-4d44-9fca-1ff79ce9aace service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:23.002773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3466b-e5bd-4cbf-9c9a-4e23098990b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:23.003391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3466b-e5bd-4cbf-9c9a-4e23098990b8 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:23.003687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3466b-e5bd-4cbf-9c9a-4e23098990b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:23.003942 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da3466b-e5bd-4cbf-9c9a-4e23098990b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:23.012886 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3466b-e5bd-4cbf-9c9a-4e23098990b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:23.014460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da3466b-e5bd-4cbf-9c9a-4e23098990b8 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:23.023806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1200/2381] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:27.032357 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba69b5b-2ba8-4aad-90d5-44bb58006f60 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:27.032809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba69b5b-2ba8-4aad-90d5-44bb58006f60 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:27.032937 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba69b5b-2ba8-4aad-90d5-44bb58006f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:27.051958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7ba69b5b-2ba8-4aad-90d5-44bb58006f60 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:27.053138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7ba69b5b-2ba8-4aad-90d5-44bb58006f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:27.060938 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1182/2382] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Aug 1 14:27:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:27.083449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3466b-e5bd-4cbf-9c9a-4e23098990b8 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:27.095259 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da3466b-e5bd-4cbf-9c9a-4e23098990b8 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:27.100813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103030c8-fa3b-45af-9749-0c156ee5ca9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:27.101795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103030c8-fa3b-45af-9749-0c156ee5ca9b service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:27.101795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103030c8-fa3b-45af-9749-0c156ee5ca9b service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:27.102045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103030c8-fa3b-45af-9749-0c156ee5ca9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:27.110563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103030c8-fa3b-45af-9749-0c156ee5ca9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:27.112159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103030c8-fa3b-45af-9749-0c156ee5ca9b service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:27.121653 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1201/2383] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:31.242824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e93dd5-b11c-4361-8f57-d33f476c03e1 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:31.243366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e93dd5-b11c-4361-8f57-d33f476c03e1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:31.243366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e93dd5-b11c-4361-8f57-d33f476c03e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:31.263496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-50e93dd5-b11c-4361-8f57-d33f476c03e1 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:31.264652 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-50e93dd5-b11c-4361-8f57-d33f476c03e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:31.272469 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1183/2384] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Aug 1 14:27:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:31.301824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103030c8-fa3b-45af-9749-0c156ee5ca9b service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:31.313173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103030c8-fa3b-45af-9749-0c156ee5ca9b service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:31.318740 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210e293-4fcd-4460-abfb-00333bd8d7dd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:31.319344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210e293-4fcd-4460-abfb-00333bd8d7dd service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:31.319627 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210e293-4fcd-4460-abfb-00333bd8d7dd service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:31.319904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2210e293-4fcd-4460-abfb-00333bd8d7dd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:31.328303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210e293-4fcd-4460-abfb-00333bd8d7dd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:31.329877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2210e293-4fcd-4460-abfb-00333bd8d7dd service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:31.339813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1202/2385] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:35.400476 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8382f-9932-44d9-a77d-273a2682d193 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:35.401001 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8382f-9932-44d9-a77d-273a2682d193 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:35.401114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a8382f-9932-44d9-a77d-273a2682d193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:35.420498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-26a8382f-9932-44d9-a77d-273a2682d193 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:35.421696 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-26a8382f-9932-44d9-a77d-273a2682d193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:35.429530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1184/2386] 10.222.0.67 () {58 vars in 1016 bytes} [Mon Aug 1 14:27:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:35.453307 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210e293-4fcd-4460-abfb-00333bd8d7dd service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:35.464517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2210e293-4fcd-4460-abfb-00333bd8d7dd service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:35.469968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5db21-f214-4147-89e2-3f97dc168cf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:35.470569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5db21-f214-4147-89e2-3f97dc168cf8 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:35.470883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5db21-f214-4147-89e2-3f97dc168cf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:35.471184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da5db21-f214-4147-89e2-3f97dc168cf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:35.479853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5db21-f214-4147-89e2-3f97dc168cf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:35.481419 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da5db21-f214-4147-89e2-3f97dc168cf8 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:35.490812 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1203/2387] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:43.157662 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8382f-9932-44d9-a77d-273a2682d193 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:43.159180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-26a8382f-9932-44d9-a77d-273a2682d193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:43.171128 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a8382f-9932-44d9-a77d-273a2682d193 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:43.174709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac990912-11b4-4aa7-bf44-fa223c3c6a72 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:43.175321 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac990912-11b4-4aa7-bf44-fa223c3c6a72 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:43.175600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac990912-11b4-4aa7-bf44-fa223c3c6a72 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:43.175874 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac990912-11b4-4aa7-bf44-fa223c3c6a72 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:43.177564 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ac990912-11b4-4aa7-bf44-fa223c3c6a72 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:43.191184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac990912-11b4-4aa7-bf44-fa223c3c6a72 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:43.192618 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac990912-11b4-4aa7-bf44-fa223c3c6a72 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:43.204595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1185/2388] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:45.486648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=36 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:46.945211 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5db21-f214-4147-89e2-3f97dc168cf8 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:46.956761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da5db21-f214-4147-89e2-3f97dc168cf8 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:46.963001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8361ca-2054-459d-be1d-ee086bade5d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:46.963606 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8361ca-2054-459d-be1d-ee086bade5d4 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:46.963885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8361ca-2054-459d-be1d-ee086bade5d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:46.964160 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8361ca-2054-459d-be1d-ee086bade5d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:46.965883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5b8361ca-2054-459d-be1d-ee086bade5d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:47.025055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8361ca-2054-459d-be1d-ee086bade5d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:47.026683 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8361ca-2054-459d-be1d-ee086bade5d4 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:47.035905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1204/2389] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:46 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:53.199701 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=21 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:27:56.288941 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315609-cb3c-4281-bb39-7af7fcda12ab None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:56.289532 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315609-cb3c-4281-bb39-7af7fcda12ab None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:56.289532 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e315609-cb3c-4281-bb39-7af7fcda12ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:56.308340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-3e315609-cb3c-4281-bb39-7af7fcda12ab None None] MFA Rules not processed for user `246f0156a53e4931bc24158b06e85654`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:27:56.309530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3e315609-cb3c-4281-bb39-7af7fcda12ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:56.316333 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1186/2390] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:27:56 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:27:56.629289 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8361ca-2054-459d-be1d-ee086bade5d4 service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:56.639439 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8361ca-2054-459d-be1d-ee086bade5d4 service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:56.643254 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b464c6-2c06-4481-964d-a3cac77ed1dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:56.643858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b464c6-2c06-4481-964d-a3cac77ed1dd service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:56.644135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b464c6-2c06-4481-964d-a3cac77ed1dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:56.644407 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b464c6-2c06-4481-964d-a3cac77ed1dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:56.646137 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-68b464c6-2c06-4481-964d-a3cac77ed1dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:56.656306 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b464c6-2c06-4481-964d-a3cac77ed1dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:56.657733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b464c6-2c06-4481-964d-a3cac77ed1dd service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:56.666313 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1205/2391] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:56.973733 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e315609-cb3c-4281-bb39-7af7fcda12ab None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:56.975185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3e315609-cb3c-4281-bb39-7af7fcda12ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:56.990570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e315609-cb3c-4281-bb39-7af7fcda12ab None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:56.995796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca6cc1-7e92-442e-bc67-6043332b8b49 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210ee6c390849e7a630a677ec52e966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:56.996417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca6cc1-7e92-442e-bc67-6043332b8b49 service placement] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:56.996833 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca6cc1-7e92-442e-bc67-6043332b8b49 service placement] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:56.997109 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca6cc1-7e92-442e-bc67-6043332b8b49 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:56.998925 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e0ca6cc1-7e92-442e-bc67-6043332b8b49 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:57.012506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca6cc1-7e92-442e-bc67-6043332b8b49 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:57.014097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca6cc1-7e92-442e-bc67-6043332b8b49 service placement] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:57.024836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1187/2392] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:58.938312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b464c6-2c06-4481-964d-a3cac77ed1dd service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:58.947950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b464c6-2c06-4481-964d-a3cac77ed1dd service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:58.951927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e53df9-988e-4027-a217-e4f42095ddbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:58.952638 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e53df9-988e-4027-a217-e4f42095ddbd service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:58.952922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e53df9-988e-4027-a217-e4f42095ddbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:58.953201 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e53df9-988e-4027-a217-e4f42095ddbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:58.955149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-02e53df9-988e-4027-a217-e4f42095ddbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:58.965528 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e53df9-988e-4027-a217-e4f42095ddbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:58.967014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e53df9-988e-4027-a217-e4f42095ddbd service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:58.975561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1206/2393] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:27:59.622115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca6cc1-7e92-442e-bc67-6043332b8b49 service placement] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:27:59.635703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca6cc1-7e92-442e-bc67-6043332b8b49 service placement] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:27:59.643054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46604192-d43d-4b7e-b1f2-5e3f24ece596 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:27:59.643882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46604192-d43d-4b7e-b1f2-5e3f24ece596 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:27:59.644157 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46604192-d43d-4b7e-b1f2-5e3f24ece596 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:27:59.645023 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46604192-d43d-4b7e-b1f2-5e3f24ece596 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:27:59.647939 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-46604192-d43d-4b7e-b1f2-5e3f24ece596 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:27:59.660524 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46604192-d43d-4b7e-b1f2-5e3f24ece596 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:27:59.663411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46604192-d43d-4b7e-b1f2-5e3f24ece596 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:27:59.675256 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1188/2394] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:27:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:06.626925 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e53df9-988e-4027-a217-e4f42095ddbd service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:06.641740 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e53df9-988e-4027-a217-e4f42095ddbd service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:06.647319 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa98f33-aa59-4bac-8175-3b277e19ea4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:06.647921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa98f33-aa59-4bac-8175-3b277e19ea4a service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:06.648199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa98f33-aa59-4bac-8175-3b277e19ea4a service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:06.648467 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa98f33-aa59-4bac-8175-3b277e19ea4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:06.650973 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bfa98f33-aa59-4bac-8175-3b277e19ea4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:06.663369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa98f33-aa59-4bac-8175-3b277e19ea4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:06.665160 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa98f33-aa59-4bac-8175-3b277e19ea4a service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:06.675911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1207/2395] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:08.705579 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46604192-d43d-4b7e-b1f2-5e3f24ece596 service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:08.730698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46604192-d43d-4b7e-b1f2-5e3f24ece596 service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:08.736056 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7c27c-402a-48df-a001-d3e7804dba93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:08.736735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7c27c-402a-48df-a001-d3e7804dba93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:08.737019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7c27c-402a-48df-a001-d3e7804dba93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:08.737297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d7c27c-402a-48df-a001-d3e7804dba93 admin admin] PATH_INFO: `/v3/users/1138cc04064443c098f4c2e87b02dd0a` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:08.738560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7c27c-402a-48df-a001-d3e7804dba93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1138cc04064443c098f4c2e87b02dd0a)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:08.740561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d7c27c-402a-48df-a001-d3e7804dba93 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:08.789878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-91d7c27c-402a-48df-a001-d3e7804dba93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1138cc04064443c098f4c2e87b02dd0a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:08.798865 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-91d7c27c-402a-48df-a001-d3e7804dba93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1138cc04064443c098f4c2e87b02dd0a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:08.811928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-91d7c27c-402a-48df-a001-d3e7804dba93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1138cc04064443c098f4c2e87b02dd0a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:08.812614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-91d7c27c-402a-48df-a001-d3e7804dba93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1138cc04064443c098f4c2e87b02dd0a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:08.822745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-91d7c27c-402a-48df-a001-d3e7804dba93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1138cc04064443c098f4c2e87b02dd0a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:08.829481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1189/2396] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:28:08 2022] DELETE /identity/v3/users/1138cc04064443c098f4c2e87b02dd0a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:28:09.048477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa98f33-aa59-4bac-8175-3b277e19ea4a service nova] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:09.065991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa98f33-aa59-4bac-8175-3b277e19ea4a service nova] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:09.133719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613df29-ffeb-4a79-b1af-39cd388e486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:09.134808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613df29-ffeb-4a79-b1af-39cd388e486b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:09.135097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613df29-ffeb-4a79-b1af-39cd388e486b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:09.135406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1613df29-ffeb-4a79-b1af-39cd388e486b admin admin] PATH_INFO: `/v3/projects/890799b9312440c2b993e7db9f5b4d57` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:09.136605 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613df29-ffeb-4a79-b1af-39cd388e486b admin admin] RBAC: Authorizing `identity:delete_project(project_id=890799b9312440c2b993e7db9f5b4d57)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:09.138568 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1613df29-ffeb-4a79-b1af-39cd388e486b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:09.190485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1613df29-ffeb-4a79-b1af-39cd388e486b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '890799b9312440c2b993e7db9f5b4d57', 'request_id': 'req-1613df29-ffeb-4a79-b1af-39cd388e486b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:09.196783 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1613df29-ffeb-4a79-b1af-39cd388e486b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '890799b9312440c2b993e7db9f5b4d57', 'request_id': 'req-1613df29-ffeb-4a79-b1af-39cd388e486b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:09.202463 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:09.204213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1613df29-ffeb-4a79-b1af-39cd388e486b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '890799b9312440c2b993e7db9f5b4d57', 'request_id': 'req-1613df29-ffeb-4a79-b1af-39cd388e486b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:09.218785 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1613df29-ffeb-4a79-b1af-39cd388e486b admin admin] The token cache is being invalidate because project 890799b9312440c2b993e7db9f5b4d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:28:09.219806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1613df29-ffeb-4a79-b1af-39cd388e486b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:09.220450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-1613df29-ffeb-4a79-b1af-39cd388e486b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:09.222229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1208/2397] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:28:09 2022] DELETE /identity/v3/projects/890799b9312440c2b993e7db9f5b4d57 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:28:11.901898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7c27c-402a-48df-a001-d3e7804dba93 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:11.903316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-91d7c27c-402a-48df-a001-d3e7804dba93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:11.964190 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d7c27c-402a-48df-a001-d3e7804dba93 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:12.012197 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1cc66-c02c-436e-af68-82d8fbb72500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:12.012818 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1cc66-c02c-436e-af68-82d8fbb72500 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:12.013097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1cc66-c02c-436e-af68-82d8fbb72500 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:12.013401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca1cc66-c02c-436e-af68-82d8fbb72500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:12.015192 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1ca1cc66-c02c-436e-af68-82d8fbb72500 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:12.024183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:12.075878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1cc66-c02c-436e-af68-82d8fbb72500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:12.077327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca1cc66-c02c-436e-af68-82d8fbb72500 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:12.086204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1190/2398] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:11 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:18.936721 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613df29-ffeb-4a79-b1af-39cd388e486b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:18.938224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1613df29-ffeb-4a79-b1af-39cd388e486b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:19.040818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1613df29-ffeb-4a79-b1af-39cd388e486b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:19.047045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68caca-1c73-440c-a813-776187b2cf70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:19.048079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68caca-1c73-440c-a813-776187b2cf70 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:19.048581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68caca-1c73-440c-a813-776187b2cf70 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:19.049269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68caca-1c73-440c-a813-776187b2cf70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:19.051851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7c68caca-1c73-440c-a813-776187b2cf70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:19.067738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68caca-1c73-440c-a813-776187b2cf70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:19.081952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68caca-1c73-440c-a813-776187b2cf70 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:19.098003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1209/2399] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:20.931202 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1cc66-c02c-436e-af68-82d8fbb72500 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:20.933234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1ca1cc66-c02c-436e-af68-82d8fbb72500 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:20.944063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca1cc66-c02c-436e-af68-82d8fbb72500 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:20.947695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6abc2b-9fc7-4bd2-a82f-391bee40cda6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:20.948499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6abc2b-9fc7-4bd2-a82f-391bee40cda6 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:20.948780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6abc2b-9fc7-4bd2-a82f-391bee40cda6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:20.949071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6abc2b-9fc7-4bd2-a82f-391bee40cda6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:20.950780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4a6abc2b-9fc7-4bd2-a82f-391bee40cda6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:21.009900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6abc2b-9fc7-4bd2-a82f-391bee40cda6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:21.011391 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6abc2b-9fc7-4bd2-a82f-391bee40cda6 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:21.020457 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1191/2400] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:28.031048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a694-9e6c-4159-8c89-fde34901c419 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:28.031559 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a694-9e6c-4159-8c89-fde34901c419 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:28.031668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b43a694-9e6c-4159-8c89-fde34901c419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:28.051965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0b43a694-9e6c-4159-8c89-fde34901c419 None None] MFA Rules not processed for user `614de29f4fde415a9e858d82ebfffb6c`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:28.053205 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0b43a694-9e6c-4159-8c89-fde34901c419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:28.060844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1210/2401] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:28:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:31.016268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=51 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:31.151157 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6abc2b-9fc7-4bd2-a82f-391bee40cda6 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:31.156059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4a6abc2b-9fc7-4bd2-a82f-391bee40cda6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:31.238526 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6abc2b-9fc7-4bd2-a82f-391bee40cda6 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:31.242301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77653902-6dc3-411d-b3d3-c540f1ffc924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:31.242962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77653902-6dc3-411d-b3d3-c540f1ffc924 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:31.243245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77653902-6dc3-411d-b3d3-c540f1ffc924 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:31.243521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77653902-6dc3-411d-b3d3-c540f1ffc924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:31.247121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-77653902-6dc3-411d-b3d3-c540f1ffc924 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:31.314902 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77653902-6dc3-411d-b3d3-c540f1ffc924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:31.316363 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77653902-6dc3-411d-b3d3-c540f1ffc924 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:31.326956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1192/2402] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:34.698974 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43a694-9e6c-4159-8c89-fde34901c419 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:34.701267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0b43a694-9e6c-4159-8c89-fde34901c419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:34.719649 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b43a694-9e6c-4159-8c89-fde34901c419 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:34.731735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d046265e-4ef9-4ff4-a92f-6e97367d030b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:34.732524 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046265e-4ef9-4ff4-a92f-6e97367d030b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:34.732798 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046265e-4ef9-4ff4-a92f-6e97367d030b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:34.733066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d046265e-4ef9-4ff4-a92f-6e97367d030b admin admin] PATH_INFO: `/v3/users/666b3c9d23604bf0aefc4f09374f92c8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:34.734237 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046265e-4ef9-4ff4-a92f-6e97367d030b admin admin] RBAC: Authorizing `identity:delete_user(user_id=666b3c9d23604bf0aefc4f09374f92c8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:34.736189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d046265e-4ef9-4ff4-a92f-6e97367d030b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:34.781681 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d046265e-4ef9-4ff4-a92f-6e97367d030b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '666b3c9d23604bf0aefc4f09374f92c8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:34.793565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d046265e-4ef9-4ff4-a92f-6e97367d030b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '666b3c9d23604bf0aefc4f09374f92c8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:34.800249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d046265e-4ef9-4ff4-a92f-6e97367d030b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '666b3c9d23604bf0aefc4f09374f92c8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:34.800930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d046265e-4ef9-4ff4-a92f-6e97367d030b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '666b3c9d23604bf0aefc4f09374f92c8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:34.809157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-d046265e-4ef9-4ff4-a92f-6e97367d030b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '666b3c9d23604bf0aefc4f09374f92c8'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:34.815616 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1211/2403] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:28:34 2022] DELETE /identity/v3/users/666b3c9d23604bf0aefc4f09374f92c8 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:28:35.004026 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77653902-6dc3-411d-b3d3-c540f1ffc924 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:35.014780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77653902-6dc3-411d-b3d3-c540f1ffc924 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:35.077326 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c4d22-d677-45ca-99f6-a2ed009e354a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:35.077977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c4d22-d677-45ca-99f6-a2ed009e354a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:35.078375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c4d22-d677-45ca-99f6-a2ed009e354a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:35.078798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c4d22-d677-45ca-99f6-a2ed009e354a admin admin] PATH_INFO: `/v3/projects/19f75a5937eb45ec8d211ac5f7d37b77` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:35.079975 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c4d22-d677-45ca-99f6-a2ed009e354a admin admin] RBAC: Authorizing `identity:delete_project(project_id=19f75a5937eb45ec8d211ac5f7d37b77)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:35.081930 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786c4d22-d677-45ca-99f6-a2ed009e354a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:35.131936 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-786c4d22-d677-45ca-99f6-a2ed009e354a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19f75a5937eb45ec8d211ac5f7d37b77', 'request_id': 'req-786c4d22-d677-45ca-99f6-a2ed009e354a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:35.134327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:35.140468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-786c4d22-d677-45ca-99f6-a2ed009e354a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19f75a5937eb45ec8d211ac5f7d37b77', 'request_id': 'req-786c4d22-d677-45ca-99f6-a2ed009e354a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:35.148986 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-786c4d22-d677-45ca-99f6-a2ed009e354a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19f75a5937eb45ec8d211ac5f7d37b77', 'request_id': 'req-786c4d22-d677-45ca-99f6-a2ed009e354a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:35.167978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-786c4d22-d677-45ca-99f6-a2ed009e354a admin admin] The token cache is being invalidate because project 19f75a5937eb45ec8d211ac5f7d37b77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:28:35.168284 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-786c4d22-d677-45ca-99f6-a2ed009e354a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:35.169147 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-786c4d22-d677-45ca-99f6-a2ed009e354a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:28:35.170493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1193/2404] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:28:35 2022] DELETE /identity/v3/projects/19f75a5937eb45ec8d211ac5f7d37b77 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:28:35.176092 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe5d1d-fee6-481b-aa0c-706951fc2810 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:35.176386 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe5d1d-fee6-481b-aa0c-706951fc2810 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:35.176672 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbe5d1d-fee6-481b-aa0c-706951fc2810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:35.207081 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5bbe5d1d-fee6-481b-aa0c-706951fc2810 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:35.208965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5bbe5d1d-fee6-481b-aa0c-706951fc2810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:35.257085 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:35.290319 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1212/2405] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:35.298341 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b5956-5810-4ed2-95b0-d66883b42506 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:35.298721 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b5956-5810-4ed2-95b0-d66883b42506 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:35.298997 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0b5956-5810-4ed2-95b0-d66883b42506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:35.322035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7a0b5956-5810-4ed2-95b0-d66883b42506 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:35.323590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7a0b5956-5810-4ed2-95b0-d66883b42506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:35.333135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1194/2406] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:35.337770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe5d1d-fee6-481b-aa0c-706951fc2810 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:35.348370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbe5d1d-fee6-481b-aa0c-706951fc2810 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:35.352985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba159a-dbfa-4035-982c-ef54adb7aa12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:35.353587 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba159a-dbfa-4035-982c-ef54adb7aa12 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:35.353901 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba159a-dbfa-4035-982c-ef54adb7aa12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:35.354721 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ba159a-dbfa-4035-982c-ef54adb7aa12 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:35.355426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba159a-dbfa-4035-982c-ef54adb7aa12 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:28:35.355732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba159a-dbfa-4035-982c-ef54adb7aa12 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:35.357325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ba159a-dbfa-4035-982c-ef54adb7aa12 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:35.368946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1213/2407] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:28:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:28:35.373854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b5956-5810-4ed2-95b0-d66883b42506 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:35.383229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0b5956-5810-4ed2-95b0-d66883b42506 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:35.388487 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821da05-de04-40d5-94c2-672114eaefac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:35.389103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821da05-de04-40d5-94c2-672114eaefac admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:35.389383 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821da05-de04-40d5-94c2-672114eaefac admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:35.389657 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d821da05-de04-40d5-94c2-672114eaefac admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:35.390317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821da05-de04-40d5-94c2-672114eaefac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:35.392294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d821da05-de04-40d5-94c2-672114eaefac admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:35.420461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1195/2408] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:28:35 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:28:35.424773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba159a-dbfa-4035-982c-ef54adb7aa12 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:35.435226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ba159a-dbfa-4035-982c-ef54adb7aa12 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:35.490486 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d8494-8cd8-4e27-aae4-b988f8e78828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:35.491048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d8494-8cd8-4e27-aae4-b988f8e78828 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:35.491327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d8494-8cd8-4e27-aae4-b988f8e78828 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:35.491594 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6d8494-8cd8-4e27-aae4-b988f8e78828 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:35.492243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d8494-8cd8-4e27-aae4-b988f8e78828 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:35.494166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6d8494-8cd8-4e27-aae4-b988f8e78828 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:35.514391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1214/2409] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:28:35 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:28:35.518483 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821da05-de04-40d5-94c2-672114eaefac admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:35.529092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d821da05-de04-40d5-94c2-672114eaefac admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:35.533809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3c62c-9a6c-4e32-b06b-fbb18c14a7b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:35.534421 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3c62c-9a6c-4e32-b06b-fbb18c14a7b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:35.534731 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3c62c-9a6c-4e32-b06b-fbb18c14a7b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:35.535005 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3c62c-9a6c-4e32-b06b-fbb18c14a7b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:35.535698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3c62c-9a6c-4e32-b06b-fbb18c14a7b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:35.537396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3c62c-9a6c-4e32-b06b-fbb18c14a7b9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:35.548481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1196/2410] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:28:35.552500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d8494-8cd8-4e27-aae4-b988f8e78828 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:35.563055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6d8494-8cd8-4e27-aae4-b988f8e78828 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:35.567649 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e19705-0e62-4573-ab81-ba80cd43b7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:35.568249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e19705-0e62-4573-ab81-ba80cd43b7f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:35.568528 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e19705-0e62-4573-ab81-ba80cd43b7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:35.568802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e19705-0e62-4573-ab81-ba80cd43b7f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:35.569487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e19705-0e62-4573-ab81-ba80cd43b7f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:35.571114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e19705-0e62-4573-ab81-ba80cd43b7f0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:35.582344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1215/2411] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:28:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:28:35.586251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3c62c-9a6c-4e32-b06b-fbb18c14a7b9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:35.596050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3c62c-9a6c-4e32-b06b-fbb18c14a7b9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:35.600732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c78ac-ecdf-429a-8655-616b292afdf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:35.601386 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c78ac-ecdf-429a-8655-616b292afdf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:35.601665 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c78ac-ecdf-429a-8655-616b292afdf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:35.601937 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8c78ac-ecdf-429a-8655-616b292afdf9 admin admin] PATH_INFO: `/v3/projects/6ff3fcdd41b2470897d4f424c783543a/users/c86a9d7b668944d58b995fe157256ef8/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:35.616755 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c78ac-ecdf-429a-8655-616b292afdf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ff3fcdd41b2470897d4f424c783543a, user_id=c86a9d7b668944d58b995fe157256ef8, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:35.619519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec8c78ac-ecdf-429a-8655-616b292afdf9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:35.633595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1197/2412] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:28:35 2022] PUT /identity/v3/projects/6ff3fcdd41b2470897d4f424c783543a/users/c86a9d7b668944d58b995fe157256ef8/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:28:35.639400 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49966a25-a398-4529-a88e-6b52748874bb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:35.640099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49966a25-a398-4529-a88e-6b52748874bb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:35.640381 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49966a25-a398-4529-a88e-6b52748874bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:35.659713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-49966a25-a398-4529-a88e-6b52748874bb None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:35.660930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-49966a25-a398-4529-a88e-6b52748874bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:35.725048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1216/2413] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:28:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:35.736255 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c78ac-ecdf-429a-8655-616b292afdf9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:35.738397 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ec8c78ac-ecdf-429a-8655-616b292afdf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:35.804229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8c78ac-ecdf-429a-8655-616b292afdf9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:35.808094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc61a0-0790-4173-b148-52f6295f9beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:35.809134 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc61a0-0790-4173-b148-52f6295f9beb service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:35.809475 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc61a0-0790-4173-b148-52f6295f9beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:35.809817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23dc61a0-0790-4173-b148-52f6295f9beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:35.819234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc61a0-0790-4173-b148-52f6295f9beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:35.821303 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23dc61a0-0790-4173-b148-52f6295f9beb service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:35.834641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1198/2414] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:40.276740 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9325aa-03e0-4ebd-8f9c-4ad0389bff2d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:40.277224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9325aa-03e0-4ebd-8f9c-4ad0389bff2d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:40.277323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9325aa-03e0-4ebd-8f9c-4ad0389bff2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:40.311590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9c9325aa-03e0-4ebd-8f9c-4ad0389bff2d None None] MFA Rules not processed for user `c86a9d7b668944d58b995fe157256ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:40.312801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9c9325aa-03e0-4ebd-8f9c-4ad0389bff2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:40.348751 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:40.382354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1217/2415] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:28:40 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:40.397521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc61a0-0790-4173-b148-52f6295f9beb service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:40.398987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-23dc61a0-0790-4173-b148-52f6295f9beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:40.496238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23dc61a0-0790-4173-b148-52f6295f9beb service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:40.501730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca55965-43bb-4e39-a13f-a347ac535e54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:40.502347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca55965-43bb-4e39-a13f-a347ac535e54 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:40.502667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca55965-43bb-4e39-a13f-a347ac535e54 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:40.502943 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca55965-43bb-4e39-a13f-a347ac535e54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:40.511151 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca55965-43bb-4e39-a13f-a347ac535e54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:40.515507 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca55965-43bb-4e39-a13f-a347ac535e54 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:40.526047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1199/2416] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:40 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:42.091561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c685ef5-0858-4985-8d00-a9e57322454e None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:42.092037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c685ef5-0858-4985-8d00-a9e57322454e None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:42.092145 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c685ef5-0858-4985-8d00-a9e57322454e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:42.111425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3c685ef5-0858-4985-8d00-a9e57322454e None None] MFA Rules not processed for user `c86a9d7b668944d58b995fe157256ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:42.112649 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3c685ef5-0858-4985-8d00-a9e57322454e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:42.120314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1218/2417] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:28:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:42.454204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca55965-43bb-4e39-a13f-a347ac535e54 service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:42.456339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6ca55965-43bb-4e39-a13f-a347ac535e54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:42.466450 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:42.471401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca55965-43bb-4e39-a13f-a347ac535e54 service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:42.477749 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe4f00b-1b6a-4268-bfce-802c67ebce3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:42.480547 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4f00b-1b6a-4268-bfce-802c67ebce3c service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:42.481065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4f00b-1b6a-4268-bfce-802c67ebce3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:42.481653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe4f00b-1b6a-4268-bfce-802c67ebce3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:42.483928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5fe4f00b-1b6a-4268-bfce-802c67ebce3c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:42.494199 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4f00b-1b6a-4268-bfce-802c67ebce3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:42.495785 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe4f00b-1b6a-4268-bfce-802c67ebce3c service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:42.504265 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1200/2418] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:48.535417 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8bf85-2c04-430d-a873-1aef14cee11f None None] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:48.536009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8bf85-2c04-430d-a873-1aef14cee11f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:48.536009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e8bf85-2c04-430d-a873-1aef14cee11f None None] PATH_INFO: `/` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:48.537563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1219/2419] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 1 14:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:28:48.544042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8eec3-ddfb-48b4-bec7-effbd5a37846 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:48.544525 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8eec3-ddfb-48b4-bec7-effbd5a37846 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:48.544631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b8eec3-ddfb-48b4-bec7-effbd5a37846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:48.564825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e3b8eec3-ddfb-48b4-bec7-effbd5a37846 None None] MFA Rules not processed for user `33fcc673845943fc96bc18f011639716`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:48.565960 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e3b8eec3-ddfb-48b4-bec7-effbd5a37846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:48.574117 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1201/2420] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 1 14:28:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:48.588278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8bf85-2c04-430d-a873-1aef14cee11f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:48.599374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e8bf85-2c04-430d-a873-1aef14cee11f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:48.604059 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f495464-0cb3-407c-ae88-ee2900c73a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:48.604793 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f495464-0cb3-407c-ae88-ee2900c73a6f service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:48.605139 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f495464-0cb3-407c-ae88-ee2900c73a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:48.605477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f495464-0cb3-407c-ae88-ee2900c73a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:48.613130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f495464-0cb3-407c-ae88-ee2900c73a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:48.614764 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f495464-0cb3-407c-ae88-ee2900c73a6f service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:48.622939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1220/2421] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:48.726976 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f26cb6-7d68-4892-b42d-fd6b08fc13db None None] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:48.727286 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f26cb6-7d68-4892-b42d-fd6b08fc13db None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:48.727564 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f26cb6-7d68-4892-b42d-fd6b08fc13db None None] PATH_INFO: `/` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:48.729621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1202/2422] 10.222.0.70 () {54 vars in 921 bytes} [Mon Aug 1 14:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 01 14:28:48.735375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be85b4-b944-479a-925c-aa30f9957cb7 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:48.735665 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be85b4-b944-479a-925c-aa30f9957cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:48.735944 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6be85b4-b944-479a-925c-aa30f9957cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:48.755540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a6be85b4-b944-479a-925c-aa30f9957cb7 None None] MFA Rules not processed for user `e856fd5aff914cfb8b8dd86b39c89bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:28:48.756745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a6be85b4-b944-479a-925c-aa30f9957cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:28:48.766058 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1221/2423] 10.222.0.70 () {58 vars in 1018 bytes} [Mon Aug 1 14:28:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:28:48.776654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f26cb6-7d68-4892-b42d-fd6b08fc13db None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:28:48.787795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f26cb6-7d68-4892-b42d-fd6b08fc13db None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:28:48.792037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3020ad-229f-4d0f-a39a-b53f73242de8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:28:48.792645 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3020ad-229f-4d0f-a39a-b53f73242de8 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:28:48.793026 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3020ad-229f-4d0f-a39a-b53f73242de8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:28:48.793189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3020ad-229f-4d0f-a39a-b53f73242de8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:28:48.803580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3020ad-229f-4d0f-a39a-b53f73242de8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:28:48.805032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3020ad-229f-4d0f-a39a-b53f73242de8 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:28:48.817156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1203/2424] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:28:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:28:58.750792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=23 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:28:58.811888 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=13 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:29:53.140854 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360322b-fcdb-4c74-be23-bd541e123aa9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:29:53.141396 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360322b-fcdb-4c74-be23-bd541e123aa9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:29:53.141705 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0360322b-fcdb-4c74-be23-bd541e123aa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:29:53.163420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0360322b-fcdb-4c74-be23-bd541e123aa9 None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:29:53.164628 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0360322b-fcdb-4c74-be23-bd541e123aa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:29:53.220257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1222/2425] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 1 14:29:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:29:53.266634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3020ad-229f-4d0f-a39a-b53f73242de8 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:29:53.268397 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5d3020ad-229f-4d0f-a39a-b53f73242de8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:29:53.337719 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3020ad-229f-4d0f-a39a-b53f73242de8 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:29:53.342895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec1896-6d0f-4684-981e-b6ca5654d3c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:29:53.343511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec1896-6d0f-4684-981e-b6ca5654d3c8 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:29:53.343813 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec1896-6d0f-4684-981e-b6ca5654d3c8 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:29:53.344082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec1896-6d0f-4684-981e-b6ca5654d3c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:29:53.352614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec1896-6d0f-4684-981e-b6ca5654d3c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:29:53.354228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec1896-6d0f-4684-981e-b6ca5654d3c8 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:29:53.362231 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1204/2426] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:29:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:30:03.213698 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=25 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:03.359211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=32 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:09.960882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802200f4-9e70-4300-9359-986084241ca3 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:09.961380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802200f4-9e70-4300-9359-986084241ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:09.961548 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802200f4-9e70-4300-9359-986084241ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:10.000900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-802200f4-9e70-4300-9359-986084241ca3 None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:10.002028 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-802200f4-9e70-4300-9359-986084241ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:10.035689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1223/2427] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 1 14:30:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:10.048143 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec1896-6d0f-4684-981e-b6ca5654d3c8 service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:10.090127 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec1896-6d0f-4684-981e-b6ca5654d3c8 service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:10.095207 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e28b030-5ed4-4c40-bf0f-b656e7e37f52 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:10.095814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28b030-5ed4-4c40-bf0f-b656e7e37f52 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:10.096089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28b030-5ed4-4c40-bf0f-b656e7e37f52 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:10.096357 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e28b030-5ed4-4c40-bf0f-b656e7e37f52 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:10.104945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28b030-5ed4-4c40-bf0f-b656e7e37f52 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:10.106527 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e28b030-5ed4-4c40-bf0f-b656e7e37f52 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:10.114649 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1205/2428] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:30:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:30:20.033501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=23 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:20.111374 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=20 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:28.076190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802200f4-9e70-4300-9359-986084241ca3 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:28.077615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-802200f4-9e70-4300-9359-986084241ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:28.173156 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802200f4-9e70-4300-9359-986084241ca3 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:28.178346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b142f5-ea90-4fb9-bfeb-9367769bfc22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210ee6c390849e7a630a677ec52e966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:28.178997 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b142f5-ea90-4fb9-bfeb-9367769bfc22 service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:28.179277 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b142f5-ea90-4fb9-bfeb-9367769bfc22 service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:28.179554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b142f5-ea90-4fb9-bfeb-9367769bfc22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:28.181394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c4b142f5-ea90-4fb9-bfeb-9367769bfc22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:28.194614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b142f5-ea90-4fb9-bfeb-9367769bfc22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:28.196485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b142f5-ea90-4fb9-bfeb-9367769bfc22 service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:28.206909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1224/2429] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:28 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:30:31.849362 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bb56f-60e7-45f5-b138-91f573599d57 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:31.849875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bb56f-60e7-45f5-b138-91f573599d57 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:31.850071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9bb56f-60e7-45f5-b138-91f573599d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:31.883055 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-cd9bb56f-60e7-45f5-b138-91f573599d57 None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:31.884375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cd9bb56f-60e7-45f5-b138-91f573599d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:31.892277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1206/2430] 10.222.0.70 () {58 vars in 967 bytes} [Mon Aug 1 14:30:31 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:31.906907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b142f5-ea90-4fb9-bfeb-9367769bfc22 service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:31.919726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b142f5-ea90-4fb9-bfeb-9367769bfc22 service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:31.925225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6194a14-c85f-4359-8741-cbba26c1c8cd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:31.925860 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6194a14-c85f-4359-8741-cbba26c1c8cd service swift] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:31.926708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6194a14-c85f-4359-8741-cbba26c1c8cd service swift] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:31.926986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6194a14-c85f-4359-8741-cbba26c1c8cd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:31.935714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6194a14-c85f-4359-8741-cbba26c1c8cd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:31.937309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6194a14-c85f-4359-8741-cbba26c1c8cd service swift] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:31.946672 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1225/2431] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:30:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:30:36.020370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e962a5-9109-47f6-86ea-8a1106794afc None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:36.020860 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e962a5-9109-47f6-86ea-8a1106794afc None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:36.020981 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e962a5-9109-47f6-86ea-8a1106794afc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:36.044057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-91e962a5-9109-47f6-86ea-8a1106794afc None None] MFA Rules not processed for user `c86a9d7b668944d58b995fe157256ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:36.045281 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-91e962a5-9109-47f6-86ea-8a1106794afc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:36.054722 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1207/2432] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:30:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:30:41.942498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=47 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:44.830463 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6194a14-c85f-4359-8741-cbba26c1c8cd service swift] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:44.850860 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6194a14-c85f-4359-8741-cbba26c1c8cd service swift] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:44.854469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d185471-c249-4e57-89ff-0bb110769c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:44.855110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d185471-c249-4e57-89ff-0bb110769c05 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:44.855388 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d185471-c249-4e57-89ff-0bb110769c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:44.855655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d185471-c249-4e57-89ff-0bb110769c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:44.857442 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9d185471-c249-4e57-89ff-0bb110769c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:44.918029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d185471-c249-4e57-89ff-0bb110769c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:44.919569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d185471-c249-4e57-89ff-0bb110769c05 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:44.929982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1226/2433] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:30:46.041047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=6 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:50.068764 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e962a5-9109-47f6-86ea-8a1106794afc None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:50.080117 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e962a5-9109-47f6-86ea-8a1106794afc None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:50.084129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19c788-a146-4115-a56f-cd7622e66be0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:50.084822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19c788-a146-4115-a56f-cd7622e66be0 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:50.085238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19c788-a146-4115-a56f-cd7622e66be0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:50.085513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d19c788-a146-4115-a56f-cd7622e66be0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:50.088891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0d19c788-a146-4115-a56f-cd7622e66be0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:50.136747 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19c788-a146-4115-a56f-cd7622e66be0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:50.138260 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d19c788-a146-4115-a56f-cd7622e66be0 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:50.161261 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1208/2434] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:30:51.704578 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d185471-c249-4e57-89ff-0bb110769c05 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:51.714314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d185471-c249-4e57-89ff-0bb110769c05 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:51.718635 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbc4d1-cc3b-40df-b7ba-f869e8df9aa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:51.719262 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbc4d1-cc3b-40df-b7ba-f869e8df9aa0 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:51.719542 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbc4d1-cc3b-40df-b7ba-f869e8df9aa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:51.719822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafbc4d1-cc3b-40df-b7ba-f869e8df9aa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:51.721678 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-aafbc4d1-cc3b-40df-b7ba-f869e8df9aa0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:51.736148 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbc4d1-cc3b-40df-b7ba-f869e8df9aa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:51.738676 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafbc4d1-cc3b-40df-b7ba-f869e8df9aa0 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:51.767429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1227/2435] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:30:53.873118 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19c788-a146-4115-a56f-cd7622e66be0 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:53.876062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0d19c788-a146-4115-a56f-cd7622e66be0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:53.898122 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d19c788-a146-4115-a56f-cd7622e66be0 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:53.903735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b89f9-8de8-417e-ab2f-fa0a2fab579a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210ee6c390849e7a630a677ec52e966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:53.904404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b89f9-8de8-417e-ab2f-fa0a2fab579a service placement] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:53.904685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b89f9-8de8-417e-ab2f-fa0a2fab579a service placement] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:53.905169 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b89f9-8de8-417e-ab2f-fa0a2fab579a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:53.907080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-344b89f9-8de8-417e-ab2f-fa0a2fab579a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:53.926901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b89f9-8de8-417e-ab2f-fa0a2fab579a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:53.928788 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b89f9-8de8-417e-ab2f-fa0a2fab579a service placement] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:53.943068 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1209/2436] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:30:57.393297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbc4d1-cc3b-40df-b7ba-f869e8df9aa0 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:57.412561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafbc4d1-cc3b-40df-b7ba-f869e8df9aa0 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:57.421146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62282a5d-2dea-4dc4-af96-4aa99978078a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210ee6c390849e7a630a677ec52e966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:57.421822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282a5d-2dea-4dc4-af96-4aa99978078a service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:57.422106 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282a5d-2dea-4dc4-af96-4aa99978078a service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:57.422989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62282a5d-2dea-4dc4-af96-4aa99978078a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:57.426490 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-62282a5d-2dea-4dc4-af96-4aa99978078a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:57.475526 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62282a5d-2dea-4dc4-af96-4aa99978078a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:57.477198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62282a5d-2dea-4dc4-af96-4aa99978078a service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:57.490961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b89f9-8de8-417e-ab2f-fa0a2fab579a service placement] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:57.492928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-344b89f9-8de8-417e-ab2f-fa0a2fab579a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:57.508312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1228/2437] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:57 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:30:57.514244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b89f9-8de8-417e-ab2f-fa0a2fab579a service placement] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:57.526047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee522b2-99d4-4151-91d9-a9ed5dbdbaf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:57.527260 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee522b2-99d4-4151-91d9-a9ed5dbdbaf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:57.527499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee522b2-99d4-4151-91d9-a9ed5dbdbaf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:57.527770 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee522b2-99d4-4151-91d9-a9ed5dbdbaf7 admin admin] PATH_INFO: `/v3/users/614de29f4fde415a9e858d82ebfffb6c` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:57.529599 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee522b2-99d4-4151-91d9-a9ed5dbdbaf7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=614de29f4fde415a9e858d82ebfffb6c)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:57.532755 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee522b2-99d4-4151-91d9-a9ed5dbdbaf7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:57.608715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7ee522b2-99d4-4151-91d9-a9ed5dbdbaf7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '614de29f4fde415a9e858d82ebfffb6c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:57.616751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7ee522b2-99d4-4151-91d9-a9ed5dbdbaf7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '614de29f4fde415a9e858d82ebfffb6c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:57.630926 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7ee522b2-99d4-4151-91d9-a9ed5dbdbaf7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '614de29f4fde415a9e858d82ebfffb6c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:57.631831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7ee522b2-99d4-4151-91d9-a9ed5dbdbaf7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '614de29f4fde415a9e858d82ebfffb6c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:57.639558 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7ee522b2-99d4-4151-91d9-a9ed5dbdbaf7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '614de29f4fde415a9e858d82ebfffb6c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:57.646504 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1210/2438] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:30:57 2022] DELETE /identity/v3/users/614de29f4fde415a9e858d82ebfffb6c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:30:58.001007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62282a5d-2dea-4dc4-af96-4aa99978078a service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:58.017643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62282a5d-2dea-4dc4-af96-4aa99978078a service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:58.102035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15aeef1-4f49-410d-9f0a-a04e91a57db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:58.102990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aeef1-4f49-410d-9f0a-a04e91a57db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:58.103380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aeef1-4f49-410d-9f0a-a04e91a57db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:58.103764 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15aeef1-4f49-410d-9f0a-a04e91a57db2 admin admin] PATH_INFO: `/v3/projects/ffdd6264b71843e1bfbb327a70ddd3b2` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:58.105125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15aeef1-4f49-410d-9f0a-a04e91a57db2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffdd6264b71843e1bfbb327a70ddd3b2)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:58.107252 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15aeef1-4f49-410d-9f0a-a04e91a57db2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:58.165709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c15aeef1-4f49-410d-9f0a-a04e91a57db2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffdd6264b71843e1bfbb327a70ddd3b2', 'request_id': 'req-c15aeef1-4f49-410d-9f0a-a04e91a57db2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:58.173918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c15aeef1-4f49-410d-9f0a-a04e91a57db2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffdd6264b71843e1bfbb327a70ddd3b2', 'request_id': 'req-c15aeef1-4f49-410d-9f0a-a04e91a57db2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:58.182724 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c15aeef1-4f49-410d-9f0a-a04e91a57db2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffdd6264b71843e1bfbb327a70ddd3b2', 'request_id': 'req-c15aeef1-4f49-410d-9f0a-a04e91a57db2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:58.185851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:58.200979 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c15aeef1-4f49-410d-9f0a-a04e91a57db2 admin admin] The token cache is being invalidate because project ffdd6264b71843e1bfbb327a70ddd3b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:30:58.201549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c15aeef1-4f49-410d-9f0a-a04e91a57db2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:58.202377 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-c15aeef1-4f49-410d-9f0a-a04e91a57db2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:58.203927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1229/2439] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:30:57 2022] DELETE /identity/v3/projects/ffdd6264b71843e1bfbb327a70ddd3b2 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:30:58.208971 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578e419-b682-4387-89ce-04b3bda3f7f5 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:58.209264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578e419-b682-4387-89ce-04b3bda3f7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:58.209561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1578e419-b682-4387-89ce-04b3bda3f7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:58.280629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1578e419-b682-4387-89ce-04b3bda3f7f5 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:58.281904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1578e419-b682-4387-89ce-04b3bda3f7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:58.332376 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:58.352820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1211/2440] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:30:58.361521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf071dfa-3876-45c1-b934-d3cbcee8fe95 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:58.361984 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf071dfa-3876-45c1-b934-d3cbcee8fe95 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:58.362393 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf071dfa-3876-45c1-b934-d3cbcee8fe95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:58.382123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578e419-b682-4387-89ce-04b3bda3f7f5 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:58.383791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1578e419-b682-4387-89ce-04b3bda3f7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:58.387289 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-bf071dfa-3876-45c1-b934-d3cbcee8fe95 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:58.388568 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bf071dfa-3876-45c1-b934-d3cbcee8fe95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:58.396855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1578e419-b682-4387-89ce-04b3bda3f7f5 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:58.397660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1230/2441] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:30:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:30:58.401979 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674b95a-a3f7-4f09-afbd-5a1862040017 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:58.402147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf071dfa-3876-45c1-b934-d3cbcee8fe95 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:58.402922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674b95a-a3f7-4f09-afbd-5a1862040017 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:58.403336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674b95a-a3f7-4f09-afbd-5a1862040017 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:58.403612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f674b95a-a3f7-4f09-afbd-5a1862040017 admin admin] PATH_INFO: `/v3/users/272b9bd66acc4415bf3a056e719433fe` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:58.404799 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674b95a-a3f7-4f09-afbd-5a1862040017 admin admin] RBAC: Authorizing `identity:delete_user(user_id=272b9bd66acc4415bf3a056e719433fe)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:58.406977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f674b95a-a3f7-4f09-afbd-5a1862040017 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:58.411692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf071dfa-3876-45c1-b934-d3cbcee8fe95 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:58.416536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fbefb-b55d-41d5-96dd-f2948cfd660c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:58.417153 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fbefb-b55d-41d5-96dd-f2948cfd660c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:58.417437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fbefb-b55d-41d5-96dd-f2948cfd660c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:58.417714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fbefb-b55d-41d5-96dd-f2948cfd660c admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:58.418414 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fbefb-b55d-41d5-96dd-f2948cfd660c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:30:58.418759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fbefb-b55d-41d5-96dd-f2948cfd660c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:58.420365 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fbefb-b55d-41d5-96dd-f2948cfd660c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:58.433126 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1231/2442] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:30:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:30:58.437657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fbefb-b55d-41d5-96dd-f2948cfd660c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:58.448801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fbefb-b55d-41d5-96dd-f2948cfd660c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:58.453665 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8670493-b2fa-4acc-b105-c43e2ea4d179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:58.454383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8670493-b2fa-4acc-b105-c43e2ea4d179 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:58.454804 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8670493-b2fa-4acc-b105-c43e2ea4d179 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:58.455153 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8670493-b2fa-4acc-b105-c43e2ea4d179 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:58.456411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8670493-b2fa-4acc-b105-c43e2ea4d179 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:58.458403 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8670493-b2fa-4acc-b105-c43e2ea4d179 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:58.459627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-f674b95a-a3f7-4f09-afbd-5a1862040017 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '272b9bd66acc4415bf3a056e719433fe'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:58.469152 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-f674b95a-a3f7-4f09-afbd-5a1862040017 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '272b9bd66acc4415bf3a056e719433fe'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:58.481629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-f674b95a-a3f7-4f09-afbd-5a1862040017 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '272b9bd66acc4415bf3a056e719433fe'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:58.482370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-f674b95a-a3f7-4f09-afbd-5a1862040017 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '272b9bd66acc4415bf3a056e719433fe'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:58.488401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1232/2443] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:30:58 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:30:58.492522 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8670493-b2fa-4acc-b105-c43e2ea4d179 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:58.493701 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-f674b95a-a3f7-4f09-afbd-5a1862040017 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '272b9bd66acc4415bf3a056e719433fe'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:58.494217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a8670493-b2fa-4acc-b105-c43e2ea4d179 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:58.500004 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1212/2444] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:30:58 2022] DELETE /identity/v3/users/272b9bd66acc4415bf3a056e719433fe => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:30:58.567189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8670493-b2fa-4acc-b105-c43e2ea4d179 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:58.627460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59530a22-33bd-4671-906d-b64020379087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:58.628247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59530a22-33bd-4671-906d-b64020379087 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:58.628393 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59530a22-33bd-4671-906d-b64020379087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:58.628633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59530a22-33bd-4671-906d-b64020379087 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:58.629298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59530a22-33bd-4671-906d-b64020379087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:58.631311 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59530a22-33bd-4671-906d-b64020379087 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:58.653694 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1233/2445] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:30:58 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:30:58.657729 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674b95a-a3f7-4f09-afbd-5a1862040017 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:58.669484 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f674b95a-a3f7-4f09-afbd-5a1862040017 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:58.674482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffc8f3-63d2-4575-b2dd-2f7cec6a5a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:58.675271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffc8f3-63d2-4575-b2dd-2f7cec6a5a6c admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:58.675554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffc8f3-63d2-4575-b2dd-2f7cec6a5a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:58.675837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ffc8f3-63d2-4575-b2dd-2f7cec6a5a6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:58.676528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffc8f3-63d2-4575-b2dd-2f7cec6a5a6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:58.678166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ffc8f3-63d2-4575-b2dd-2f7cec6a5a6c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:58.690616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1213/2446] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:30:58.693279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59530a22-33bd-4671-906d-b64020379087 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:58.693494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffc8f3-63d2-4575-b2dd-2f7cec6a5a6c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:58.695536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-59530a22-33bd-4671-906d-b64020379087 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:58.706293 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ffc8f3-63d2-4575-b2dd-2f7cec6a5a6c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:58.709359 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59530a22-33bd-4671-906d-b64020379087 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:58.712147 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0937f-7d58-4170-a4e0-af819a3c477a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:58.712783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0937f-7d58-4170-a4e0-af819a3c477a admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:58.713070 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0937f-7d58-4170-a4e0-af819a3c477a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:58.713351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f0937f-7d58-4170-a4e0-af819a3c477a admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:58.714051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0937f-7d58-4170-a4e0-af819a3c477a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:58.714393 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:58.715084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:58.715365 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:58.715638 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc admin admin] PATH_INFO: `/v3/projects/9e29a746ab1c4a7a9566d4096aa29bf6` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:58.715749 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f0937f-7d58-4170-a4e0-af819a3c477a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:58.716904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e29a746ab1c4a7a9566d4096aa29bf6)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:58.718878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:58.728243 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1214/2447] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:30:58 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:30:58.732444 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0937f-7d58-4170-a4e0-af819a3c477a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:58.743475 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f0937f-7d58-4170-a4e0-af819a3c477a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:58.749458 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd2b7af-f754-4dbb-b8f0-d2e3da0afbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:58.750095 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2b7af-f754-4dbb-b8f0-d2e3da0afbaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:58.750401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2b7af-f754-4dbb-b8f0-d2e3da0afbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:58.750928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd2b7af-f754-4dbb-b8f0-d2e3da0afbaa admin admin] PATH_INFO: `/v3/projects/63696b8d21d648a792075f32e7aa78f8/users/0d05f23ba97e410096137bc4923a7fb6/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:58.766558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=4,keystone:SELECT=92,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:58.767805 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2b7af-f754-4dbb-b8f0-d2e3da0afbaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=63696b8d21d648a792075f32e7aa78f8, user_id=0d05f23ba97e410096137bc4923a7fb6, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:58.771128 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd2b7af-f754-4dbb-b8f0-d2e3da0afbaa admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:58.771327 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e29a746ab1c4a7a9566d4096aa29bf6', 'request_id': 'req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:58.779365 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e29a746ab1c4a7a9566d4096aa29bf6', 'request_id': 'req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:58.786495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e29a746ab1c4a7a9566d4096aa29bf6', 'request_id': 'req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:58.787621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1215/2448] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:30:58 2022] PUT /identity/v3/projects/63696b8d21d648a792075f32e7aa78f8/users/0d05f23ba97e410096137bc4923a7fb6/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:30:58.800682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c56782-768d-41b6-bc36-041162898be6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:58.801054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c56782-768d-41b6-bc36-041162898be6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:58.801330 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c56782-768d-41b6-bc36-041162898be6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:58.801852 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc admin admin] The token cache is being invalidate because project 9e29a746ab1c4a7a9566d4096aa29bf6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:30:58.802264 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:58.802999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:58.804616 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1234/2449] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:30:58 2022] DELETE /identity/v3/projects/9e29a746ab1c4a7a9566d4096aa29bf6 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:30:58.808537 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:58.810018 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:58.833456 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-63c56782-768d-41b6-bc36-041162898be6 None None] MFA Rules not processed for user `0d05f23ba97e410096137bc4923a7fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:58.834728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-63c56782-768d-41b6-bc36-041162898be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:58.876184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4d0537-3068-4d21-bb30-1b711a2ba1dc admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:58.933773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1216/2450] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:30:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:30:58.933982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d682a-f2ac-4f57-82e1-f735eeda7242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:58.933982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d682a-f2ac-4f57-82e1-f735eeda7242 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:58.933982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d682a-f2ac-4f57-82e1-f735eeda7242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:58.933982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356d682a-f2ac-4f57-82e1-f735eeda7242 admin admin] PATH_INFO: `/v3/users/8a93a7a7dd7941a693beb73f55508e19` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:58.934780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c56782-768d-41b6-bc36-041162898be6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:58.934985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d682a-f2ac-4f57-82e1-f735eeda7242 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8a93a7a7dd7941a693beb73f55508e19)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:58.936119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-63c56782-768d-41b6-bc36-041162898be6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:58.936915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-356d682a-f2ac-4f57-82e1-f735eeda7242 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:58.945005 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:58.951056 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c56782-768d-41b6-bc36-041162898be6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:58.958059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1212e-3a81-46d3-9cc0-3b11ede2179c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:58.958714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1212e-3a81-46d3-9cc0-3b11ede2179c admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:58.958997 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1212e-3a81-46d3-9cc0-3b11ede2179c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:58.959266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a1212e-3a81-46d3-9cc0-3b11ede2179c admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:58.959925 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1212e-3a81-46d3-9cc0-3b11ede2179c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:58.961859 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a1212e-3a81-46d3-9cc0-3b11ede2179c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:58.996546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1217/2451] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:30:58 2022] POST /identity/v3/projects => generated 373 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:30:58.999448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-356d682a-f2ac-4f57-82e1-f735eeda7242 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8a93a7a7dd7941a693beb73f55508e19'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:59.000359 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1212e-3a81-46d3-9cc0-3b11ede2179c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:59.015346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-356d682a-f2ac-4f57-82e1-f735eeda7242 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8a93a7a7dd7941a693beb73f55508e19'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:59.023107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-356d682a-f2ac-4f57-82e1-f735eeda7242 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8a93a7a7dd7941a693beb73f55508e19'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:59.023981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-356d682a-f2ac-4f57-82e1-f735eeda7242 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8a93a7a7dd7941a693beb73f55508e19'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:59.032380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-356d682a-f2ac-4f57-82e1-f735eeda7242 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8a93a7a7dd7941a693beb73f55508e19'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:59.034059 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:59.045236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1235/2452] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:30:58 2022] DELETE /identity/v3/users/8a93a7a7dd7941a693beb73f55508e19 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:30:59.072803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a1212e-3a81-46d3-9cc0-3b11ede2179c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:59.136112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffbc1f-126e-45a9-9677-5c753068b950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:59.136729 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffbc1f-126e-45a9-9677-5c753068b950 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:59.137005 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffbc1f-126e-45a9-9677-5c753068b950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:59.137410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bffbc1f-126e-45a9-9677-5c753068b950 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:59.138073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffbc1f-126e-45a9-9677-5c753068b950 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:59.140057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bffbc1f-126e-45a9-9677-5c753068b950 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:59.162538 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1218/2453] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:30:58 2022] POST /identity/v3/users => generated 293 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:30:59.166448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d682a-f2ac-4f57-82e1-f735eeda7242 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:59.167948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-356d682a-f2ac-4f57-82e1-f735eeda7242 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:59.181312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356d682a-f2ac-4f57-82e1-f735eeda7242 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:59.186005 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc44f21-101d-4942-8020-bd8f53ca197b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:59.186564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44f21-101d-4942-8020-bd8f53ca197b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:59.186871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44f21-101d-4942-8020-bd8f53ca197b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:59.187147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44f21-101d-4942-8020-bd8f53ca197b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:59.187839 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc44f21-101d-4942-8020-bd8f53ca197b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:59.189425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc44f21-101d-4942-8020-bd8f53ca197b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:59.200637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1236/2454] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:30:59.204954 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffbc1f-126e-45a9-9677-5c753068b950 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:59.216037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bffbc1f-126e-45a9-9677-5c753068b950 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:59.221275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74024d64-39d7-41a9-a559-6e984dc1a2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:59.222102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74024d64-39d7-41a9-a559-6e984dc1a2ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:59.222377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74024d64-39d7-41a9-a559-6e984dc1a2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:59.222697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74024d64-39d7-41a9-a559-6e984dc1a2ed admin admin] PATH_INFO: `/v3/projects/1d89816992184ffeb2fb8adf57fdfcab/users/e215665bfd0642ff8ea74638dc7115d6/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:59.235454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc44f21-101d-4942-8020-bd8f53ca197b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:59.239236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4dc44f21-101d-4942-8020-bd8f53ca197b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:59.244592 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74024d64-39d7-41a9-a559-6e984dc1a2ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d89816992184ffeb2fb8adf57fdfcab, user_id=e215665bfd0642ff8ea74638dc7115d6, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:59.247250 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74024d64-39d7-41a9-a559-6e984dc1a2ed admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:59.262649 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc44f21-101d-4942-8020-bd8f53ca197b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:59.267471 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:59.268171 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:59.268548 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:59.268828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc admin admin] PATH_INFO: `/v3/projects/f781628fbfe64369b0ce078d141960bc` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:59.270372 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f781628fbfe64369b0ce078d141960bc)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:59.272490 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:59.277142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1219/2455] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:30:59 2022] PUT /identity/v3/projects/1d89816992184ffeb2fb8adf57fdfcab/users/e215665bfd0642ff8ea74638dc7115d6/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:30:59.278178 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74024d64-39d7-41a9-a559-6e984dc1a2ed admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:59.344946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f781628fbfe64369b0ce078d141960bc', 'request_id': 'req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:59.352036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f781628fbfe64369b0ce078d141960bc', 'request_id': 'req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:59.355828 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:30:59.360049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f781628fbfe64369b0ce078d141960bc', 'request_id': 'req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:59.372328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74024d64-39d7-41a9-a559-6e984dc1a2ed admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:59.381759 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc admin admin] The token cache is being invalidate because project f781628fbfe64369b0ce078d141960bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:30:59.382051 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:59.382747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:30:59.384269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1237/2456] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:30:59 2022] DELETE /identity/v3/projects/f781628fbfe64369b0ce078d141960bc => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:30:59.445987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d36342-8bde-43b5-bd29-0da83c758f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:59.446513 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d36342-8bde-43b5-bd29-0da83c758f5c admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:59.446826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d36342-8bde-43b5-bd29-0da83c758f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:59.447096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d36342-8bde-43b5-bd29-0da83c758f5c admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:59.447803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d36342-8bde-43b5-bd29-0da83c758f5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:59.449472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d36342-8bde-43b5-bd29-0da83c758f5c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:59.461417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1220/2457] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:30:59.465957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:59.467672 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:59.482134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a8f1b8-14b8-4a47-9e40-d814f0a87adc admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:59.487120 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b3d2b-c0ea-4b90-82b7-4479fc6ae9ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:59.487822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b3d2b-c0ea-4b90-82b7-4479fc6ae9ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:59.488100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b3d2b-c0ea-4b90-82b7-4479fc6ae9ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:59.488374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54b3d2b-c0ea-4b90-82b7-4479fc6ae9ae admin admin] PATH_INFO: `/v3/projects/1d89816992184ffeb2fb8adf57fdfcab/users/e215665bfd0642ff8ea74638dc7115d6/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:59.490421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b3d2b-c0ea-4b90-82b7-4479fc6ae9ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d89816992184ffeb2fb8adf57fdfcab, user_id=e215665bfd0642ff8ea74638dc7115d6, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:59.493208 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54b3d2b-c0ea-4b90-82b7-4479fc6ae9ae admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:59.504834 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1238/2458] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:30:59 2022] PUT /identity/v3/projects/1d89816992184ffeb2fb8adf57fdfcab/users/e215665bfd0642ff8ea74638dc7115d6/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:30:59.515896 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad714179-d65a-4674-8cc9-ed4f1ce64ab1 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:59.516769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad714179-d65a-4674-8cc9-ed4f1ce64ab1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:59.517201 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad714179-d65a-4674-8cc9-ed4f1ce64ab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:59.549873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-ad714179-d65a-4674-8cc9-ed4f1ce64ab1 None None] MFA Rules not processed for user `e215665bfd0642ff8ea74638dc7115d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:30:59.551229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ad714179-d65a-4674-8cc9-ed4f1ce64ab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:59.644984 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1221/2459] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:30:59 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:30:59.656546 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b3d2b-c0ea-4b90-82b7-4479fc6ae9ae admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:30:59.658283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b54b3d2b-c0ea-4b90-82b7-4479fc6ae9ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:30:59.754492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54b3d2b-c0ea-4b90-82b7-4479fc6ae9ae admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:30:59.758256 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c66b33-10fe-4050-bbfe-0906c8d77c7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:30:59.759049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c66b33-10fe-4050-bbfe-0906c8d77c7a service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:30:59.759332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c66b33-10fe-4050-bbfe-0906c8d77c7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:30:59.759609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c66b33-10fe-4050-bbfe-0906c8d77c7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:30:59.769803 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c66b33-10fe-4050-bbfe-0906c8d77c7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:30:59.771294 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c66b33-10fe-4050-bbfe-0906c8d77c7a service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:30:59.780948 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1239/2460] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:30:59 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:00.225910 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad714179-d65a-4674-8cc9-ed4f1ce64ab1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:00.288379 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad714179-d65a-4674-8cc9-ed4f1ce64ab1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:00.292933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e813c2e-5d2c-4550-9026-18a3d79ffd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:00.293613 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e813c2e-5d2c-4550-9026-18a3d79ffd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:00.293889 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e813c2e-5d2c-4550-9026-18a3d79ffd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:00.294166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e813c2e-5d2c-4550-9026-18a3d79ffd69 admin admin] PATH_INFO: `/v3/users/0d05f23ba97e410096137bc4923a7fb6` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:00.295351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e813c2e-5d2c-4550-9026-18a3d79ffd69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d05f23ba97e410096137bc4923a7fb6)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:00.297467 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e813c2e-5d2c-4550-9026-18a3d79ffd69 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:00.321041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:00.347500 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9e813c2e-5d2c-4550-9026-18a3d79ffd69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d05f23ba97e410096137bc4923a7fb6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:00.354928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9e813c2e-5d2c-4550-9026-18a3d79ffd69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d05f23ba97e410096137bc4923a7fb6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:00.367518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9e813c2e-5d2c-4550-9026-18a3d79ffd69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d05f23ba97e410096137bc4923a7fb6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:00.368163 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9e813c2e-5d2c-4550-9026-18a3d79ffd69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d05f23ba97e410096137bc4923a7fb6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:00.375087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9e813c2e-5d2c-4550-9026-18a3d79ffd69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d05f23ba97e410096137bc4923a7fb6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:00.380955 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1222/2461] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:00 2022] DELETE /identity/v3/users/0d05f23ba97e410096137bc4923a7fb6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:00.390775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fc3de-220f-480b-bc3c-2e8ec9b6be60 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:00.391093 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fc3de-220f-480b-bc3c-2e8ec9b6be60 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:00.391398 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20fc3de-220f-480b-bc3c-2e8ec9b6be60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:00.410837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d20fc3de-220f-480b-bc3c-2e8ec9b6be60 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:00.412061 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d20fc3de-220f-480b-bc3c-2e8ec9b6be60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:00.446469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:00.478164 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1240/2462] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:00.488198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e813c2e-5d2c-4550-9026-18a3d79ffd69 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:00.489797 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9e813c2e-5d2c-4550-9026-18a3d79ffd69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:00.563524 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e813c2e-5d2c-4550-9026-18a3d79ffd69 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:00.567759 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff2a5a-a4df-427c-a06b-4ad5e6f1b908 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:00.568377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff2a5a-a4df-427c-a06b-4ad5e6f1b908 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:00.568653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff2a5a-a4df-427c-a06b-4ad5e6f1b908 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:00.569178 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ff2a5a-a4df-427c-a06b-4ad5e6f1b908 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:00.578954 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff2a5a-a4df-427c-a06b-4ad5e6f1b908 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:00.580410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ff2a5a-a4df-427c-a06b-4ad5e6f1b908 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:00.590561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1223/2463] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:00.870722 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fc3de-220f-480b-bc3c-2e8ec9b6be60 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:00.872453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d20fc3de-220f-480b-bc3c-2e8ec9b6be60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:00.889757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20fc3de-220f-480b-bc3c-2e8ec9b6be60 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:00.895376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:00.896040 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:00.896364 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:00.896586 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b admin admin] PATH_INFO: `/v3/projects/63696b8d21d648a792075f32e7aa78f8` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:00.897776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=63696b8d21d648a792075f32e7aa78f8)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:00.899760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:00.948540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63696b8d21d648a792075f32e7aa78f8', 'request_id': 'req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:00.954958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63696b8d21d648a792075f32e7aa78f8', 'request_id': 'req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:00.960986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63696b8d21d648a792075f32e7aa78f8', 'request_id': 'req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:00.974215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b admin admin] The token cache is being invalidate because project 63696b8d21d648a792075f32e7aa78f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:00.974522 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:00.975212 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:00.976782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1241/2464] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:00 2022] DELETE /identity/v3/projects/63696b8d21d648a792075f32e7aa78f8 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:00.987370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff2a5a-a4df-427c-a06b-4ad5e6f1b908 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:00.997471 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ff2a5a-a4df-427c-a06b-4ad5e6f1b908 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:01.056453 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68de1c3-1ce2-497a-8aad-6060c7e38321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:01.057094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68de1c3-1ce2-497a-8aad-6060c7e38321 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:01.057373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68de1c3-1ce2-497a-8aad-6060c7e38321 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:01.057645 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68de1c3-1ce2-497a-8aad-6060c7e38321 admin admin] PATH_INFO: `/v3/users/e215665bfd0642ff8ea74638dc7115d6` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:01.058836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68de1c3-1ce2-497a-8aad-6060c7e38321 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e215665bfd0642ff8ea74638dc7115d6)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:01.060786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68de1c3-1ce2-497a-8aad-6060c7e38321 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:01.098853 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:01.109666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a68de1c3-1ce2-497a-8aad-6060c7e38321 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e215665bfd0642ff8ea74638dc7115d6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:01.118247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a68de1c3-1ce2-497a-8aad-6060c7e38321 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e215665bfd0642ff8ea74638dc7115d6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:01.131185 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a68de1c3-1ce2-497a-8aad-6060c7e38321 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e215665bfd0642ff8ea74638dc7115d6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:01.132049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a68de1c3-1ce2-497a-8aad-6060c7e38321 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e215665bfd0642ff8ea74638dc7115d6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:01.138991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a68de1c3-1ce2-497a-8aad-6060c7e38321 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e215665bfd0642ff8ea74638dc7115d6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:01.145574 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1224/2465] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:00 2022] DELETE /identity/v3/users/e215665bfd0642ff8ea74638dc7115d6 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:01.432966 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:01.434692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:01.449379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd82f72-d3fe-45e2-aab5-89ee3144ce9b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:01.508828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123e0b1f-4128-483b-8859-53647a409e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:01.509521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e0b1f-4128-483b-8859-53647a409e51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:01.509734 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e0b1f-4128-483b-8859-53647a409e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:01.510002 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123e0b1f-4128-483b-8859-53647a409e51 admin admin] PATH_INFO: `/v3/projects/1d89816992184ffeb2fb8adf57fdfcab` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:01.511197 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e0b1f-4128-483b-8859-53647a409e51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d89816992184ffeb2fb8adf57fdfcab)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:01.513098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123e0b1f-4128-483b-8859-53647a409e51 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:01.560180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-123e0b1f-4128-483b-8859-53647a409e51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d89816992184ffeb2fb8adf57fdfcab', 'request_id': 'req-123e0b1f-4128-483b-8859-53647a409e51'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:01.567789 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-123e0b1f-4128-483b-8859-53647a409e51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d89816992184ffeb2fb8adf57fdfcab', 'request_id': 'req-123e0b1f-4128-483b-8859-53647a409e51'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:01.573732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-123e0b1f-4128-483b-8859-53647a409e51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d89816992184ffeb2fb8adf57fdfcab', 'request_id': 'req-123e0b1f-4128-483b-8859-53647a409e51'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:01.576226 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:01.589673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-123e0b1f-4128-483b-8859-53647a409e51 admin admin] The token cache is being invalidate because project 1d89816992184ffeb2fb8adf57fdfcab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:01.589972 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-123e0b1f-4128-483b-8859-53647a409e51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:01.590653 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-123e0b1f-4128-483b-8859-53647a409e51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:01.592208 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1242/2466] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:01 2022] DELETE /identity/v3/projects/1d89816992184ffeb2fb8adf57fdfcab => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:01.597848 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f49ca3-c240-4abf-8220-a07dd80f8cb8 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:01.598370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f49ca3-c240-4abf-8220-a07dd80f8cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:01.598472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f49ca3-c240-4abf-8220-a07dd80f8cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:01.618531 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b5f49ca3-c240-4abf-8220-a07dd80f8cb8 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:01.619790 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b5f49ca3-c240-4abf-8220-a07dd80f8cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:01.678571 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1225/2467] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:31:01.686534 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc5c77-1ced-4d9a-a243-80de1b273ae4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:01.686850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc5c77-1ced-4d9a-a243-80de1b273ae4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:01.687125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc5c77-1ced-4d9a-a243-80de1b273ae4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:01.707284 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-17fc5c77-1ced-4d9a-a243-80de1b273ae4 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:01.708589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-17fc5c77-1ced-4d9a-a243-80de1b273ae4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:01.716533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1243/2468] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:01.720757 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f49ca3-c240-4abf-8220-a07dd80f8cb8 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:01.731180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f49ca3-c240-4abf-8220-a07dd80f8cb8 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:01.735836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844f29b-6bcd-44c0-99d6-7e6ddb4fd081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:01.736444 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844f29b-6bcd-44c0-99d6-7e6ddb4fd081 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:01.736737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844f29b-6bcd-44c0-99d6-7e6ddb4fd081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:01.737003 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844f29b-6bcd-44c0-99d6-7e6ddb4fd081 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:01.737695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844f29b-6bcd-44c0-99d6-7e6ddb4fd081 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:31:01.737997 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844f29b-6bcd-44c0-99d6-7e6ddb4fd081 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:01.739649 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844f29b-6bcd-44c0-99d6-7e6ddb4fd081 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:01.751646 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1226/2469] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:31:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:31:01.755967 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc5c77-1ced-4d9a-a243-80de1b273ae4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:01.765229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc5c77-1ced-4d9a-a243-80de1b273ae4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:01.770472 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc190f-bdec-45fa-b79a-304e84caeb94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:01.771107 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc190f-bdec-45fa-b79a-304e84caeb94 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:01.771383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc190f-bdec-45fa-b79a-304e84caeb94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:01.771650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbcc190f-bdec-45fa-b79a-304e84caeb94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:01.772309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc190f-bdec-45fa-b79a-304e84caeb94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:01.774210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbcc190f-bdec-45fa-b79a-304e84caeb94 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:01.802050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1244/2470] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:01 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:31:01.806482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844f29b-6bcd-44c0-99d6-7e6ddb4fd081 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:01.817398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844f29b-6bcd-44c0-99d6-7e6ddb4fd081 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:01.873809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c36de-9865-4541-b9e0-fc30440cd62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:01.874446 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c36de-9865-4541-b9e0-fc30440cd62f admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:01.874767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c36de-9865-4541-b9e0-fc30440cd62f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:01.875044 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c36de-9865-4541-b9e0-fc30440cd62f admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:01.875728 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c36de-9865-4541-b9e0-fc30440cd62f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:01.877707 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c36de-9865-4541-b9e0-fc30440cd62f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:01.900149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1227/2471] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:31:01 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:31:01.904137 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc190f-bdec-45fa-b79a-304e84caeb94 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:01.915728 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbcc190f-bdec-45fa-b79a-304e84caeb94 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:01.920430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec023def-0ab9-4cdd-a7df-2cf3e4b8648c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:01.921050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec023def-0ab9-4cdd-a7df-2cf3e4b8648c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:01.921323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec023def-0ab9-4cdd-a7df-2cf3e4b8648c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:01.921593 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec023def-0ab9-4cdd-a7df-2cf3e4b8648c admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:01.922279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec023def-0ab9-4cdd-a7df-2cf3e4b8648c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:01.923907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec023def-0ab9-4cdd-a7df-2cf3e4b8648c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:01.935030 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1245/2472] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:31:01.939060 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c36de-9865-4541-b9e0-fc30440cd62f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:01.949613 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c36de-9865-4541-b9e0-fc30440cd62f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:01.954451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9a991e-bec5-4646-8039-9be74b283dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:01.955300 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a991e-bec5-4646-8039-9be74b283dba admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:01.955594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a991e-bec5-4646-8039-9be74b283dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:01.955869 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9a991e-bec5-4646-8039-9be74b283dba admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:01.956567 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a991e-bec5-4646-8039-9be74b283dba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:01.958214 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9a991e-bec5-4646-8039-9be74b283dba admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:01.969265 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1228/2473] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:31:01.973839 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec023def-0ab9-4cdd-a7df-2cf3e4b8648c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:01.984188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec023def-0ab9-4cdd-a7df-2cf3e4b8648c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:01.989449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388bc1b-228d-480c-9aab-a33a36d378fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:01.990117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388bc1b-228d-480c-9aab-a33a36d378fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:01.990399 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388bc1b-228d-480c-9aab-a33a36d378fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:01.990709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388bc1b-228d-480c-9aab-a33a36d378fe admin admin] PATH_INFO: `/v3/projects/0f7ba5d9445e445ea3923050f860a177/users/953d488fefce4d6e923d8b4638bfe81f/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:02.006673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388bc1b-228d-480c-9aab-a33a36d378fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f7ba5d9445e445ea3923050f860a177, user_id=953d488fefce4d6e923d8b4638bfe81f, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:02.009350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3388bc1b-228d-480c-9aab-a33a36d378fe admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:02.024710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1246/2474] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:01 2022] PUT /identity/v3/projects/0f7ba5d9445e445ea3923050f860a177/users/953d488fefce4d6e923d8b4638bfe81f/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:02.036576 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0df23-96be-4bbe-bb86-f74581a8d334 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:02.036866 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0df23-96be-4bbe-bb86-f74581a8d334 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:02.037139 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a0df23-96be-4bbe-bb86-f74581a8d334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:02.066283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b1a0df23-96be-4bbe-bb86-f74581a8d334 None None] MFA Rules not processed for user `953d488fefce4d6e923d8b4638bfe81f`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:02.067530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b1a0df23-96be-4bbe-bb86-f74581a8d334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:02.072854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:02.135495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1229/2475] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:02.140007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388bc1b-228d-480c-9aab-a33a36d378fe admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:02.203001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3388bc1b-228d-480c-9aab-a33a36d378fe admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:02.207643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2417ad-2645-4a00-9f3e-c63f0d23f1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:02.208257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2417ad-2645-4a00-9f3e-c63f0d23f1bf admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:02.208540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2417ad-2645-4a00-9f3e-c63f0d23f1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:02.208811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2417ad-2645-4a00-9f3e-c63f0d23f1bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:02.209469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2417ad-2645-4a00-9f3e-c63f0d23f1bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:02.211410 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2417ad-2645-4a00-9f3e-c63f0d23f1bf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:02.238595 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1247/2476] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:02 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:31:02.242829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0df23-96be-4bbe-bb86-f74581a8d334 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:02.254561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a0df23-96be-4bbe-bb86-f74581a8d334 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:02.311684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffbe12-bdc6-499c-aa53-83ec17ba08a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:02.312309 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffbe12-bdc6-499c-aa53-83ec17ba08a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:02.312590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffbe12-bdc6-499c-aa53-83ec17ba08a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:02.312860 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dffbe12-bdc6-499c-aa53-83ec17ba08a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:02.313521 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffbe12-bdc6-499c-aa53-83ec17ba08a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:02.315574 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dffbe12-bdc6-499c-aa53-83ec17ba08a5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:02.337494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1230/2477] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:31:02 2022] POST /identity/v3/users => generated 300 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:31:02.341645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2417ad-2645-4a00-9f3e-c63f0d23f1bf admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:02.352788 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2417ad-2645-4a00-9f3e-c63f0d23f1bf admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:02.357446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ecd16-bbc6-43a9-8130-f749c9ff4be9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:02.358058 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ecd16-bbc6-43a9-8130-f749c9ff4be9 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:02.358335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ecd16-bbc6-43a9-8130-f749c9ff4be9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:02.358626 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6ecd16-bbc6-43a9-8130-f749c9ff4be9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:02.359316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ecd16-bbc6-43a9-8130-f749c9ff4be9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:02.360897 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6ecd16-bbc6-43a9-8130-f749c9ff4be9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:02.372213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1248/2478] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:31:02.376695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffbe12-bdc6-499c-aa53-83ec17ba08a5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:02.387489 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dffbe12-bdc6-499c-aa53-83ec17ba08a5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:02.392114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ad02a-394f-40ae-9197-6a75c8919b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:02.392782 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ad02a-394f-40ae-9197-6a75c8919b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:02.393067 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ad02a-394f-40ae-9197-6a75c8919b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:02.393346 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42ad02a-394f-40ae-9197-6a75c8919b45 admin admin] PATH_INFO: `/v3/projects/0bd2a1b9de6e4764a9c7085f6961e2d9/users/ee38a31283f24e1d9eca6fc1b4b95571/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:02.410794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ad02a-394f-40ae-9197-6a75c8919b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd2a1b9de6e4764a9c7085f6961e2d9, user_id=ee38a31283f24e1d9eca6fc1b4b95571, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:02.413562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42ad02a-394f-40ae-9197-6a75c8919b45 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:02.427548 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1231/2479] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:02 2022] PUT /identity/v3/projects/0bd2a1b9de6e4764a9c7085f6961e2d9/users/ee38a31283f24e1d9eca6fc1b4b95571/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:02.431729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ecd16-bbc6-43a9-8130-f749c9ff4be9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:02.441847 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6ecd16-bbc6-43a9-8130-f749c9ff4be9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:02.504883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c636c0d-8f0f-4307-90e6-38c181181fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:02.505498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636c0d-8f0f-4307-90e6-38c181181fe9 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:02.505780 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636c0d-8f0f-4307-90e6-38c181181fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:02.506041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c636c0d-8f0f-4307-90e6-38c181181fe9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:02.506769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c636c0d-8f0f-4307-90e6-38c181181fe9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:02.508415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c636c0d-8f0f-4307-90e6-38c181181fe9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:02.513853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:02.520622 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1249/2480] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:02 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:31:02.524391 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ad02a-394f-40ae-9197-6a75c8919b45 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:02.536470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42ad02a-394f-40ae-9197-6a75c8919b45 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:02.542241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775bcf5-bab7-4658-8748-a9fdfa576b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:02.543085 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775bcf5-bab7-4658-8748-a9fdfa576b9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:02.543373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775bcf5-bab7-4658-8748-a9fdfa576b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:02.543763 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9775bcf5-bab7-4658-8748-a9fdfa576b9c admin admin] PATH_INFO: `/v3/projects/0bd2a1b9de6e4764a9c7085f6961e2d9/users/ee38a31283f24e1d9eca6fc1b4b95571/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:02.545898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775bcf5-bab7-4658-8748-a9fdfa576b9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bd2a1b9de6e4764a9c7085f6961e2d9, user_id=ee38a31283f24e1d9eca6fc1b4b95571, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:02.549041 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9775bcf5-bab7-4658-8748-a9fdfa576b9c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:02.561710 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1232/2481] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:02 2022] PUT /identity/v3/projects/0bd2a1b9de6e4764a9c7085f6961e2d9/users/ee38a31283f24e1d9eca6fc1b4b95571/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:02.572667 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47567e88-64ba-486d-884d-8b204339cdd9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:02.573035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47567e88-64ba-486d-884d-8b204339cdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:02.573318 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47567e88-64ba-486d-884d-8b204339cdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:02.603707 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-47567e88-64ba-486d-884d-8b204339cdd9 None None] MFA Rules not processed for user `ee38a31283f24e1d9eca6fc1b4b95571`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:02.605104 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-47567e88-64ba-486d-884d-8b204339cdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:02.677117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1250/2482] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:02 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:02.689431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775bcf5-bab7-4658-8748-a9fdfa576b9c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:02.691909 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9775bcf5-bab7-4658-8748-a9fdfa576b9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:02.751578 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9775bcf5-bab7-4658-8748-a9fdfa576b9c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:02.755184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a5231-8a3b-4127-aa7a-653cf0a021e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:02.755800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a5231-8a3b-4127-aa7a-653cf0a021e7 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:02.756080 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a5231-8a3b-4127-aa7a-653cf0a021e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:02.756360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a5231-8a3b-4127-aa7a-653cf0a021e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:02.765396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a5231-8a3b-4127-aa7a-653cf0a021e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:02.766877 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a5231-8a3b-4127-aa7a-653cf0a021e7 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:02.776247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1233/2483] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:02 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:02.805273 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47567e88-64ba-486d-884d-8b204339cdd9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:02.868389 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47567e88-64ba-486d-884d-8b204339cdd9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:02.872984 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd8efd-706a-4fbc-918e-b1e2795bd3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:02.873616 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd8efd-706a-4fbc-918e-b1e2795bd3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:02.873895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd8efd-706a-4fbc-918e-b1e2795bd3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:02.874167 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffd8efd-706a-4fbc-918e-b1e2795bd3f3 admin admin] PATH_INFO: `/v3/users/953d488fefce4d6e923d8b4638bfe81f` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:02.875350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd8efd-706a-4fbc-918e-b1e2795bd3f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=953d488fefce4d6e923d8b4638bfe81f)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:02.877304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffd8efd-706a-4fbc-918e-b1e2795bd3f3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:02.925314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-dffd8efd-706a-4fbc-918e-b1e2795bd3f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953d488fefce4d6e923d8b4638bfe81f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:02.937729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-dffd8efd-706a-4fbc-918e-b1e2795bd3f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953d488fefce4d6e923d8b4638bfe81f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:02.945492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-dffd8efd-706a-4fbc-918e-b1e2795bd3f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953d488fefce4d6e923d8b4638bfe81f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:02.946233 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-dffd8efd-706a-4fbc-918e-b1e2795bd3f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953d488fefce4d6e923d8b4638bfe81f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:02.954631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-dffd8efd-706a-4fbc-918e-b1e2795bd3f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953d488fefce4d6e923d8b4638bfe81f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:02.961043 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1251/2484] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:02 2022] DELETE /identity/v3/users/953d488fefce4d6e923d8b4638bfe81f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:02.965861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f6b8-53ed-4850-bbf2-09015a604ebb None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:02.966144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f6b8-53ed-4850-bbf2-09015a604ebb None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:02.966417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1652f6b8-53ed-4850-bbf2-09015a604ebb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:02.973663 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:02.987587 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1652f6b8-53ed-4850-bbf2-09015a604ebb None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:02.988794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1652f6b8-53ed-4850-bbf2-09015a604ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:03.050789 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1234/2485] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:03.060558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd8efd-706a-4fbc-918e-b1e2795bd3f3 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:03.062005 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-dffd8efd-706a-4fbc-918e-b1e2795bd3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:03.069601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:03.121567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffd8efd-706a-4fbc-918e-b1e2795bd3f3 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:03.125224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab07ff-6555-4147-947f-aa0f485c30ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:03.125840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab07ff-6555-4147-947f-aa0f485c30ba service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:03.126118 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab07ff-6555-4147-947f-aa0f485c30ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:03.126388 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab07ff-6555-4147-947f-aa0f485c30ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:03.135448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab07ff-6555-4147-947f-aa0f485c30ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:03.136882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ab07ff-6555-4147-947f-aa0f485c30ba service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:03.146867 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1252/2486] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:03.419345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f6b8-53ed-4850-bbf2-09015a604ebb None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:03.421291 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1652f6b8-53ed-4850-bbf2-09015a604ebb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:03.436920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1652f6b8-53ed-4850-bbf2-09015a604ebb None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:03.442315 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c038b-6b1e-4e44-934a-5f09253d6375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:03.443094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c038b-6b1e-4e44-934a-5f09253d6375 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:03.443266 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c038b-6b1e-4e44-934a-5f09253d6375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:03.443539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c038b-6b1e-4e44-934a-5f09253d6375 admin admin] PATH_INFO: `/v3/projects/0f7ba5d9445e445ea3923050f860a177` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:03.444935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c038b-6b1e-4e44-934a-5f09253d6375 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f7ba5d9445e445ea3923050f860a177)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:03.446928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c038b-6b1e-4e44-934a-5f09253d6375 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:03.503974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-919c038b-6b1e-4e44-934a-5f09253d6375 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f7ba5d9445e445ea3923050f860a177', 'request_id': 'req-919c038b-6b1e-4e44-934a-5f09253d6375'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:03.510042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-919c038b-6b1e-4e44-934a-5f09253d6375 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f7ba5d9445e445ea3923050f860a177', 'request_id': 'req-919c038b-6b1e-4e44-934a-5f09253d6375'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:03.517442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-919c038b-6b1e-4e44-934a-5f09253d6375 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f7ba5d9445e445ea3923050f860a177', 'request_id': 'req-919c038b-6b1e-4e44-934a-5f09253d6375'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:03.531193 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-919c038b-6b1e-4e44-934a-5f09253d6375 admin admin] The token cache is being invalidate because project 0f7ba5d9445e445ea3923050f860a177 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:03.531611 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-919c038b-6b1e-4e44-934a-5f09253d6375 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:03.532427 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-919c038b-6b1e-4e44-934a-5f09253d6375 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:03.534507 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1235/2487] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:03 2022] DELETE /identity/v3/projects/0f7ba5d9445e445ea3923050f860a177 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:03.540573 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab07ff-6555-4147-947f-aa0f485c30ba service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:03.551910 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ab07ff-6555-4147-947f-aa0f485c30ba service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:03.610562 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919b65ef-8551-4c50-802a-37efab945270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:03.611227 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b65ef-8551-4c50-802a-37efab945270 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:03.611509 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b65ef-8551-4c50-802a-37efab945270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:03.612509 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919b65ef-8551-4c50-802a-37efab945270 admin admin] PATH_INFO: `/v3/users/ee38a31283f24e1d9eca6fc1b4b95571` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:03.613704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b65ef-8551-4c50-802a-37efab945270 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee38a31283f24e1d9eca6fc1b4b95571)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:03.615745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919b65ef-8551-4c50-802a-37efab945270 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:03.662095 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-919b65ef-8551-4c50-802a-37efab945270 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee38a31283f24e1d9eca6fc1b4b95571'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:03.673760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-919b65ef-8551-4c50-802a-37efab945270 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee38a31283f24e1d9eca6fc1b4b95571'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:03.680623 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-919b65ef-8551-4c50-802a-37efab945270 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee38a31283f24e1d9eca6fc1b4b95571'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:03.681303 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-919b65ef-8551-4c50-802a-37efab945270 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee38a31283f24e1d9eca6fc1b4b95571'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:03.690500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-919b65ef-8551-4c50-802a-37efab945270 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee38a31283f24e1d9eca6fc1b4b95571'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:03.696926 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1253/2488] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:03 2022] DELETE /identity/v3/users/ee38a31283f24e1d9eca6fc1b4b95571 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:03.989551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c038b-6b1e-4e44-934a-5f09253d6375 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:03.991087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-919c038b-6b1e-4e44-934a-5f09253d6375 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:04.007467 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c038b-6b1e-4e44-934a-5f09253d6375 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:04.075395 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d7a0072-f15e-42bd-979d-33a9c8f099c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:04.075947 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a0072-f15e-42bd-979d-33a9c8f099c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:04.076225 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a0072-f15e-42bd-979d-33a9c8f099c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:04.076501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7a0072-f15e-42bd-979d-33a9c8f099c8 admin admin] PATH_INFO: `/v3/projects/0bd2a1b9de6e4764a9c7085f6961e2d9` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:04.077697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a0072-f15e-42bd-979d-33a9c8f099c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bd2a1b9de6e4764a9c7085f6961e2d9)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:04.079685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d7a0072-f15e-42bd-979d-33a9c8f099c8 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:04.112475 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:04.129854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1d7a0072-f15e-42bd-979d-33a9c8f099c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bd2a1b9de6e4764a9c7085f6961e2d9', 'request_id': 'req-1d7a0072-f15e-42bd-979d-33a9c8f099c8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:04.135405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1d7a0072-f15e-42bd-979d-33a9c8f099c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bd2a1b9de6e4764a9c7085f6961e2d9', 'request_id': 'req-1d7a0072-f15e-42bd-979d-33a9c8f099c8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:04.147398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1d7a0072-f15e-42bd-979d-33a9c8f099c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bd2a1b9de6e4764a9c7085f6961e2d9', 'request_id': 'req-1d7a0072-f15e-42bd-979d-33a9c8f099c8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:04.159540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1d7a0072-f15e-42bd-979d-33a9c8f099c8 admin admin] The token cache is being invalidate because project 0bd2a1b9de6e4764a9c7085f6961e2d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:04.160262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1d7a0072-f15e-42bd-979d-33a9c8f099c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:04.161518 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1d7a0072-f15e-42bd-979d-33a9c8f099c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:04.162247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1236/2489] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:03 2022] DELETE /identity/v3/projects/0bd2a1b9de6e4764a9c7085f6961e2d9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:04.167275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf9c97-a705-44a1-aae6-157e79de7778 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:04.167568 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf9c97-a705-44a1-aae6-157e79de7778 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:04.167845 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43cf9c97-a705-44a1-aae6-157e79de7778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:04.187564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-43cf9c97-a705-44a1-aae6-157e79de7778 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:04.188784 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-43cf9c97-a705-44a1-aae6-157e79de7778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:04.211568 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:04.261700 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1254/2490] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:04.270004 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bf5cb-f2e7-4e9e-8ac3-b8b01c770cd0 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:04.270293 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bf5cb-f2e7-4e9e-8ac3-b8b01c770cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:04.270605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753bf5cb-f2e7-4e9e-8ac3-b8b01c770cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:04.290659 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-753bf5cb-f2e7-4e9e-8ac3-b8b01c770cd0 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:04.291896 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-753bf5cb-f2e7-4e9e-8ac3-b8b01c770cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:04.300225 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1237/2491] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:31:04.304528 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf9c97-a705-44a1-aae6-157e79de7778 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:04.314625 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43cf9c97-a705-44a1-aae6-157e79de7778 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:04.320169 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede59bdc-aa77-4fda-a485-fd2f4c93511f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:04.320808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede59bdc-aa77-4fda-a485-fd2f4c93511f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:04.321080 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede59bdc-aa77-4fda-a485-fd2f4c93511f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:04.321348 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede59bdc-aa77-4fda-a485-fd2f4c93511f admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:04.322031 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede59bdc-aa77-4fda-a485-fd2f4c93511f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:31:04.322326 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede59bdc-aa77-4fda-a485-fd2f4c93511f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:04.323946 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede59bdc-aa77-4fda-a485-fd2f4c93511f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:04.341972 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1255/2492] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:31:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:31:04.346378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bf5cb-f2e7-4e9e-8ac3-b8b01c770cd0 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:04.355937 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753bf5cb-f2e7-4e9e-8ac3-b8b01c770cd0 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:04.360683 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52ca12-4051-4e54-a73c-4950adc7cda8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:04.361309 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52ca12-4051-4e54-a73c-4950adc7cda8 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:04.361587 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52ca12-4051-4e54-a73c-4950adc7cda8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:04.361864 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e52ca12-4051-4e54-a73c-4950adc7cda8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:04.362540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52ca12-4051-4e54-a73c-4950adc7cda8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:04.364525 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e52ca12-4051-4e54-a73c-4950adc7cda8 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:04.396345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1238/2493] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:04 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:04.401786 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede59bdc-aa77-4fda-a485-fd2f4c93511f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:04.411952 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede59bdc-aa77-4fda-a485-fd2f4c93511f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:04.472111 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dda2ea-8eb6-473d-8a96-ed31e4745044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:04.472726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dda2ea-8eb6-473d-8a96-ed31e4745044 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:04.473003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dda2ea-8eb6-473d-8a96-ed31e4745044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:04.473274 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dda2ea-8eb6-473d-8a96-ed31e4745044 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:04.473940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dda2ea-8eb6-473d-8a96-ed31e4745044 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:04.475897 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dda2ea-8eb6-473d-8a96-ed31e4745044 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:04.506125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1256/2494] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:31:04 2022] POST /identity/v3/users => generated 297 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:04.511307 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52ca12-4051-4e54-a73c-4950adc7cda8 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:04.523064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e52ca12-4051-4e54-a73c-4950adc7cda8 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:04.527769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66b616-e6c1-4895-8ea9-ac3aaff1f3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:04.528370 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66b616-e6c1-4895-8ea9-ac3aaff1f3a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:04.528651 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66b616-e6c1-4895-8ea9-ac3aaff1f3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:04.528932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f66b616-e6c1-4895-8ea9-ac3aaff1f3a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:04.529612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66b616-e6c1-4895-8ea9-ac3aaff1f3a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:04.531417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f66b616-e6c1-4895-8ea9-ac3aaff1f3a3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:04.542759 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1239/2495] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:04.548354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dda2ea-8eb6-473d-8a96-ed31e4745044 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:04.558795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dda2ea-8eb6-473d-8a96-ed31e4745044 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:04.563630 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f0f17-7f84-4264-bf55-d48e2f93c3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:04.564245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f0f17-7f84-4264-bf55-d48e2f93c3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:04.564527 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f0f17-7f84-4264-bf55-d48e2f93c3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:04.564830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f0f17-7f84-4264-bf55-d48e2f93c3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:04.565531 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f0f17-7f84-4264-bf55-d48e2f93c3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:04.567169 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f0f17-7f84-4264-bf55-d48e2f93c3a1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:04.578765 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1257/2496] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:04.583519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66b616-e6c1-4895-8ea9-ac3aaff1f3a3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:04.593904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f66b616-e6c1-4895-8ea9-ac3aaff1f3a3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:04.599094 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88eb4b-3429-4a35-bc18-0e43a18ab089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:04.599757 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88eb4b-3429-4a35-bc18-0e43a18ab089 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:04.600225 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88eb4b-3429-4a35-bc18-0e43a18ab089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:04.600355 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf88eb4b-3429-4a35-bc18-0e43a18ab089 admin admin] PATH_INFO: `/v3/projects/63076b3484144d33a63e59c698976897/users/7b9b67e5f07b44519e4044f6379cfcb2/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:04.615400 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88eb4b-3429-4a35-bc18-0e43a18ab089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63076b3484144d33a63e59c698976897, user_id=7b9b67e5f07b44519e4044f6379cfcb2, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:04.618072 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf88eb4b-3429-4a35-bc18-0e43a18ab089 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:04.631931 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1240/2497] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:04 2022] PUT /identity/v3/projects/63076b3484144d33a63e59c698976897/users/7b9b67e5f07b44519e4044f6379cfcb2/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:04.643859 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b3554-1e56-49c1-b7fc-58c8ebcebb03 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:04.644142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b3554-1e56-49c1-b7fc-58c8ebcebb03 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:04.644414 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b3554-1e56-49c1-b7fc-58c8ebcebb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:04.681056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-848b3554-1e56-49c1-b7fc-58c8ebcebb03 None None] MFA Rules not processed for user `7b9b67e5f07b44519e4044f6379cfcb2`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:04.681056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-848b3554-1e56-49c1-b7fc-58c8ebcebb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:04.749917 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1258/2498] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:04.759156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88eb4b-3429-4a35-bc18-0e43a18ab089 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:04.824843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf88eb4b-3429-4a35-bc18-0e43a18ab089 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:04.829731 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e922d-7a8f-4b9e-b339-ddab6303324a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:04.830904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e922d-7a8f-4b9e-b339-ddab6303324a admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:04.831207 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e922d-7a8f-4b9e-b339-ddab6303324a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:04.831511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058e922d-7a8f-4b9e-b339-ddab6303324a admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:04.832174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e922d-7a8f-4b9e-b339-ddab6303324a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:04.834228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058e922d-7a8f-4b9e-b339-ddab6303324a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:04.861917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1241/2499] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:04 2022] POST /identity/v3/projects => generated 389 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:04.866350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b3554-1e56-49c1-b7fc-58c8ebcebb03 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:04.878042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b3554-1e56-49c1-b7fc-58c8ebcebb03 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:04.898853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:04.940293 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9f41d-9bf8-488b-97a5-f56dbaa5e279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:04.940915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9f41d-9bf8-488b-97a5-f56dbaa5e279 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:04.941194 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9f41d-9bf8-488b-97a5-f56dbaa5e279 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:04.941465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d9f41d-9bf8-488b-97a5-f56dbaa5e279 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:04.942225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9f41d-9bf8-488b-97a5-f56dbaa5e279 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:04.944527 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d9f41d-9bf8-488b-97a5-f56dbaa5e279 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:04.967870 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1259/2500] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:31:04 2022] POST /identity/v3/users => generated 301 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:04.972385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e922d-7a8f-4b9e-b339-ddab6303324a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:04.982995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058e922d-7a8f-4b9e-b339-ddab6303324a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:04.988202 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8da9ad-1db1-4052-bdc2-dfa19c4d599b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:04.988817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8da9ad-1db1-4052-bdc2-dfa19c4d599b admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:04.989092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8da9ad-1db1-4052-bdc2-dfa19c4d599b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:04.989361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de8da9ad-1db1-4052-bdc2-dfa19c4d599b admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:04.990046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8da9ad-1db1-4052-bdc2-dfa19c4d599b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:04.991701 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de8da9ad-1db1-4052-bdc2-dfa19c4d599b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:05.002961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1242/2501] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:05.007228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9f41d-9bf8-488b-97a5-f56dbaa5e279 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:05.017753 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d9f41d-9bf8-488b-97a5-f56dbaa5e279 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:05.023089 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44456dc8-4c10-4914-b27e-c9aaee0cdb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:05.023774 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44456dc8-4c10-4914-b27e-c9aaee0cdb71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:05.024055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44456dc8-4c10-4914-b27e-c9aaee0cdb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:05.024337 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44456dc8-4c10-4914-b27e-c9aaee0cdb71 admin admin] PATH_INFO: `/v3/projects/b1a9e2b815934e909e57534cc8ef3645/users/28e24c1b723644c987f1472f81317565/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:05.040383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44456dc8-4c10-4914-b27e-c9aaee0cdb71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a9e2b815934e909e57534cc8ef3645, user_id=28e24c1b723644c987f1472f81317565, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:05.043072 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44456dc8-4c10-4914-b27e-c9aaee0cdb71 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:05.060040 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1260/2502] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:05 2022] PUT /identity/v3/projects/b1a9e2b815934e909e57534cc8ef3645/users/28e24c1b723644c987f1472f81317565/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:05.064149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8da9ad-1db1-4052-bdc2-dfa19c4d599b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:05.074810 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de8da9ad-1db1-4052-bdc2-dfa19c4d599b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:05.102109 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:05.137542 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87bd31d-9080-482a-9ba2-0a10908568a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:05.138068 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bd31d-9080-482a-9ba2-0a10908568a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:05.138349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bd31d-9080-482a-9ba2-0a10908568a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:05.138678 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87bd31d-9080-482a-9ba2-0a10908568a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:05.139377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bd31d-9080-482a-9ba2-0a10908568a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:05.141009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b87bd31d-9080-482a-9ba2-0a10908568a7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:05.152205 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1243/2503] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:05 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:05.156545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44456dc8-4c10-4914-b27e-c9aaee0cdb71 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:05.167692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44456dc8-4c10-4914-b27e-c9aaee0cdb71 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:05.172517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25dc78-dddf-4b1d-974b-4348606c90e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:05.173183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25dc78-dddf-4b1d-974b-4348606c90e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:05.173470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25dc78-dddf-4b1d-974b-4348606c90e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:05.173745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae25dc78-dddf-4b1d-974b-4348606c90e0 admin admin] PATH_INFO: `/v3/projects/b1a9e2b815934e909e57534cc8ef3645/users/28e24c1b723644c987f1472f81317565/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:05.175741 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25dc78-dddf-4b1d-974b-4348606c90e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1a9e2b815934e909e57534cc8ef3645, user_id=28e24c1b723644c987f1472f81317565, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:05.178397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae25dc78-dddf-4b1d-974b-4348606c90e0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:05.189200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1261/2504] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:05 2022] PUT /identity/v3/projects/b1a9e2b815934e909e57534cc8ef3645/users/28e24c1b723644c987f1472f81317565/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:05.199973 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112123-4b49-4b4d-ba10-f75a917077ec None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:05.200261 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112123-4b49-4b4d-ba10-f75a917077ec None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:05.200539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93112123-4b49-4b4d-ba10-f75a917077ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:05.233121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-93112123-4b49-4b4d-ba10-f75a917077ec None None] MFA Rules not processed for user `28e24c1b723644c987f1472f81317565`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:05.234289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-93112123-4b49-4b4d-ba10-f75a917077ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:05.310361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1244/2505] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:05 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:05.322566 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25dc78-dddf-4b1d-974b-4348606c90e0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:05.324419 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ae25dc78-dddf-4b1d-974b-4348606c90e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:05.385896 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae25dc78-dddf-4b1d-974b-4348606c90e0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:05.389719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93aa823-b4ed-43f7-be15-78ac9d67e8f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:05.390275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93aa823-b4ed-43f7-be15-78ac9d67e8f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:05.390554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93aa823-b4ed-43f7-be15-78ac9d67e8f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:05.390854 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93aa823-b4ed-43f7-be15-78ac9d67e8f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:05.400859 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93aa823-b4ed-43f7-be15-78ac9d67e8f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:05.402318 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93aa823-b4ed-43f7-be15-78ac9d67e8f3 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:05.413885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1262/2506] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:05 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:05.465134 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93112123-4b49-4b4d-ba10-f75a917077ec None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:05.466543 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-93112123-4b49-4b4d-ba10-f75a917077ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:05.479745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93112123-4b49-4b4d-ba10-f75a917077ec None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:05.488837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a0e41-4b68-4ff3-8da3-cd66c65c86bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:05.489469 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a0e41-4b68-4ff3-8da3-cd66c65c86bb service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:05.489747 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a0e41-4b68-4ff3-8da3-cd66c65c86bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:05.490021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a0e41-4b68-4ff3-8da3-cd66c65c86bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:05.548651 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a0e41-4b68-4ff3-8da3-cd66c65c86bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:05.550141 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a0e41-4b68-4ff3-8da3-cd66c65c86bb service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:05.560655 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1245/2507] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:08.902772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93aa823-b4ed-43f7-be15-78ac9d67e8f3 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:08.966765 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93aa823-b4ed-43f7-be15-78ac9d67e8f3 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:08.971541 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b223a-6a14-4b32-86a4-b8155200315e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:08.972173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b223a-6a14-4b32-86a4-b8155200315e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:08.972448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b223a-6a14-4b32-86a4-b8155200315e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:08.972789 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28b223a-6a14-4b32-86a4-b8155200315e admin admin] PATH_INFO: `/v3/users/7b9b67e5f07b44519e4044f6379cfcb2` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:08.973970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b223a-6a14-4b32-86a4-b8155200315e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b9b67e5f07b44519e4044f6379cfcb2)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:08.975930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28b223a-6a14-4b32-86a4-b8155200315e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:09.001500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:09.031438 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e28b223a-6a14-4b32-86a4-b8155200315e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b9b67e5f07b44519e4044f6379cfcb2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:09.043903 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e28b223a-6a14-4b32-86a4-b8155200315e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b9b67e5f07b44519e4044f6379cfcb2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:09.050851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e28b223a-6a14-4b32-86a4-b8155200315e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b9b67e5f07b44519e4044f6379cfcb2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:09.051727 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e28b223a-6a14-4b32-86a4-b8155200315e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b9b67e5f07b44519e4044f6379cfcb2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:09.059455 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e28b223a-6a14-4b32-86a4-b8155200315e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b9b67e5f07b44519e4044f6379cfcb2'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:09.066041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1263/2508] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:08 2022] DELETE /identity/v3/users/7b9b67e5f07b44519e4044f6379cfcb2 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:09.071414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01443034-9313-461f-9d78-47aea3bab22a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:09.071925 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01443034-9313-461f-9d78-47aea3bab22a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:09.072042 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01443034-9313-461f-9d78-47aea3bab22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:09.094494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-01443034-9313-461f-9d78-47aea3bab22a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:09.094494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-01443034-9313-461f-9d78-47aea3bab22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:09.136659 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:09.155148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1246/2509] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:09.165658 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b223a-6a14-4b32-86a4-b8155200315e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:09.167129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e28b223a-6a14-4b32-86a4-b8155200315e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:09.228346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28b223a-6a14-4b32-86a4-b8155200315e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:09.232708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2587c-48bf-4df7-9292-9949c7d62ffe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:09.233198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2587c-48bf-4df7-9292-9949c7d62ffe service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:09.233473 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2587c-48bf-4df7-9292-9949c7d62ffe service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:09.233743 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d2587c-48bf-4df7-9292-9949c7d62ffe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:09.244519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2587c-48bf-4df7-9292-9949c7d62ffe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:09.247225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d2587c-48bf-4df7-9292-9949c7d62ffe service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:09.261312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1264/2510] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:09.551404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01443034-9313-461f-9d78-47aea3bab22a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:09.554670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-01443034-9313-461f-9d78-47aea3bab22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:09.571243 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01443034-9313-461f-9d78-47aea3bab22a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:09.577595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26949897-6e7b-4d97-b806-e629570d67d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:09.578288 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26949897-6e7b-4d97-b806-e629570d67d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:09.578641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26949897-6e7b-4d97-b806-e629570d67d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:09.578860 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26949897-6e7b-4d97-b806-e629570d67d5 admin admin] PATH_INFO: `/v3/projects/63076b3484144d33a63e59c698976897` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:09.580764 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26949897-6e7b-4d97-b806-e629570d67d5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63076b3484144d33a63e59c698976897)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:09.582768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26949897-6e7b-4d97-b806-e629570d67d5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:09.633841 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-26949897-6e7b-4d97-b806-e629570d67d5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63076b3484144d33a63e59c698976897', 'request_id': 'req-26949897-6e7b-4d97-b806-e629570d67d5'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:09.639603 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-26949897-6e7b-4d97-b806-e629570d67d5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63076b3484144d33a63e59c698976897', 'request_id': 'req-26949897-6e7b-4d97-b806-e629570d67d5'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:09.648181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-26949897-6e7b-4d97-b806-e629570d67d5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63076b3484144d33a63e59c698976897', 'request_id': 'req-26949897-6e7b-4d97-b806-e629570d67d5'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:09.660430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-26949897-6e7b-4d97-b806-e629570d67d5 admin admin] The token cache is being invalidate because project 63076b3484144d33a63e59c698976897 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:09.660715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-26949897-6e7b-4d97-b806-e629570d67d5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:09.661527 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-26949897-6e7b-4d97-b806-e629570d67d5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:09.663091 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1247/2511] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:09 2022] DELETE /identity/v3/projects/63076b3484144d33a63e59c698976897 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:09.667304 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2587c-48bf-4df7-9292-9949c7d62ffe service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:09.677389 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d2587c-48bf-4df7-9292-9949c7d62ffe service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:09.738609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0656eeed-b0a6-4c63-895a-e5e2d0700ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:09.739266 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656eeed-b0a6-4c63-895a-e5e2d0700ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:09.739548 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656eeed-b0a6-4c63-895a-e5e2d0700ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:09.739827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0656eeed-b0a6-4c63-895a-e5e2d0700ce6 admin admin] PATH_INFO: `/v3/users/28e24c1b723644c987f1472f81317565` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:09.741009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656eeed-b0a6-4c63-895a-e5e2d0700ce6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=28e24c1b723644c987f1472f81317565)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:09.742999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0656eeed-b0a6-4c63-895a-e5e2d0700ce6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:09.787690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:09.793580 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0656eeed-b0a6-4c63-895a-e5e2d0700ce6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '28e24c1b723644c987f1472f81317565'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:09.806947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0656eeed-b0a6-4c63-895a-e5e2d0700ce6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '28e24c1b723644c987f1472f81317565'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:09.813985 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0656eeed-b0a6-4c63-895a-e5e2d0700ce6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '28e24c1b723644c987f1472f81317565'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:09.815247 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0656eeed-b0a6-4c63-895a-e5e2d0700ce6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '28e24c1b723644c987f1472f81317565'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:09.823410 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0656eeed-b0a6-4c63-895a-e5e2d0700ce6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '28e24c1b723644c987f1472f81317565'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:09.829742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1265/2512] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:09 2022] DELETE /identity/v3/users/28e24c1b723644c987f1472f81317565 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:10.119771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26949897-6e7b-4d97-b806-e629570d67d5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:10.121735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-26949897-6e7b-4d97-b806-e629570d67d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:10.140275 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26949897-6e7b-4d97-b806-e629570d67d5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:10.202373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc6cb04-887f-4fde-89dd-a2446a987faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:10.203082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6cb04-887f-4fde-89dd-a2446a987faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:10.203470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6cb04-887f-4fde-89dd-a2446a987faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:10.203748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc6cb04-887f-4fde-89dd-a2446a987faf admin admin] PATH_INFO: `/v3/projects/b1a9e2b815934e909e57534cc8ef3645` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:10.205480 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6cb04-887f-4fde-89dd-a2446a987faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1a9e2b815934e909e57534cc8ef3645)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:10.207620 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc6cb04-887f-4fde-89dd-a2446a987faf admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:10.258110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-afc6cb04-887f-4fde-89dd-a2446a987faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1a9e2b815934e909e57534cc8ef3645', 'request_id': 'req-afc6cb04-887f-4fde-89dd-a2446a987faf'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:10.263553 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-afc6cb04-887f-4fde-89dd-a2446a987faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1a9e2b815934e909e57534cc8ef3645', 'request_id': 'req-afc6cb04-887f-4fde-89dd-a2446a987faf'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:10.273681 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-afc6cb04-887f-4fde-89dd-a2446a987faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1a9e2b815934e909e57534cc8ef3645', 'request_id': 'req-afc6cb04-887f-4fde-89dd-a2446a987faf'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:10.282070 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:10.287282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-afc6cb04-887f-4fde-89dd-a2446a987faf admin admin] The token cache is being invalidate because project b1a9e2b815934e909e57534cc8ef3645 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:10.288231 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-afc6cb04-887f-4fde-89dd-a2446a987faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:10.289259 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-afc6cb04-887f-4fde-89dd-a2446a987faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:10.291433 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1248/2513] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:10 2022] DELETE /identity/v3/projects/b1a9e2b815934e909e57534cc8ef3645 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:10.296275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e068e8c-0009-4055-97d5-be889bf6838c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:10.296793 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e068e8c-0009-4055-97d5-be889bf6838c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:10.296915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e068e8c-0009-4055-97d5-be889bf6838c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:10.316613 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4e068e8c-0009-4055-97d5-be889bf6838c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:10.317926 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4e068e8c-0009-4055-97d5-be889bf6838c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:10.378390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1266/2514] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:10.387601 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba09ad-31aa-4a47-a046-fdc273bd256a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:10.387886 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba09ad-31aa-4a47-a046-fdc273bd256a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:10.388158 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dba09ad-31aa-4a47-a046-fdc273bd256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:10.409253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2dba09ad-31aa-4a47-a046-fdc273bd256a None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:10.410560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2dba09ad-31aa-4a47-a046-fdc273bd256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:10.418459 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1249/2515] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:10.422905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e068e8c-0009-4055-97d5-be889bf6838c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:10.432914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e068e8c-0009-4055-97d5-be889bf6838c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:10.437520 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f837607-96c7-4984-8905-9be0127ed852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:10.438128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f837607-96c7-4984-8905-9be0127ed852 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:10.438401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f837607-96c7-4984-8905-9be0127ed852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:10.438699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f837607-96c7-4984-8905-9be0127ed852 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:10.439900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f837607-96c7-4984-8905-9be0127ed852 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:31:10.440202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f837607-96c7-4984-8905-9be0127ed852 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:10.441890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f837607-96c7-4984-8905-9be0127ed852 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:10.454295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1267/2516] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:31:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:31:10.459432 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba09ad-31aa-4a47-a046-fdc273bd256a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:10.468880 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dba09ad-31aa-4a47-a046-fdc273bd256a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:10.475581 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a934ea4-4e1c-4325-a803-1a4cb5fbd25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:10.476222 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934ea4-4e1c-4325-a803-1a4cb5fbd25b admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:10.476507 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934ea4-4e1c-4325-a803-1a4cb5fbd25b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:10.476780 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934ea4-4e1c-4325-a803-1a4cb5fbd25b admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:10.477443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a934ea4-4e1c-4325-a803-1a4cb5fbd25b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:10.479444 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a934ea4-4e1c-4325-a803-1a4cb5fbd25b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:10.508540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1250/2517] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:10 2022] POST /identity/v3/projects => generated 401 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:10.512752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f837607-96c7-4984-8905-9be0127ed852 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:10.523995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f837607-96c7-4984-8905-9be0127ed852 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:10.585611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ae6d7-5b2c-4d0c-a74e-67eb89d436fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:10.586142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ae6d7-5b2c-4d0c-a74e-67eb89d436fc admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:10.586419 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ae6d7-5b2c-4d0c-a74e-67eb89d436fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:10.586727 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582ae6d7-5b2c-4d0c-a74e-67eb89d436fc admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:10.587383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ae6d7-5b2c-4d0c-a74e-67eb89d436fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:10.589313 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582ae6d7-5b2c-4d0c-a74e-67eb89d436fc admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:10.611464 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1268/2518] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:31:10 2022] POST /identity/v3/users => generated 301 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:31:10.616060 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a934ea4-4e1c-4325-a803-1a4cb5fbd25b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:10.628246 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a934ea4-4e1c-4325-a803-1a4cb5fbd25b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:10.634762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dd501-41dd-4387-bcc8-ae0c71831a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:10.635390 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dd501-41dd-4387-bcc8-ae0c71831a55 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:10.635667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dd501-41dd-4387-bcc8-ae0c71831a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:10.635943 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627dd501-41dd-4387-bcc8-ae0c71831a55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:10.636633 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dd501-41dd-4387-bcc8-ae0c71831a55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:10.638243 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627dd501-41dd-4387-bcc8-ae0c71831a55 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:10.649280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1251/2519] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:31:10.653341 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ae6d7-5b2c-4d0c-a74e-67eb89d436fc admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:10.664049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582ae6d7-5b2c-4d0c-a74e-67eb89d436fc admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:10.668822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177561db-299a-4b1e-9e97-3b516da48144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:10.669432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177561db-299a-4b1e-9e97-3b516da48144 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:10.669710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177561db-299a-4b1e-9e97-3b516da48144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:10.669982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177561db-299a-4b1e-9e97-3b516da48144 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:10.670746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177561db-299a-4b1e-9e97-3b516da48144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:10.672342 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177561db-299a-4b1e-9e97-3b516da48144 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:10.683659 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1269/2520] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:10.687941 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dd501-41dd-4387-bcc8-ae0c71831a55 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:10.699499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627dd501-41dd-4387-bcc8-ae0c71831a55 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:10.704101 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651f7de-3824-480c-8917-af46200a9005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:10.704756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651f7de-3824-480c-8917-af46200a9005 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:10.705071 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651f7de-3824-480c-8917-af46200a9005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:10.705864 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651f7de-3824-480c-8917-af46200a9005 admin admin] PATH_INFO: `/v3/projects/12f535abb88e497d8083268e3112ea37/users/7985d4d2c3dc4ed39faf2c7a6b6f98fa/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:10.724254 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651f7de-3824-480c-8917-af46200a9005 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f535abb88e497d8083268e3112ea37, user_id=7985d4d2c3dc4ed39faf2c7a6b6f98fa, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:10.726987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651f7de-3824-480c-8917-af46200a9005 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:10.741388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1252/2521] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:10 2022] PUT /identity/v3/projects/12f535abb88e497d8083268e3112ea37/users/7985d4d2c3dc4ed39faf2c7a6b6f98fa/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:10.754170 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9542a7f-3a6b-4a34-90d9-2b61dee6204d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:10.754483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9542a7f-3a6b-4a34-90d9-2b61dee6204d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:10.754800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9542a7f-3a6b-4a34-90d9-2b61dee6204d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:10.784490 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b9542a7f-3a6b-4a34-90d9-2b61dee6204d None None] MFA Rules not processed for user `7985d4d2c3dc4ed39faf2c7a6b6f98fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:10.785722 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b9542a7f-3a6b-4a34-90d9-2b61dee6204d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:10.799814 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:10.862538 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1270/2522] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:10 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:10.867318 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651f7de-3824-480c-8917-af46200a9005 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:10.933906 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651f7de-3824-480c-8917-af46200a9005 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:10.938652 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111fec0-a66a-4906-9fe5-5b1a0bf92d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:10.939299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111fec0-a66a-4906-9fe5-5b1a0bf92d7f admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:10.939575 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111fec0-a66a-4906-9fe5-5b1a0bf92d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:10.939849 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3111fec0-a66a-4906-9fe5-5b1a0bf92d7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:10.940504 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111fec0-a66a-4906-9fe5-5b1a0bf92d7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:10.942453 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3111fec0-a66a-4906-9fe5-5b1a0bf92d7f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:10.970272 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1253/2523] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:10 2022] POST /identity/v3/projects => generated 399 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:10.975051 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9542a7f-3a6b-4a34-90d9-2b61dee6204d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:10.987997 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9542a7f-3a6b-4a34-90d9-2b61dee6204d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:11.054183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd52b0-6c2b-4b26-ba47-088d95bc0be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:11.054870 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd52b0-6c2b-4b26-ba47-088d95bc0be1 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:11.055157 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd52b0-6c2b-4b26-ba47-088d95bc0be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:11.055436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fd52b0-6c2b-4b26-ba47-088d95bc0be1 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:11.056099 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd52b0-6c2b-4b26-ba47-088d95bc0be1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:11.058035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fd52b0-6c2b-4b26-ba47-088d95bc0be1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:11.081322 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1271/2524] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:31:10 2022] POST /identity/v3/users => generated 306 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:11.085446 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111fec0-a66a-4906-9fe5-5b1a0bf92d7f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:11.096082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3111fec0-a66a-4906-9fe5-5b1a0bf92d7f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:11.101261 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b404024-70fe-4443-91cf-a58dd248f1c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:11.101890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b404024-70fe-4443-91cf-a58dd248f1c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:11.102174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b404024-70fe-4443-91cf-a58dd248f1c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:11.102452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b404024-70fe-4443-91cf-a58dd248f1c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:11.103202 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b404024-70fe-4443-91cf-a58dd248f1c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:11.104823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b404024-70fe-4443-91cf-a58dd248f1c0 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:11.116554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1254/2525] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:11.121021 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd52b0-6c2b-4b26-ba47-088d95bc0be1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:11.132112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fd52b0-6c2b-4b26-ba47-088d95bc0be1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:11.137892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f7110-8562-4337-8646-572444e8d7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:11.138567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f7110-8562-4337-8646-572444e8d7af admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:11.138868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f7110-8562-4337-8646-572444e8d7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:11.139143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3f7110-8562-4337-8646-572444e8d7af admin admin] PATH_INFO: `/v3/projects/d16e4ea43b9a4c428809162770402865/users/9cba0de8de8d46cdb56f312d86eacb96/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:11.154487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f7110-8562-4337-8646-572444e8d7af admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16e4ea43b9a4c428809162770402865, user_id=9cba0de8de8d46cdb56f312d86eacb96, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:11.157162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3f7110-8562-4337-8646-572444e8d7af admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:11.178921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1272/2526] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:11 2022] PUT /identity/v3/projects/d16e4ea43b9a4c428809162770402865/users/9cba0de8de8d46cdb56f312d86eacb96/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:11.182890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b404024-70fe-4443-91cf-a58dd248f1c0 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:11.193451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b404024-70fe-4443-91cf-a58dd248f1c0 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:11.256561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bf6862-1b8e-4ba3-ab65-ea8892d9a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:11.257184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf6862-1b8e-4ba3-ab65-ea8892d9a720 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:11.257461 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf6862-1b8e-4ba3-ab65-ea8892d9a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:11.257732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bf6862-1b8e-4ba3-ab65-ea8892d9a720 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:11.258417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf6862-1b8e-4ba3-ab65-ea8892d9a720 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:11.260206 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bf6862-1b8e-4ba3-ab65-ea8892d9a720 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:11.271050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1255/2527] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:11 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:11.275411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f7110-8562-4337-8646-572444e8d7af admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:11.285907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3f7110-8562-4337-8646-572444e8d7af admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:11.290710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989d7ad-fa16-40d0-a0f9-be0e848ec0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:11.291377 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989d7ad-fa16-40d0-a0f9-be0e848ec0e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:11.291656 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989d7ad-fa16-40d0-a0f9-be0e848ec0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:11.291930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989d7ad-fa16-40d0-a0f9-be0e848ec0e3 admin admin] PATH_INFO: `/v3/projects/d16e4ea43b9a4c428809162770402865/users/9cba0de8de8d46cdb56f312d86eacb96/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:11.293908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989d7ad-fa16-40d0-a0f9-be0e848ec0e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d16e4ea43b9a4c428809162770402865, user_id=9cba0de8de8d46cdb56f312d86eacb96, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:11.296585 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989d7ad-fa16-40d0-a0f9-be0e848ec0e3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:11.315668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1273/2528] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:11 2022] PUT /identity/v3/projects/d16e4ea43b9a4c428809162770402865/users/9cba0de8de8d46cdb56f312d86eacb96/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:11.326388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cb49b-d66e-4ae1-9076-2c8b218db06d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:11.326714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cb49b-d66e-4ae1-9076-2c8b218db06d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:11.327001 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942cb49b-d66e-4ae1-9076-2c8b218db06d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:11.341714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:11.363875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-942cb49b-d66e-4ae1-9076-2c8b218db06d None None] MFA Rules not processed for user `9cba0de8de8d46cdb56f312d86eacb96`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:11.365104 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-942cb49b-d66e-4ae1-9076-2c8b218db06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:11.445895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1256/2529] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:11 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:11.456704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989d7ad-fa16-40d0-a0f9-be0e848ec0e3 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:11.458423 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6989d7ad-fa16-40d0-a0f9-be0e848ec0e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:11.520397 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989d7ad-fa16-40d0-a0f9-be0e848ec0e3 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:11.524266 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56da393-6a6c-4c5a-b3f0-15042f334b08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:11.524884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56da393-6a6c-4c5a-b3f0-15042f334b08 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:11.525164 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56da393-6a6c-4c5a-b3f0-15042f334b08 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:11.525436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56da393-6a6c-4c5a-b3f0-15042f334b08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:11.535800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56da393-6a6c-4c5a-b3f0-15042f334b08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:11.537276 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56da393-6a6c-4c5a-b3f0-15042f334b08 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:11.548747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1274/2530] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:11 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:11.635046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cb49b-d66e-4ae1-9076-2c8b218db06d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:11.645416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942cb49b-d66e-4ae1-9076-2c8b218db06d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:11.649070 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1e9c14-3756-45ce-99a2-f2e2b1e2c5b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:11.649682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e9c14-3756-45ce-99a2-f2e2b1e2c5b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:11.649958 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e9c14-3756-45ce-99a2-f2e2b1e2c5b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:11.650319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1e9c14-3756-45ce-99a2-f2e2b1e2c5b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:11.714049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e9c14-3756-45ce-99a2-f2e2b1e2c5b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:11.715470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1e9c14-3756-45ce-99a2-f2e2b1e2c5b1 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:11.725093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1257/2531] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:11 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:15.844485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56da393-6a6c-4c5a-b3f0-15042f334b08 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:15.854386 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:15.908964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56da393-6a6c-4c5a-b3f0-15042f334b08 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:15.913907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05216f9-b20d-41f9-9fca-b89774cb372e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:15.914599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05216f9-b20d-41f9-9fca-b89774cb372e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:15.914890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05216f9-b20d-41f9-9fca-b89774cb372e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:15.915171 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05216f9-b20d-41f9-9fca-b89774cb372e admin admin] PATH_INFO: `/v3/users/7985d4d2c3dc4ed39faf2c7a6b6f98fa` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:15.916345 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05216f9-b20d-41f9-9fca-b89774cb372e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7985d4d2c3dc4ed39faf2c7a6b6f98fa)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:15.918277 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05216f9-b20d-41f9-9fca-b89774cb372e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:15.969668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e05216f9-b20d-41f9-9fca-b89774cb372e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7985d4d2c3dc4ed39faf2c7a6b6f98fa'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:15.983696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e05216f9-b20d-41f9-9fca-b89774cb372e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7985d4d2c3dc4ed39faf2c7a6b6f98fa'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:15.991987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e05216f9-b20d-41f9-9fca-b89774cb372e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7985d4d2c3dc4ed39faf2c7a6b6f98fa'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:15.992723 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e05216f9-b20d-41f9-9fca-b89774cb372e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7985d4d2c3dc4ed39faf2c7a6b6f98fa'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:16.001570 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e05216f9-b20d-41f9-9fca-b89774cb372e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7985d4d2c3dc4ed39faf2c7a6b6f98fa'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:16.007820 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1275/2532] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:15 2022] DELETE /identity/v3/users/7985d4d2c3dc4ed39faf2c7a6b6f98fa => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:16.012510 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bdd68-9db2-4d88-baa5-273fd444045f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:16.012966 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bdd68-9db2-4d88-baa5-273fd444045f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:16.013063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74bdd68-9db2-4d88-baa5-273fd444045f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:16.032580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f74bdd68-9db2-4d88-baa5-273fd444045f None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:16.034658 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f74bdd68-9db2-4d88-baa5-273fd444045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:16.100142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1258/2533] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:16.110078 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05216f9-b20d-41f9-9fca-b89774cb372e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:16.111535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e05216f9-b20d-41f9-9fca-b89774cb372e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:16.171561 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05216f9-b20d-41f9-9fca-b89774cb372e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:16.175334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df52c7-a4b5-4ca6-94a0-51bb7a378de7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:16.175958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df52c7-a4b5-4ca6-94a0-51bb7a378de7 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:16.176244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df52c7-a4b5-4ca6-94a0-51bb7a378de7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:16.176517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df52c7-a4b5-4ca6-94a0-51bb7a378de7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:16.191581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df52c7-a4b5-4ca6-94a0-51bb7a378de7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:16.191581 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df52c7-a4b5-4ca6-94a0-51bb7a378de7 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:16.198802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1276/2534] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:16.481876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bdd68-9db2-4d88-baa5-273fd444045f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:16.483359 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f74bdd68-9db2-4d88-baa5-273fd444045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:16.496170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74bdd68-9db2-4d88-baa5-273fd444045f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:16.501541 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:16.502198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:16.502481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:16.502788 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc admin admin] PATH_INFO: `/v3/projects/12f535abb88e497d8083268e3112ea37` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:16.503984 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f535abb88e497d8083268e3112ea37)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:16.505957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:16.541627 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:16.560225 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f535abb88e497d8083268e3112ea37', 'request_id': 'req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:16.565693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f535abb88e497d8083268e3112ea37', 'request_id': 'req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:16.574005 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f535abb88e497d8083268e3112ea37', 'request_id': 'req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:16.586158 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc admin admin] The token cache is being invalidate because project 12f535abb88e497d8083268e3112ea37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:16.586450 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:16.587136 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:16.588662 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1259/2535] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:16 2022] DELETE /identity/v3/projects/12f535abb88e497d8083268e3112ea37 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:16.592628 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df52c7-a4b5-4ca6-94a0-51bb7a378de7 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:16.603172 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df52c7-a4b5-4ca6-94a0-51bb7a378de7 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:16.633428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:16.664968 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56e0b18-ac0b-4d4d-9908-13abb25f38df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:16.665611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e0b18-ac0b-4d4d-9908-13abb25f38df admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:16.665892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e0b18-ac0b-4d4d-9908-13abb25f38df admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:16.666166 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56e0b18-ac0b-4d4d-9908-13abb25f38df admin admin] PATH_INFO: `/v3/users/9cba0de8de8d46cdb56f312d86eacb96` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:16.667431 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e0b18-ac0b-4d4d-9908-13abb25f38df admin admin] RBAC: Authorizing `identity:delete_user(user_id=9cba0de8de8d46cdb56f312d86eacb96)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:16.669355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56e0b18-ac0b-4d4d-9908-13abb25f38df admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:16.729624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e56e0b18-ac0b-4d4d-9908-13abb25f38df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9cba0de8de8d46cdb56f312d86eacb96'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:16.742564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e56e0b18-ac0b-4d4d-9908-13abb25f38df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9cba0de8de8d46cdb56f312d86eacb96'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:16.759362 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e56e0b18-ac0b-4d4d-9908-13abb25f38df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9cba0de8de8d46cdb56f312d86eacb96'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:16.760167 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e56e0b18-ac0b-4d4d-9908-13abb25f38df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9cba0de8de8d46cdb56f312d86eacb96'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:16.768008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-e56e0b18-ac0b-4d4d-9908-13abb25f38df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9cba0de8de8d46cdb56f312d86eacb96'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:16.774124 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1277/2536] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:16 2022] DELETE /identity/v3/users/9cba0de8de8d46cdb56f312d86eacb96 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:17.075282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:17.077500 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:17.095995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca4c4ca-dfcc-4811-aa3d-9c66f76494bc admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:17.158454 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8dc3b3-8be2-439c-ac2b-1e28acb461c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:17.159144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dc3b3-8be2-439c-ac2b-1e28acb461c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:17.159426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dc3b3-8be2-439c-ac2b-1e28acb461c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:17.159704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8dc3b3-8be2-439c-ac2b-1e28acb461c6 admin admin] PATH_INFO: `/v3/projects/d16e4ea43b9a4c428809162770402865` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:17.160951 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dc3b3-8be2-439c-ac2b-1e28acb461c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d16e4ea43b9a4c428809162770402865)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:17.163831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8dc3b3-8be2-439c-ac2b-1e28acb461c6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:17.213642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4a8dc3b3-8be2-439c-ac2b-1e28acb461c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd16e4ea43b9a4c428809162770402865', 'request_id': 'req-4a8dc3b3-8be2-439c-ac2b-1e28acb461c6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:17.219211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4a8dc3b3-8be2-439c-ac2b-1e28acb461c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd16e4ea43b9a4c428809162770402865', 'request_id': 'req-4a8dc3b3-8be2-439c-ac2b-1e28acb461c6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:17.226705 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4a8dc3b3-8be2-439c-ac2b-1e28acb461c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd16e4ea43b9a4c428809162770402865', 'request_id': 'req-4a8dc3b3-8be2-439c-ac2b-1e28acb461c6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:17.238745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4a8dc3b3-8be2-439c-ac2b-1e28acb461c6 admin admin] The token cache is being invalidate because project d16e4ea43b9a4c428809162770402865 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:17.239037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4a8dc3b3-8be2-439c-ac2b-1e28acb461c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:17.239688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4a8dc3b3-8be2-439c-ac2b-1e28acb461c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:17.241219 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1260/2537] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:17 2022] DELETE /identity/v3/projects/d16e4ea43b9a4c428809162770402865 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:17.247776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d248ae4-80f2-4421-ab22-5cad7a238dbb None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:17.248297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d248ae4-80f2-4421-ab22-5cad7a238dbb None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:17.248404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d248ae4-80f2-4421-ab22-5cad7a238dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:17.270602 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4d248ae4-80f2-4421-ab22-5cad7a238dbb None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:17.271830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4d248ae4-80f2-4421-ab22-5cad7a238dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:17.333899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1278/2538] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:17.342969 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e01bbe-3ea6-4d04-ac17-ae43e9e2c5d0 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:17.343258 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e01bbe-3ea6-4d04-ac17-ae43e9e2c5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:17.343540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e01bbe-3ea6-4d04-ac17-ae43e9e2c5d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:17.365256 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e4e01bbe-3ea6-4d04-ac17-ae43e9e2c5d0 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:17.366501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e4e01bbe-3ea6-4d04-ac17-ae43e9e2c5d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:17.374618 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1261/2539] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:17.379518 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d248ae4-80f2-4421-ab22-5cad7a238dbb None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:17.389411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d248ae4-80f2-4421-ab22-5cad7a238dbb None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:17.394791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e3655-ae4a-4b6a-b7ac-4d131f09e34d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:17.395421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e3655-ae4a-4b6a-b7ac-4d131f09e34d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:17.395695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e3655-ae4a-4b6a-b7ac-4d131f09e34d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:17.395970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6e3655-ae4a-4b6a-b7ac-4d131f09e34d admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:17.396697 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e3655-ae4a-4b6a-b7ac-4d131f09e34d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:31:17.396997 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e3655-ae4a-4b6a-b7ac-4d131f09e34d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:17.398613 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6e3655-ae4a-4b6a-b7ac-4d131f09e34d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:17.410880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1279/2540] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:31:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:31:17.415453 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e01bbe-3ea6-4d04-ac17-ae43e9e2c5d0 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:17.424979 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e01bbe-3ea6-4d04-ac17-ae43e9e2c5d0 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:17.429809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464482ba-5078-47f1-9b51-0e360f3f1d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:17.430432 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464482ba-5078-47f1-9b51-0e360f3f1d12 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:17.430744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464482ba-5078-47f1-9b51-0e360f3f1d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:17.431018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464482ba-5078-47f1-9b51-0e360f3f1d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:17.431681 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464482ba-5078-47f1-9b51-0e360f3f1d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:17.433845 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464482ba-5078-47f1-9b51-0e360f3f1d12 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:17.463315 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1262/2541] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:17 2022] POST /identity/v3/projects => generated 407 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:17.467833 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e3655-ae4a-4b6a-b7ac-4d131f09e34d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:17.478190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6e3655-ae4a-4b6a-b7ac-4d131f09e34d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:17.512760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:17.542619 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fa29f-736e-4a38-80e8-f9c2e96c17b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:17.543245 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fa29f-736e-4a38-80e8-f9c2e96c17b9 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:17.543521 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fa29f-736e-4a38-80e8-f9c2e96c17b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:17.543794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1fa29f-736e-4a38-80e8-f9c2e96c17b9 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:17.545520 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fa29f-736e-4a38-80e8-f9c2e96c17b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:17.546716 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1fa29f-736e-4a38-80e8-f9c2e96c17b9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:17.571021 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1280/2542] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:31:17 2022] POST /identity/v3/users => generated 304 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:17.575120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464482ba-5078-47f1-9b51-0e360f3f1d12 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:17.590253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464482ba-5078-47f1-9b51-0e360f3f1d12 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:17.594941 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d93b2-f475-48db-b9d8-c0370b9137a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:17.595554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d93b2-f475-48db-b9d8-c0370b9137a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:17.595831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d93b2-f475-48db-b9d8-c0370b9137a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:17.596100 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5d93b2-f475-48db-b9d8-c0370b9137a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:17.596791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d93b2-f475-48db-b9d8-c0370b9137a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:17.598413 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5d93b2-f475-48db-b9d8-c0370b9137a9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:17.608910 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1263/2543] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:17.613440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fa29f-736e-4a38-80e8-f9c2e96c17b9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:17.623863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1fa29f-736e-4a38-80e8-f9c2e96c17b9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:17.629070 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405eb3ce-0a04-4588-9cb5-52e40919676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:17.629687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405eb3ce-0a04-4588-9cb5-52e40919676b admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:17.629962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405eb3ce-0a04-4588-9cb5-52e40919676b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:17.630235 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405eb3ce-0a04-4588-9cb5-52e40919676b admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:17.630978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405eb3ce-0a04-4588-9cb5-52e40919676b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:17.632681 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405eb3ce-0a04-4588-9cb5-52e40919676b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:17.645248 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1281/2544] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:17.649593 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d93b2-f475-48db-b9d8-c0370b9137a9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:17.656229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:17.660605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5d93b2-f475-48db-b9d8-c0370b9137a9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:17.666899 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bd9c0-bfcd-47e0-8b3c-2b966c7a8124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:17.667827 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bd9c0-bfcd-47e0-8b3c-2b966c7a8124 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:17.668358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bd9c0-bfcd-47e0-8b3c-2b966c7a8124 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:17.668863 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5bd9c0-bfcd-47e0-8b3c-2b966c7a8124 admin admin] PATH_INFO: `/v3/projects/3548065fb4cc47d29922795863323152/users/0edbf8cef71146c787cc048802cf2f48/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:17.685761 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bd9c0-bfcd-47e0-8b3c-2b966c7a8124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3548065fb4cc47d29922795863323152, user_id=0edbf8cef71146c787cc048802cf2f48, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:17.688504 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5bd9c0-bfcd-47e0-8b3c-2b966c7a8124 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:17.703767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1264/2545] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:17 2022] PUT /identity/v3/projects/3548065fb4cc47d29922795863323152/users/0edbf8cef71146c787cc048802cf2f48/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:17.714148 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c208d6-5ab5-49c3-a3e9-95020538d2e8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:17.714432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c208d6-5ab5-49c3-a3e9-95020538d2e8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:17.714731 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c208d6-5ab5-49c3-a3e9-95020538d2e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:17.744267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-08c208d6-5ab5-49c3-a3e9-95020538d2e8 None None] MFA Rules not processed for user `0edbf8cef71146c787cc048802cf2f48`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:17.745684 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-08c208d6-5ab5-49c3-a3e9-95020538d2e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:17.819038 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1282/2546] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:17 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:17.824319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bd9c0-bfcd-47e0-8b3c-2b966c7a8124 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:17.890479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5bd9c0-bfcd-47e0-8b3c-2b966c7a8124 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:17.895219 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696d9cd-702a-4a05-b624-dd2146479cd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:17.895845 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696d9cd-702a-4a05-b624-dd2146479cd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:17.896125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696d9cd-702a-4a05-b624-dd2146479cd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:17.896399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a696d9cd-702a-4a05-b624-dd2146479cd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:17.897057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696d9cd-702a-4a05-b624-dd2146479cd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:17.899032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a696d9cd-702a-4a05-b624-dd2146479cd8 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:17.927630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1265/2547] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:17 2022] POST /identity/v3/projects => generated 409 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:17.931880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c208d6-5ab5-49c3-a3e9-95020538d2e8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:17.943193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c208d6-5ab5-49c3-a3e9-95020538d2e8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:18.003478 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741c242-036b-4bad-a7f6-b72e011750a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:18.004578 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741c242-036b-4bad-a7f6-b72e011750a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:18.004578 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741c242-036b-4bad-a7f6-b72e011750a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:18.004814 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d741c242-036b-4bad-a7f6-b72e011750a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:18.006102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741c242-036b-4bad-a7f6-b72e011750a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:18.007314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d741c242-036b-4bad-a7f6-b72e011750a4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:18.030982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1283/2548] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:31:17 2022] POST /identity/v3/users => generated 311 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:18.035642 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696d9cd-702a-4a05-b624-dd2146479cd8 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:18.046858 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a696d9cd-702a-4a05-b624-dd2146479cd8 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:18.052165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435c942-fb33-4c64-888b-04f09e6fde77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:18.052781 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435c942-fb33-4c64-888b-04f09e6fde77 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:18.053063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435c942-fb33-4c64-888b-04f09e6fde77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:18.053339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9435c942-fb33-4c64-888b-04f09e6fde77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:18.054036 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435c942-fb33-4c64-888b-04f09e6fde77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:18.055707 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9435c942-fb33-4c64-888b-04f09e6fde77 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:18.067220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1266/2549] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:18.071682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741c242-036b-4bad-a7f6-b72e011750a4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:18.082278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d741c242-036b-4bad-a7f6-b72e011750a4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:18.094227 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63702a-1fb1-4519-babc-134b14f641cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:18.095875 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63702a-1fb1-4519-babc-134b14f641cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:18.096163 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63702a-1fb1-4519-babc-134b14f641cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:18.096446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c63702a-1fb1-4519-babc-134b14f641cd admin admin] PATH_INFO: `/v3/projects/d3c4665179e74a73bc506b362962d174/users/e041691bd52b4e72a61ac8eb7921c350/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:18.114663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63702a-1fb1-4519-babc-134b14f641cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c4665179e74a73bc506b362962d174, user_id=e041691bd52b4e72a61ac8eb7921c350, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:18.117376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c63702a-1fb1-4519-babc-134b14f641cd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:18.133098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1284/2550] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:18 2022] PUT /identity/v3/projects/d3c4665179e74a73bc506b362962d174/users/e041691bd52b4e72a61ac8eb7921c350/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:18.137742 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435c942-fb33-4c64-888b-04f09e6fde77 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:18.150828 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9435c942-fb33-4c64-888b-04f09e6fde77 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:18.214038 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f11284d-dc82-447c-91a6-e5e84eb407b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:18.214720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11284d-dc82-447c-91a6-e5e84eb407b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:18.214998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11284d-dc82-447c-91a6-e5e84eb407b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:18.215269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f11284d-dc82-447c-91a6-e5e84eb407b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:18.215955 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f11284d-dc82-447c-91a6-e5e84eb407b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:18.217632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f11284d-dc82-447c-91a6-e5e84eb407b0 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:18.228671 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1267/2551] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:18.233709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63702a-1fb1-4519-babc-134b14f641cd admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:18.245881 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c63702a-1fb1-4519-babc-134b14f641cd admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:18.250956 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234a8e0-0dd1-4807-97fe-04c947aeaaa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:18.251617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a8e0-0dd1-4807-97fe-04c947aeaaa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:18.251887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a8e0-0dd1-4807-97fe-04c947aeaaa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:18.252159 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f234a8e0-0dd1-4807-97fe-04c947aeaaa0 admin admin] PATH_INFO: `/v3/projects/d3c4665179e74a73bc506b362962d174/users/e041691bd52b4e72a61ac8eb7921c350/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:18.258323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234a8e0-0dd1-4807-97fe-04c947aeaaa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3c4665179e74a73bc506b362962d174, user_id=e041691bd52b4e72a61ac8eb7921c350, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:18.258323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f234a8e0-0dd1-4807-97fe-04c947aeaaa0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:18.263200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:18.270260 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1285/2552] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:18 2022] PUT /identity/v3/projects/d3c4665179e74a73bc506b362962d174/users/e041691bd52b4e72a61ac8eb7921c350/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:18.281944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a7678-5e77-492b-ae53-659227fcbb88 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:18.282219 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a7678-5e77-492b-ae53-659227fcbb88 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:18.282497 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468a7678-5e77-492b-ae53-659227fcbb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:18.312278 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-468a7678-5e77-492b-ae53-659227fcbb88 None None] MFA Rules not processed for user `e041691bd52b4e72a61ac8eb7921c350`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:18.313502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-468a7678-5e77-492b-ae53-659227fcbb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:18.359440 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:18.393262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1268/2553] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:18 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:18.404121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234a8e0-0dd1-4807-97fe-04c947aeaaa0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:18.405786 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f234a8e0-0dd1-4807-97fe-04c947aeaaa0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:18.471564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f234a8e0-0dd1-4807-97fe-04c947aeaaa0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:18.475350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d3407-ef28-40a5-9b28-762c769e85e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:18.475964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d3407-ef28-40a5-9b28-762c769e85e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:18.476236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d3407-ef28-40a5-9b28-762c769e85e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:18.476508 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8d3407-ef28-40a5-9b28-762c769e85e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:18.486360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d3407-ef28-40a5-9b28-762c769e85e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:18.487839 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8d3407-ef28-40a5-9b28-762c769e85e8 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:18.497549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1286/2554] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:18 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:18.662522 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a7678-5e77-492b-ae53-659227fcbb88 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:18.673124 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468a7678-5e77-492b-ae53-659227fcbb88 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:18.676710 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a16a098-4f54-4004-83cd-8dae57aa2849 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:18.677350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16a098-4f54-4004-83cd-8dae57aa2849 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:18.677690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16a098-4f54-4004-83cd-8dae57aa2849 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:18.677962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a16a098-4f54-4004-83cd-8dae57aa2849 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:18.740832 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16a098-4f54-4004-83cd-8dae57aa2849 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:18.742377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a16a098-4f54-4004-83cd-8dae57aa2849 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:18.752729 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1269/2555] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:18 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:24.150430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d3407-ef28-40a5-9b28-762c769e85e8 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:24.216870 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8d3407-ef28-40a5-9b28-762c769e85e8 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:24.223150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a02a7-c7c5-41ba-bbee-037b992a2fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:24.223794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a02a7-c7c5-41ba-bbee-037b992a2fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:24.224075 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a02a7-c7c5-41ba-bbee-037b992a2fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:24.224347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a02a7-c7c5-41ba-bbee-037b992a2fe6 admin admin] PATH_INFO: `/v3/users/0edbf8cef71146c787cc048802cf2f48` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:24.225513 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a02a7-c7c5-41ba-bbee-037b992a2fe6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0edbf8cef71146c787cc048802cf2f48)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:24.227519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a02a7-c7c5-41ba-bbee-037b992a2fe6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:24.277791 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-674a02a7-c7c5-41ba-bbee-037b992a2fe6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0edbf8cef71146c787cc048802cf2f48'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:24.289679 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-674a02a7-c7c5-41ba-bbee-037b992a2fe6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0edbf8cef71146c787cc048802cf2f48'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:24.296679 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-674a02a7-c7c5-41ba-bbee-037b992a2fe6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0edbf8cef71146c787cc048802cf2f48'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:24.297448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-674a02a7-c7c5-41ba-bbee-037b992a2fe6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0edbf8cef71146c787cc048802cf2f48'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:24.307899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-674a02a7-c7c5-41ba-bbee-037b992a2fe6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0edbf8cef71146c787cc048802cf2f48'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:24.319533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1287/2556] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:24 2022] DELETE /identity/v3/users/0edbf8cef71146c787cc048802cf2f48 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:24.324128 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dde1a-2448-45d4-a66d-cdcd2e0de687 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:24.324668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dde1a-2448-45d4-a66d-cdcd2e0de687 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:24.324668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7dde1a-2448-45d4-a66d-cdcd2e0de687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:24.346717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-5e7dde1a-2448-45d4-a66d-cdcd2e0de687 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:24.347951 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5e7dde1a-2448-45d4-a66d-cdcd2e0de687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:24.414772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1270/2557] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:24.424919 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a02a7-c7c5-41ba-bbee-037b992a2fe6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:24.426369 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-674a02a7-c7c5-41ba-bbee-037b992a2fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:24.452163 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:24.490746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a02a7-c7c5-41ba-bbee-037b992a2fe6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:24.494335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09c1f9-a361-4a60-bccf-280cff32a589 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:24.494996 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09c1f9-a361-4a60-bccf-280cff32a589 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:24.495270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09c1f9-a361-4a60-bccf-280cff32a589 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:24.495537 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09c1f9-a361-4a60-bccf-280cff32a589 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:24.505910 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09c1f9-a361-4a60-bccf-280cff32a589 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:24.507516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e09c1f9-a361-4a60-bccf-280cff32a589 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:24.517658 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1288/2558] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:24.804265 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dde1a-2448-45d4-a66d-cdcd2e0de687 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:24.805897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-5e7dde1a-2448-45d4-a66d-cdcd2e0de687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:24.819102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7dde1a-2448-45d4-a66d-cdcd2e0de687 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:24.824494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102878f-85f8-43ae-80e3-2648adf3c844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:24.825154 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102878f-85f8-43ae-80e3-2648adf3c844 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:24.825437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102878f-85f8-43ae-80e3-2648adf3c844 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:24.825709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102878f-85f8-43ae-80e3-2648adf3c844 admin admin] PATH_INFO: `/v3/projects/3548065fb4cc47d29922795863323152` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:24.826917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102878f-85f8-43ae-80e3-2648adf3c844 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3548065fb4cc47d29922795863323152)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:24.829467 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b102878f-85f8-43ae-80e3-2648adf3c844 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:24.877559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b102878f-85f8-43ae-80e3-2648adf3c844 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3548065fb4cc47d29922795863323152', 'request_id': 'req-b102878f-85f8-43ae-80e3-2648adf3c844'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:24.883021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b102878f-85f8-43ae-80e3-2648adf3c844 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3548065fb4cc47d29922795863323152', 'request_id': 'req-b102878f-85f8-43ae-80e3-2648adf3c844'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:24.890515 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b102878f-85f8-43ae-80e3-2648adf3c844 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3548065fb4cc47d29922795863323152', 'request_id': 'req-b102878f-85f8-43ae-80e3-2648adf3c844'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:24.897932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:24.903578 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b102878f-85f8-43ae-80e3-2648adf3c844 admin admin] The token cache is being invalidate because project 3548065fb4cc47d29922795863323152 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:24.904061 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b102878f-85f8-43ae-80e3-2648adf3c844 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:24.905245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-b102878f-85f8-43ae-80e3-2648adf3c844 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:24.907895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1271/2559] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:24 2022] DELETE /identity/v3/projects/3548065fb4cc47d29922795863323152 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:24.911858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09c1f9-a361-4a60-bccf-280cff32a589 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:24.921652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09c1f9-a361-4a60-bccf-280cff32a589 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:24.989228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1d524e-f890-4619-a250-1a4a129aa8bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:24.989957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d524e-f890-4619-a250-1a4a129aa8bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:24.990233 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d524e-f890-4619-a250-1a4a129aa8bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:24.990506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1d524e-f890-4619-a250-1a4a129aa8bd admin admin] PATH_INFO: `/v3/users/e041691bd52b4e72a61ac8eb7921c350` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:24.991711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d524e-f890-4619-a250-1a4a129aa8bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=e041691bd52b4e72a61ac8eb7921c350)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:24.993608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1d524e-f890-4619-a250-1a4a129aa8bd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:25.040516 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fd1d524e-f890-4619-a250-1a4a129aa8bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e041691bd52b4e72a61ac8eb7921c350'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:25.053102 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fd1d524e-f890-4619-a250-1a4a129aa8bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e041691bd52b4e72a61ac8eb7921c350'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:25.059889 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fd1d524e-f890-4619-a250-1a4a129aa8bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e041691bd52b4e72a61ac8eb7921c350'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:25.060603 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fd1d524e-f890-4619-a250-1a4a129aa8bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e041691bd52b4e72a61ac8eb7921c350'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:25.069481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-fd1d524e-f890-4619-a250-1a4a129aa8bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e041691bd52b4e72a61ac8eb7921c350'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:25.075554 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1289/2560] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:24 2022] DELETE /identity/v3/users/e041691bd52b4e72a61ac8eb7921c350 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:25.352498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102878f-85f8-43ae-80e3-2648adf3c844 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:25.353985 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b102878f-85f8-43ae-80e3-2648adf3c844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:25.367778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102878f-85f8-43ae-80e3-2648adf3c844 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:25.431621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83f8cd-4cfe-459c-a4d4-0d39d7924467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:25.432267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83f8cd-4cfe-459c-a4d4-0d39d7924467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:25.432549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83f8cd-4cfe-459c-a4d4-0d39d7924467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:25.432822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83f8cd-4cfe-459c-a4d4-0d39d7924467 admin admin] PATH_INFO: `/v3/projects/d3c4665179e74a73bc506b362962d174` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:25.434009 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83f8cd-4cfe-459c-a4d4-0d39d7924467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3c4665179e74a73bc506b362962d174)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:25.436015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83f8cd-4cfe-459c-a4d4-0d39d7924467 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:25.482331 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-df83f8cd-4cfe-459c-a4d4-0d39d7924467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3c4665179e74a73bc506b362962d174', 'request_id': 'req-df83f8cd-4cfe-459c-a4d4-0d39d7924467'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:25.488539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-df83f8cd-4cfe-459c-a4d4-0d39d7924467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3c4665179e74a73bc506b362962d174', 'request_id': 'req-df83f8cd-4cfe-459c-a4d4-0d39d7924467'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:25.495970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-df83f8cd-4cfe-459c-a4d4-0d39d7924467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3c4665179e74a73bc506b362962d174', 'request_id': 'req-df83f8cd-4cfe-459c-a4d4-0d39d7924467'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:25.507348 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-df83f8cd-4cfe-459c-a4d4-0d39d7924467 admin admin] The token cache is being invalidate because project d3c4665179e74a73bc506b362962d174 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:25.507629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-df83f8cd-4cfe-459c-a4d4-0d39d7924467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:25.508293 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-df83f8cd-4cfe-459c-a4d4-0d39d7924467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:25.509804 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1272/2561] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:25 2022] DELETE /identity/v3/projects/d3c4665179e74a73bc506b362962d174 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:25.515827 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d36566-1083-4071-b22e-15650fcde21f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:25.516325 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d36566-1083-4071-b22e-15650fcde21f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:25.516432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d36566-1083-4071-b22e-15650fcde21f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:25.539531 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-e9d36566-1083-4071-b22e-15650fcde21f None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:25.541036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-e9d36566-1083-4071-b22e-15650fcde21f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:25.579591 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:25.606710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1290/2562] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:25.614886 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dbb9a-791b-4f6b-bd80-8e6c4e97c438 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:25.615172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dbb9a-791b-4f6b-bd80-8e6c4e97c438 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:25.615448 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196dbb9a-791b-4f6b-bd80-8e6c4e97c438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:25.637150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-196dbb9a-791b-4f6b-bd80-8e6c4e97c438 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:25.638371 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-196dbb9a-791b-4f6b-bd80-8e6c4e97c438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:25.646398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1273/2563] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:25.650742 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d36566-1083-4071-b22e-15650fcde21f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:25.663018 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d36566-1083-4071-b22e-15650fcde21f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:25.667704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d11a0e-f0c8-44a3-86b9-733d79708d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:25.668340 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d11a0e-f0c8-44a3-86b9-733d79708d37 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:25.668618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d11a0e-f0c8-44a3-86b9-733d79708d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:25.668887 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d11a0e-f0c8-44a3-86b9-733d79708d37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:25.669583 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d11a0e-f0c8-44a3-86b9-733d79708d37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:31:25.669886 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d11a0e-f0c8-44a3-86b9-733d79708d37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:25.671602 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d11a0e-f0c8-44a3-86b9-733d79708d37 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:25.684387 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1291/2564] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:31:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:31:25.688983 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dbb9a-791b-4f6b-bd80-8e6c4e97c438 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:25.698597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196dbb9a-791b-4f6b-bd80-8e6c4e97c438 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:25.703316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c415110-4a3a-4f48-b801-720765718db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:25.703920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c415110-4a3a-4f48-b801-720765718db5 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:25.704226 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c415110-4a3a-4f48-b801-720765718db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:25.704500 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c415110-4a3a-4f48-b801-720765718db5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:25.705643 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c415110-4a3a-4f48-b801-720765718db5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:25.708508 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c415110-4a3a-4f48-b801-720765718db5 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:25.738269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1274/2565] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:25 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:25.742491 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d11a0e-f0c8-44a3-86b9-733d79708d37 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:25.753923 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d11a0e-f0c8-44a3-86b9-733d79708d37 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:25.811241 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05367b3f-4b01-4dbc-a65e-c8a811421be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:25.811766 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05367b3f-4b01-4dbc-a65e-c8a811421be0 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:25.812042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05367b3f-4b01-4dbc-a65e-c8a811421be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:25.812312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05367b3f-4b01-4dbc-a65e-c8a811421be0 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:25.812964 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05367b3f-4b01-4dbc-a65e-c8a811421be0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:25.814935 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05367b3f-4b01-4dbc-a65e-c8a811421be0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:25.837757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1292/2566] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:31:25 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:31:25.842161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c415110-4a3a-4f48-b801-720765718db5 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:25.853871 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c415110-4a3a-4f48-b801-720765718db5 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:25.858557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c0c2b-646d-476d-a1a1-2b342df17f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:25.859198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c0c2b-646d-476d-a1a1-2b342df17f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:25.859478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c0c2b-646d-476d-a1a1-2b342df17f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:25.859748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0c0c2b-646d-476d-a1a1-2b342df17f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:25.860436 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c0c2b-646d-476d-a1a1-2b342df17f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:25.862051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0c0c2b-646d-476d-a1a1-2b342df17f32 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:25.872146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1275/2567] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:25.876326 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05367b3f-4b01-4dbc-a65e-c8a811421be0 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:25.886480 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05367b3f-4b01-4dbc-a65e-c8a811421be0 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:25.891222 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9d1d4a-df04-4a0a-92b9-47291b7c4fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:25.892330 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d1d4a-df04-4a0a-92b9-47291b7c4fcb admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:25.892609 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d1d4a-df04-4a0a-92b9-47291b7c4fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:25.892880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9d1d4a-df04-4a0a-92b9-47291b7c4fcb admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:25.893574 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d1d4a-df04-4a0a-92b9-47291b7c4fcb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:25.895212 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9d1d4a-df04-4a0a-92b9-47291b7c4fcb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:25.906061 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1293/2568] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:25.911178 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c0c2b-646d-476d-a1a1-2b342df17f32 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:25.921327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0c0c2b-646d-476d-a1a1-2b342df17f32 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:25.925983 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9f17f-582b-46e3-b70f-f1e0ba7bad0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:25.926680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9f17f-582b-46e3-b70f-f1e0ba7bad0d admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:25.926957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9f17f-582b-46e3-b70f-f1e0ba7bad0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:25.927227 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e9f17f-582b-46e3-b70f-f1e0ba7bad0d admin admin] PATH_INFO: `/v3/projects/7aaa5f6bf9de4a81b523e256fbc33ca3/users/f1e12eebd35843288ec2b05860022e5a/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:25.941664 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9f17f-582b-46e3-b70f-f1e0ba7bad0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7aaa5f6bf9de4a81b523e256fbc33ca3, user_id=f1e12eebd35843288ec2b05860022e5a, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:25.944651 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e9f17f-582b-46e3-b70f-f1e0ba7bad0d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:25.958481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1276/2569] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:25 2022] PUT /identity/v3/projects/7aaa5f6bf9de4a81b523e256fbc33ca3/users/f1e12eebd35843288ec2b05860022e5a/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:25.968690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b59303-5853-4e01-8663-577bb01c595a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:25.968978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b59303-5853-4e01-8663-577bb01c595a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:25.969272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b59303-5853-4e01-8663-577bb01c595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:25.997935 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-81b59303-5853-4e01-8663-577bb01c595a None None] MFA Rules not processed for user `f1e12eebd35843288ec2b05860022e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:25.999204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-81b59303-5853-4e01-8663-577bb01c595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:26.063458 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1294/2570] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:26.074313 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9f17f-582b-46e3-b70f-f1e0ba7bad0d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:26.076016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-33e9f17f-582b-46e3-b70f-f1e0ba7bad0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:26.105059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:26.136047 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e9f17f-582b-46e3-b70f-f1e0ba7bad0d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:26.139661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef079-11e9-41c4-9868-00f881f8bb7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:26.140276 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef079-11e9-41c4-9868-00f881f8bb7e service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:26.140550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef079-11e9-41c4-9868-00f881f8bb7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:26.140818 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801ef079-11e9-41c4-9868-00f881f8bb7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:26.149364 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ef079-11e9-41c4-9868-00f881f8bb7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:26.150846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801ef079-11e9-41c4-9868-00f881f8bb7e service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:26.160640 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1277/2571] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:26 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:27.530265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3d7de-8d26-48c0-b702-dd6993e1142b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:27.530865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3d7de-8d26-48c0-b702-dd6993e1142b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:27.530865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d3d7de-8d26-48c0-b702-dd6993e1142b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:27.550085 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a2d3d7de-8d26-48c0-b702-dd6993e1142b None None] MFA Rules not processed for user `f1e12eebd35843288ec2b05860022e5a`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:27.551337 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a2d3d7de-8d26-48c0-b702-dd6993e1142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:27.558163 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1295/2572] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:36.155995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=15 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:37.544869 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=83,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:38.934853 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef079-11e9-41c4-9868-00f881f8bb7e service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:38.936636 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-801ef079-11e9-41c4-9868-00f881f8bb7e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:39.014175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801ef079-11e9-41c4-9868-00f881f8bb7e service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:39.018598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed1c40-213a-4819-bc92-d1a482968775 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:39.019225 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed1c40-213a-4819-bc92-d1a482968775 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:39.019501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed1c40-213a-4819-bc92-d1a482968775 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:39.019773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afed1c40-213a-4819-bc92-d1a482968775 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:39.021544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-afed1c40-213a-4819-bc92-d1a482968775 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:39.085991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed1c40-213a-4819-bc92-d1a482968775 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:39.087468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afed1c40-213a-4819-bc92-d1a482968775 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:39.097847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1278/2573] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:43.273696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3d7de-8d26-48c0-b702-dd6993e1142b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:43.275201 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a2d3d7de-8d26-48c0-b702-dd6993e1142b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:43.301001 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d3d7de-8d26-48c0-b702-dd6993e1142b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:43.323388 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe1ddfa-7041-4d6c-9b5c-ec1e402d02d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:43.324234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1ddfa-7041-4d6c-9b5c-ec1e402d02d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:43.324593 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1ddfa-7041-4d6c-9b5c-ec1e402d02d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:43.325421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe1ddfa-7041-4d6c-9b5c-ec1e402d02d6 admin admin] PATH_INFO: `/v3/users/246f0156a53e4931bc24158b06e85654` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:43.327941 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1ddfa-7041-4d6c-9b5c-ec1e402d02d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=246f0156a53e4931bc24158b06e85654)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:43.330504 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe1ddfa-7041-4d6c-9b5c-ec1e402d02d6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:43.388523 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2fe1ddfa-7041-4d6c-9b5c-ec1e402d02d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '246f0156a53e4931bc24158b06e85654'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:43.401218 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2fe1ddfa-7041-4d6c-9b5c-ec1e402d02d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '246f0156a53e4931bc24158b06e85654'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:43.410179 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2fe1ddfa-7041-4d6c-9b5c-ec1e402d02d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '246f0156a53e4931bc24158b06e85654'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:43.410836 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2fe1ddfa-7041-4d6c-9b5c-ec1e402d02d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '246f0156a53e4931bc24158b06e85654'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:43.420905 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2fe1ddfa-7041-4d6c-9b5c-ec1e402d02d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '246f0156a53e4931bc24158b06e85654'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:43.428433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1296/2574] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:43 2022] DELETE /identity/v3/users/246f0156a53e4931bc24158b06e85654 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:43.605445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed1c40-213a-4819-bc92-d1a482968775 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:43.617045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afed1c40-213a-4819-bc92-d1a482968775 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:43.678411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dc8410c-f2a9-4959-a8e4-c29a2a47b73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:43.679121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8410c-f2a9-4959-a8e4-c29a2a47b73c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:43.679398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8410c-f2a9-4959-a8e4-c29a2a47b73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:43.679669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dc8410c-f2a9-4959-a8e4-c29a2a47b73c admin admin] PATH_INFO: `/v3/projects/14e4d4c3c71d4348a9f1ec3cea1be646` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:43.680845 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8410c-f2a9-4959-a8e4-c29a2a47b73c admin admin] RBAC: Authorizing `identity:delete_project(project_id=14e4d4c3c71d4348a9f1ec3cea1be646)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:43.685932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dc8410c-f2a9-4959-a8e4-c29a2a47b73c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:43.740169 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6dc8410c-f2a9-4959-a8e4-c29a2a47b73c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14e4d4c3c71d4348a9f1ec3cea1be646', 'request_id': 'req-6dc8410c-f2a9-4959-a8e4-c29a2a47b73c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:43.742459 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:43.748039 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6dc8410c-f2a9-4959-a8e4-c29a2a47b73c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14e4d4c3c71d4348a9f1ec3cea1be646', 'request_id': 'req-6dc8410c-f2a9-4959-a8e4-c29a2a47b73c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:43.758384 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6dc8410c-f2a9-4959-a8e4-c29a2a47b73c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14e4d4c3c71d4348a9f1ec3cea1be646', 'request_id': 'req-6dc8410c-f2a9-4959-a8e4-c29a2a47b73c'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:43.770759 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6dc8410c-f2a9-4959-a8e4-c29a2a47b73c admin admin] The token cache is being invalidate because project 14e4d4c3c71d4348a9f1ec3cea1be646 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:43.771032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6dc8410c-f2a9-4959-a8e4-c29a2a47b73c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:43.771704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6dc8410c-f2a9-4959-a8e4-c29a2a47b73c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:43.773647 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1279/2575] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:43 2022] DELETE /identity/v3/projects/14e4d4c3c71d4348a9f1ec3cea1be646 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:43.778612 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db260d2e-3525-4b62-a38a-59c8775f2d16 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:43.778917 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db260d2e-3525-4b62-a38a-59c8775f2d16 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:43.779267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db260d2e-3525-4b62-a38a-59c8775f2d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:43.804354 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-db260d2e-3525-4b62-a38a-59c8775f2d16 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:43.805605 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-db260d2e-3525-4b62-a38a-59c8775f2d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:43.870078 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1297/2576] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:43.878052 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d95e1-1d3c-49c3-8467-290f2e6f86f1 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:43.878338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d95e1-1d3c-49c3-8467-290f2e6f86f1 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:43.878690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681d95e1-1d3c-49c3-8467-290f2e6f86f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:43.899139 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-681d95e1-1d3c-49c3-8467-290f2e6f86f1 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:43.900380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-681d95e1-1d3c-49c3-8467-290f2e6f86f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:43.908934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1280/2577] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:43.913236 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db260d2e-3525-4b62-a38a-59c8775f2d16 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:43.923312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db260d2e-3525-4b62-a38a-59c8775f2d16 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:43.928152 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b8ded-df7e-48cb-b295-810f276b773f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:43.928755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b8ded-df7e-48cb-b295-810f276b773f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:43.929035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b8ded-df7e-48cb-b295-810f276b773f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:43.929305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289b8ded-df7e-48cb-b295-810f276b773f admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:43.930000 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b8ded-df7e-48cb-b295-810f276b773f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:31:43.930299 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b8ded-df7e-48cb-b295-810f276b773f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:43.931920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289b8ded-df7e-48cb-b295-810f276b773f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:43.944514 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1298/2578] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:31:43.948869 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d95e1-1d3c-49c3-8467-290f2e6f86f1 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:43.959544 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681d95e1-1d3c-49c3-8467-290f2e6f86f1 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:43.964250 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bebc8f-b7b5-425d-ae81-04b87c00a0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:43.964865 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bebc8f-b7b5-425d-ae81-04b87c00a0e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:43.965170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bebc8f-b7b5-425d-ae81-04b87c00a0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:43.965444 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bebc8f-b7b5-425d-ae81-04b87c00a0e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:43.966109 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bebc8f-b7b5-425d-ae81-04b87c00a0e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:43.968059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bebc8f-b7b5-425d-ae81-04b87c00a0e6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:43.996481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1281/2579] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:43 2022] POST /identity/v3/projects => generated 373 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:44.000738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b8ded-df7e-48cb-b295-810f276b773f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:44.010961 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289b8ded-df7e-48cb-b295-810f276b773f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:44.076264 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c98a0-fc5a-48da-be0a-1c4684a7077a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:44.076891 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c98a0-fc5a-48da-be0a-1c4684a7077a admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:44.077173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c98a0-fc5a-48da-be0a-1c4684a7077a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:44.077455 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c98a0-fc5a-48da-be0a-1c4684a7077a admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:44.078661 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c98a0-fc5a-48da-be0a-1c4684a7077a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:44.080599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c98a0-fc5a-48da-be0a-1c4684a7077a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:44.088661 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:44.105065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1299/2580] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:31:43 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:44.109402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bebc8f-b7b5-425d-ae81-04b87c00a0e6 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:44.119878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bebc8f-b7b5-425d-ae81-04b87c00a0e6 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:44.124512 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1a419-92ed-478a-8326-ce077e9c16e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:44.125153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1a419-92ed-478a-8326-ce077e9c16e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:44.125432 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1a419-92ed-478a-8326-ce077e9c16e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:44.125708 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b1a419-92ed-478a-8326-ce077e9c16e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:44.126399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1a419-92ed-478a-8326-ce077e9c16e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:44.128093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b1a419-92ed-478a-8326-ce077e9c16e9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:44.138677 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1282/2581] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:44.143483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c98a0-fc5a-48da-be0a-1c4684a7077a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:44.154134 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c98a0-fc5a-48da-be0a-1c4684a7077a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:44.159595 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3689ca68-6796-4d4d-b863-5ffb16abd17c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:44.160233 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689ca68-6796-4d4d-b863-5ffb16abd17c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:44.160513 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689ca68-6796-4d4d-b863-5ffb16abd17c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:44.160787 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3689ca68-6796-4d4d-b863-5ffb16abd17c admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:44.161507 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689ca68-6796-4d4d-b863-5ffb16abd17c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:44.163150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3689ca68-6796-4d4d-b863-5ffb16abd17c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:44.174046 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1300/2582] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:44.178639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1a419-92ed-478a-8326-ce077e9c16e9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:44.189300 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b1a419-92ed-478a-8326-ce077e9c16e9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:44.194193 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eacc1f-a7f2-450e-ac43-ae5d6daac63a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:44.194891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eacc1f-a7f2-450e-ac43-ae5d6daac63a admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:44.195172 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eacc1f-a7f2-450e-ac43-ae5d6daac63a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:44.195447 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eacc1f-a7f2-450e-ac43-ae5d6daac63a admin admin] PATH_INFO: `/v3/projects/d048855a5ac2421497e22f65a04ba77e/users/3a2ee3e3d4a84f46b0e93f187f3d0376/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:44.210777 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eacc1f-a7f2-450e-ac43-ae5d6daac63a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d048855a5ac2421497e22f65a04ba77e, user_id=3a2ee3e3d4a84f46b0e93f187f3d0376, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:44.213474 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eacc1f-a7f2-450e-ac43-ae5d6daac63a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:44.226986 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1283/2583] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:44 2022] PUT /identity/v3/projects/d048855a5ac2421497e22f65a04ba77e/users/3a2ee3e3d4a84f46b0e93f187f3d0376/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:44.237198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef20b6b-7f59-4eda-9c5b-bea334d51498 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:44.237557 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef20b6b-7f59-4eda-9c5b-bea334d51498 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:44.237830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef20b6b-7f59-4eda-9c5b-bea334d51498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:44.267580 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-4ef20b6b-7f59-4eda-9c5b-bea334d51498 None None] MFA Rules not processed for user `3a2ee3e3d4a84f46b0e93f187f3d0376`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:44.268802 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-4ef20b6b-7f59-4eda-9c5b-bea334d51498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:44.335173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1301/2584] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:44.349580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eacc1f-a7f2-450e-ac43-ae5d6daac63a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:44.351621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f6eacc1f-a7f2-450e-ac43-ae5d6daac63a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:44.454366 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eacc1f-a7f2-450e-ac43-ae5d6daac63a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:44.460378 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7de85-21c6-4e61-975c-287ea77b891b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:44.461012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7de85-21c6-4e61-975c-287ea77b891b service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:44.461331 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7de85-21c6-4e61-975c-287ea77b891b service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:44.461641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e7de85-21c6-4e61-975c-287ea77b891b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:44.471150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7de85-21c6-4e61-975c-287ea77b891b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:44.472807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e7de85-21c6-4e61-975c-287ea77b891b service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:44.482491 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1284/2585] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:44 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:44.492461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1fb6f-0323-414e-b76b-9e3157e5f2fe None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:44.492752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1fb6f-0323-414e-b76b-9e3157e5f2fe None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:44.493031 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c1fb6f-0323-414e-b76b-9e3157e5f2fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:44.512632 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-25c1fb6f-0323-414e-b76b-9e3157e5f2fe None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:44.513871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-25c1fb6f-0323-414e-b76b-9e3157e5f2fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:44.574197 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1302/2586] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 1 14:31:44 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:44.625783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7de85-21c6-4e61-975c-287ea77b891b service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:44.627743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-17e7de85-21c6-4e61-975c-287ea77b891b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:44.679019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:44.705545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e7de85-21c6-4e61-975c-287ea77b891b service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:44.711654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5bc5d-3721-42a2-8f90-877aa96a1254 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:44.712391 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5bc5d-3721-42a2-8f90-877aa96a1254 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:44.712800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5bc5d-3721-42a2-8f90-877aa96a1254 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:44.713206 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5bc5d-3721-42a2-8f90-877aa96a1254 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:44.723794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5bc5d-3721-42a2-8f90-877aa96a1254 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:44.725412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5bc5d-3721-42a2-8f90-877aa96a1254 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:44.735614 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1285/2587] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:31:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:31:45.273682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb3d89-b7f6-4b61-a6a2-422d33daa2fc None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:45.273969 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb3d89-b7f6-4b61-a6a2-422d33daa2fc None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:45.274246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbb3d89-b7f6-4b61-a6a2-422d33daa2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:45.294255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-efbb3d89-b7f6-4b61-a6a2-422d33daa2fc None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:45.295525 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-efbb3d89-b7f6-4b61-a6a2-422d33daa2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:45.302771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1303/2588] 10.222.0.70 () {58 vars in 967 bytes} [Mon Aug 1 14:31:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:31:45.315519 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5bc5d-3721-42a2-8f90-877aa96a1254 service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:45.326664 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5bc5d-3721-42a2-8f90-877aa96a1254 service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:45.332314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba465a-82c1-4cca-94b7-7aa6cb146209 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:45.332910 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba465a-82c1-4cca-94b7-7aa6cb146209 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:45.333192 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba465a-82c1-4cca-94b7-7aa6cb146209 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:45.333468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba465a-82c1-4cca-94b7-7aa6cb146209 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:45.345462 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba465a-82c1-4cca-94b7-7aa6cb146209 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:45.347114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ba465a-82c1-4cca-94b7-7aa6cb146209 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:45.357866 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1286/2589] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:31:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:31:45.586333 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adad8a-d83c-4ac7-a7d5-74e28ac2959a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:45.586865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adad8a-d83c-4ac7-a7d5-74e28ac2959a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:45.586962 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3adad8a-d83c-4ac7-a7d5-74e28ac2959a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:45.608771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a3adad8a-d83c-4ac7-a7d5-74e28ac2959a None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:45.609970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a3adad8a-d83c-4ac7-a7d5-74e28ac2959a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:45.617461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1304/2590] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 1 14:31:45 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:45.630863 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba465a-82c1-4cca-94b7-7aa6cb146209 service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:45.643066 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ba465a-82c1-4cca-94b7-7aa6cb146209 service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:45.648522 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ef994-a36f-4498-a426-305b6ddf70b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:45.649147 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ef994-a36f-4498-a426-305b6ddf70b9 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:45.649425 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ef994-a36f-4498-a426-305b6ddf70b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:45.649691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ef994-a36f-4498-a426-305b6ddf70b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:45.659437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ef994-a36f-4498-a426-305b6ddf70b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:45.661338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ef994-a36f-4498-a426-305b6ddf70b9 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:45.681898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1287/2591] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:31:45 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:31:46.008206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294dd3f-f5a3-48ed-b1c4-38390bdf7d9f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:46.008843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294dd3f-f5a3-48ed-b1c4-38390bdf7d9f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:46.008843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9294dd3f-f5a3-48ed-b1c4-38390bdf7d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:46.028753 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-9294dd3f-f5a3-48ed-b1c4-38390bdf7d9f None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:46.030049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9294dd3f-f5a3-48ed-b1c4-38390bdf7d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:46.037784 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1305/2592] 10.222.0.70 () {58 vars in 967 bytes} [Mon Aug 1 14:31:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:31:46.051198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ef994-a36f-4498-a426-305b6ddf70b9 service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:46.062379 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ef994-a36f-4498-a426-305b6ddf70b9 service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:46.069875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fad528-431e-4be6-8542-a532d91ccdb7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:46.070664 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fad528-431e-4be6-8542-a532d91ccdb7 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:46.070950 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fad528-431e-4be6-8542-a532d91ccdb7 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:46.071225 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fad528-431e-4be6-8542-a532d91ccdb7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:46.080645 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fad528-431e-4be6-8542-a532d91ccdb7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:46.082302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fad528-431e-4be6-8542-a532d91ccdb7 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:46.092242 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1288/2593] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:31:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:31:47.213050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294dd3f-f5a3-48ed-b1c4-38390bdf7d9f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:47.266922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:47.280792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9294dd3f-f5a3-48ed-b1c4-38390bdf7d9f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:47.287657 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f6c4c-42d3-4437-8451-23c0e749f09a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:47.288376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f6c4c-42d3-4437-8451-23c0e749f09a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:47.288756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f6c4c-42d3-4437-8451-23c0e749f09a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:47.289263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12f6c4c-42d3-4437-8451-23c0e749f09a admin admin] PATH_INFO: `/v3/users/3a2ee3e3d4a84f46b0e93f187f3d0376` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:47.290618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f6c4c-42d3-4437-8451-23c0e749f09a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2ee3e3d4a84f46b0e93f187f3d0376)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:47.292650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12f6c4c-42d3-4437-8451-23c0e749f09a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:47.347655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b12f6c4c-42d3-4437-8451-23c0e749f09a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2ee3e3d4a84f46b0e93f187f3d0376'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:47.361148 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b12f6c4c-42d3-4437-8451-23c0e749f09a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2ee3e3d4a84f46b0e93f187f3d0376'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:47.368771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b12f6c4c-42d3-4437-8451-23c0e749f09a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2ee3e3d4a84f46b0e93f187f3d0376'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:47.369589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b12f6c4c-42d3-4437-8451-23c0e749f09a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2ee3e3d4a84f46b0e93f187f3d0376'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:47.377314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b12f6c4c-42d3-4437-8451-23c0e749f09a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2ee3e3d4a84f46b0e93f187f3d0376'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:47.383596 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1306/2594] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:47 2022] DELETE /identity/v3/users/3a2ee3e3d4a84f46b0e93f187f3d0376 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:47.388919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d36e1-7089-4823-b93d-2b39d0401f04 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:47.389523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d36e1-7089-4823-b93d-2b39d0401f04 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:47.389798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398d36e1-7089-4823-b93d-2b39d0401f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:47.415174 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-398d36e1-7089-4823-b93d-2b39d0401f04 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:47.416501 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-398d36e1-7089-4823-b93d-2b39d0401f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:47.478083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1289/2595] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:47.487899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f6c4c-42d3-4437-8451-23c0e749f09a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:47.489301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b12f6c4c-42d3-4437-8451-23c0e749f09a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:47.548330 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12f6c4c-42d3-4437-8451-23c0e749f09a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:47.552021 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23c05b9-e81a-44b7-9d1e-c0086176baa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:47.552639 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c05b9-e81a-44b7-9d1e-c0086176baa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:47.552921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c05b9-e81a-44b7-9d1e-c0086176baa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:47.553192 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23c05b9-e81a-44b7-9d1e-c0086176baa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:47.562311 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c05b9-e81a-44b7-9d1e-c0086176baa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:47.564954 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23c05b9-e81a-44b7-9d1e-c0086176baa1 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:47.575884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1307/2596] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:47.854514 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d36e1-7089-4823-b93d-2b39d0401f04 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:47.856096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-398d36e1-7089-4823-b93d-2b39d0401f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:47.868834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398d36e1-7089-4823-b93d-2b39d0401f04 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:47.873628 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2d953f-6306-480e-a692-2e59d72786af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:47.874294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d953f-6306-480e-a692-2e59d72786af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:47.874668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d953f-6306-480e-a692-2e59d72786af admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:47.875404 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2d953f-6306-480e-a692-2e59d72786af admin admin] PATH_INFO: `/v3/projects/d048855a5ac2421497e22f65a04ba77e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:47.876611 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d953f-6306-480e-a692-2e59d72786af admin admin] RBAC: Authorizing `identity:delete_project(project_id=d048855a5ac2421497e22f65a04ba77e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:47.878556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2d953f-6306-480e-a692-2e59d72786af admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:47.927271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4c2d953f-6306-480e-a692-2e59d72786af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd048855a5ac2421497e22f65a04ba77e', 'request_id': 'req-4c2d953f-6306-480e-a692-2e59d72786af'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:47.932645 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4c2d953f-6306-480e-a692-2e59d72786af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd048855a5ac2421497e22f65a04ba77e', 'request_id': 'req-4c2d953f-6306-480e-a692-2e59d72786af'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:47.940861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4c2d953f-6306-480e-a692-2e59d72786af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd048855a5ac2421497e22f65a04ba77e', 'request_id': 'req-4c2d953f-6306-480e-a692-2e59d72786af'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:47.952795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4c2d953f-6306-480e-a692-2e59d72786af admin admin] The token cache is being invalidate because project d048855a5ac2421497e22f65a04ba77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:47.953113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4c2d953f-6306-480e-a692-2e59d72786af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:47.953843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4c2d953f-6306-480e-a692-2e59d72786af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:47.955493 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1290/2597] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:47 2022] DELETE /identity/v3/projects/d048855a5ac2421497e22f65a04ba77e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:47.960492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f82714-8a8f-44c8-961a-2086b6c47dd0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:47.960780 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f82714-8a8f-44c8-961a-2086b6c47dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:47.961062 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f82714-8a8f-44c8-961a-2086b6c47dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:47.981614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a6f82714-8a8f-44c8-961a-2086b6c47dd0 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:47.982866 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a6f82714-8a8f-44c8-961a-2086b6c47dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:48.044741 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1308/2598] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:48.053968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b4378-fa9b-4788-927e-dded0a443f0d None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.054257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b4378-fa9b-4788-927e-dded0a443f0d None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.054539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b4378-fa9b-4788-927e-dded0a443f0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.075362 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-fc7b4378-fa9b-4788-927e-dded0a443f0d None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:48.076590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fc7b4378-fa9b-4788-927e-dded0a443f0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:48.084561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1291/2599] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:48.088976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f82714-8a8f-44c8-961a-2086b6c47dd0 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:48.099242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f82714-8a8f-44c8-961a-2086b6c47dd0 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:48.104139 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674cde4-384f-481c-9599-3f171bf303a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:48.104764 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674cde4-384f-481c-9599-3f171bf303a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.105042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674cde4-384f-481c-9599-3f171bf303a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.105310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674cde4-384f-481c-9599-3f171bf303a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.106010 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674cde4-384f-481c-9599-3f171bf303a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:31:48.106346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674cde4-384f-481c-9599-3f171bf303a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:48.108015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674cde4-384f-481c-9599-3f171bf303a1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:48.122515 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1309/2600] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:31:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:31:48.127190 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b4378-fa9b-4788-927e-dded0a443f0d None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:48.137293 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b4378-fa9b-4788-927e-dded0a443f0d None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:48.142050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d56dd-62fc-448e-bca7-11f35bbd0a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:48.142693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d56dd-62fc-448e-bca7-11f35bbd0a6a admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.142975 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d56dd-62fc-448e-bca7-11f35bbd0a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.143250 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913d56dd-62fc-448e-bca7-11f35bbd0a6a admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.143924 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d56dd-62fc-448e-bca7-11f35bbd0a6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:48.145859 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913d56dd-62fc-448e-bca7-11f35bbd0a6a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:48.151372 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:48.176556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1292/2601] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:48 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:48.181190 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674cde4-384f-481c-9599-3f171bf303a1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:48.186243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:48.193874 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674cde4-384f-481c-9599-3f171bf303a1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:48.221096 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d56dd-62fc-448e-bca7-11f35bbd0a6a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:48.223032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-913d56dd-62fc-448e-bca7-11f35bbd0a6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:48.255465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49630244-002c-4c67-924e-f331263ed28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:48.256374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49630244-002c-4c67-924e-f331263ed28f admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.256374 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49630244-002c-4c67-924e-f331263ed28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.256683 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49630244-002c-4c67-924e-f331263ed28f admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.257302 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49630244-002c-4c67-924e-f331263ed28f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:48.259315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49630244-002c-4c67-924e-f331263ed28f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:48.282616 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1310/2602] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:31:48 2022] POST /identity/v3/users => generated 291 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:48.287243 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49630244-002c-4c67-924e-f331263ed28f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:48.292557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913d56dd-62fc-448e-bca7-11f35bbd0a6a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:48.297436 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49630244-002c-4c67-924e-f331263ed28f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:48.298290 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da5c4be-9070-4794-af20-44fe5732e95a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:48.298975 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5c4be-9070-4794-af20-44fe5732e95a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.299274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5c4be-9070-4794-af20-44fe5732e95a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.299523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da5c4be-9070-4794-af20-44fe5732e95a admin admin] PATH_INFO: `/v3/users/f1e12eebd35843288ec2b05860022e5a` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.300709 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5c4be-9070-4794-af20-44fe5732e95a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e12eebd35843288ec2b05860022e5a)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:48.302438 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ccaec-b58a-48bf-ac14-59bfadd5bde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:48.302683 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da5c4be-9070-4794-af20-44fe5732e95a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:48.303086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ccaec-b58a-48bf-ac14-59bfadd5bde9 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.303366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ccaec-b58a-48bf-ac14-59bfadd5bde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.303641 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ccaec-b58a-48bf-ac14-59bfadd5bde9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.304336 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ccaec-b58a-48bf-ac14-59bfadd5bde9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:48.305922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ccaec-b58a-48bf-ac14-59bfadd5bde9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:48.322160 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1311/2603] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:31:48.326147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ccaec-b58a-48bf-ac14-59bfadd5bde9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:48.336680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ccaec-b58a-48bf-ac14-59bfadd5bde9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:48.341722 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f2b75-a232-49fe-8dde-11dd67cce332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:48.342331 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f2b75-a232-49fe-8dde-11dd67cce332 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.342631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f2b75-a232-49fe-8dde-11dd67cce332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.342908 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70f2b75-a232-49fe-8dde-11dd67cce332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.344178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f2b75-a232-49fe-8dde-11dd67cce332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:48.345762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d70f2b75-a232-49fe-8dde-11dd67cce332 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:48.355998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1da5c4be-9070-4794-af20-44fe5732e95a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e12eebd35843288ec2b05860022e5a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:48.356419 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1312/2604] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:31:48.360963 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f2b75-a232-49fe-8dde-11dd67cce332 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:48.368249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1da5c4be-9070-4794-af20-44fe5732e95a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e12eebd35843288ec2b05860022e5a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:48.371276 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70f2b75-a232-49fe-8dde-11dd67cce332 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:48.375955 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4698fa58-cd79-4198-81be-1bafab294100 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:48.376618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698fa58-cd79-4198-81be-1bafab294100 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.376898 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698fa58-cd79-4198-81be-1bafab294100 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.377178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4698fa58-cd79-4198-81be-1bafab294100 admin admin] PATH_INFO: `/v3/projects/72a577569e4248908fb62870a4a661f2/users/bb1d794515ed42f58167d8a276bf86fd/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.381225 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1da5c4be-9070-4794-af20-44fe5732e95a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e12eebd35843288ec2b05860022e5a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:48.381948 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1da5c4be-9070-4794-af20-44fe5732e95a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e12eebd35843288ec2b05860022e5a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:48.389264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1da5c4be-9070-4794-af20-44fe5732e95a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e12eebd35843288ec2b05860022e5a'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:48.393056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698fa58-cd79-4198-81be-1bafab294100 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72a577569e4248908fb62870a4a661f2, user_id=bb1d794515ed42f58167d8a276bf86fd, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:48.395604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1293/2605] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:48 2022] DELETE /identity/v3/users/f1e12eebd35843288ec2b05860022e5a => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:48.398511 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4698fa58-cd79-4198-81be-1bafab294100 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:48.399913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f967b1-0b40-42ac-8bf7-f576ddb30923 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.400199 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f967b1-0b40-42ac-8bf7-f576ddb30923 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.400473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f967b1-0b40-42ac-8bf7-f576ddb30923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.414515 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1313/2606] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:48 2022] PUT /identity/v3/projects/72a577569e4248908fb62870a4a661f2/users/bb1d794515ed42f58167d8a276bf86fd/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:48.423132 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-38f967b1-0b40-42ac-8bf7-f576ddb30923 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:48.424341 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-38f967b1-0b40-42ac-8bf7-f576ddb30923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:48.425578 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5807a4c-a550-4c2e-b283-0663e99197f2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.425868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5807a4c-a550-4c2e-b283-0663e99197f2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.426145 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5807a4c-a550-4c2e-b283-0663e99197f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.454660 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c5807a4c-a550-4c2e-b283-0663e99197f2 None None] MFA Rules not processed for user `bb1d794515ed42f58167d8a276bf86fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:48.455845 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c5807a4c-a550-4c2e-b283-0663e99197f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:48.487942 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1294/2607] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:31:48.497891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f967b1-0b40-42ac-8bf7-f576ddb30923 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:48.499306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-38f967b1-0b40-42ac-8bf7-f576ddb30923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:48.509731 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:48.530662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1314/2608] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:31:48.535295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5807a4c-a550-4c2e-b283-0663e99197f2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:48.536671 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c5807a4c-a550-4c2e-b283-0663e99197f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:48.549988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5807a4c-a550-4c2e-b283-0663e99197f2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:48.555147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254cdd9-3933-40ff-9cf3-56f78821806c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:48.555768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254cdd9-3933-40ff-9cf3-56f78821806c admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.556077 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254cdd9-3933-40ff-9cf3-56f78821806c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.556346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5254cdd9-3933-40ff-9cf3-56f78821806c admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.557104 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254cdd9-3933-40ff-9cf3-56f78821806c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:48.559084 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5254cdd9-3933-40ff-9cf3-56f78821806c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:48.563122 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f967b1-0b40-42ac-8bf7-f576ddb30923 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:48.568151 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e8c99-7e8a-4bc5-a942-8950715029af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:48.568789 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8c99-7e8a-4bc5-a942-8950715029af service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.569068 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8c99-7e8a-4bc5-a942-8950715029af service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.569339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e8c99-7e8a-4bc5-a942-8950715029af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.579921 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e8c99-7e8a-4bc5-a942-8950715029af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:48.581494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e8c99-7e8a-4bc5-a942-8950715029af service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:48.593333 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1315/2609] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:48 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:31:48.593556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1295/2610] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:31:48.595367 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254cdd9-3933-40ff-9cf3-56f78821806c admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:48.609287 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:48.665428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5254cdd9-3933-40ff-9cf3-56f78821806c admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:48.670158 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019877b1-f1ca-47fd-a7cb-eb79f75a47d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:48.670804 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019877b1-f1ca-47fd-a7cb-eb79f75a47d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.671086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019877b1-f1ca-47fd-a7cb-eb79f75a47d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.671357 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019877b1-f1ca-47fd-a7cb-eb79f75a47d5 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.672596 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019877b1-f1ca-47fd-a7cb-eb79f75a47d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:48.674519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019877b1-f1ca-47fd-a7cb-eb79f75a47d5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:48.696200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1316/2611] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:31:48 2022] POST /identity/v3/users => generated 296 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:31:48.699902 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e8c99-7e8a-4bc5-a942-8950715029af service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:48.711193 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e8c99-7e8a-4bc5-a942-8950715029af service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:48.716511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f797b-fcd5-4df1-994d-53c331d81f6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:48.717116 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f797b-fcd5-4df1-994d-53c331d81f6b admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.717393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f797b-fcd5-4df1-994d-53c331d81f6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.717664 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f797b-fcd5-4df1-994d-53c331d81f6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.718349 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f797b-fcd5-4df1-994d-53c331d81f6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:48.720818 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f797b-fcd5-4df1-994d-53c331d81f6b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:48.731438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1296/2612] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:48.735679 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019877b1-f1ca-47fd-a7cb-eb79f75a47d5 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:48.746012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019877b1-f1ca-47fd-a7cb-eb79f75a47d5 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:48.751918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4214840-d2cc-41e0-a5ef-e03fc889c0bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:48.752629 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4214840-d2cc-41e0-a5ef-e03fc889c0bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.752907 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4214840-d2cc-41e0-a5ef-e03fc889c0bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.753178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4214840-d2cc-41e0-a5ef-e03fc889c0bd admin admin] PATH_INFO: `/v3/projects/e2dded2ffb8141e2a0f6b7c3c320070d/users/3d5d0fce8e0f4a15b7971237dc92327e/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.772550 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4214840-d2cc-41e0-a5ef-e03fc889c0bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2dded2ffb8141e2a0f6b7c3c320070d, user_id=3d5d0fce8e0f4a15b7971237dc92327e, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:48.775479 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4214840-d2cc-41e0-a5ef-e03fc889c0bd admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:48.780206 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f797b-fcd5-4df1-994d-53c331d81f6b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:48.783638 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-fd8f797b-fcd5-4df1-994d-53c331d81f6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:48.793162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1317/2613] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:48 2022] PUT /identity/v3/projects/e2dded2ffb8141e2a0f6b7c3c320070d/users/3d5d0fce8e0f4a15b7971237dc92327e/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:48.797149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4214840-d2cc-41e0-a5ef-e03fc889c0bd admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:48.804050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f797b-fcd5-4df1-994d-53c331d81f6b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:48.869954 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4214840-d2cc-41e0-a5ef-e03fc889c0bd admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:48.874857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5991310-dd4b-44ac-9877-d31594bd20b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:48.875547 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5991310-dd4b-44ac-9877-d31594bd20b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.875899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5991310-dd4b-44ac-9877-d31594bd20b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.876293 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5991310-dd4b-44ac-9877-d31594bd20b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.877281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5991310-dd4b-44ac-9877-d31594bd20b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:48.879137 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5991310-dd4b-44ac-9877-d31594bd20b6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:48.883089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63190df6-cda4-40e0-97a1-4b72943600c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:48.883768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63190df6-cda4-40e0-97a1-4b72943600c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.884175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63190df6-cda4-40e0-97a1-4b72943600c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.884464 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63190df6-cda4-40e0-97a1-4b72943600c4 admin admin] PATH_INFO: `/v3/projects/7aaa5f6bf9de4a81b523e256fbc33ca3` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.885652 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63190df6-cda4-40e0-97a1-4b72943600c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7aaa5f6bf9de4a81b523e256fbc33ca3)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:48.887636 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63190df6-cda4-40e0-97a1-4b72943600c4 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:48.889955 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1318/2614] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:48 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:31:48.894689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5991310-dd4b-44ac-9877-d31594bd20b6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:48.907889 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5991310-dd4b-44ac-9877-d31594bd20b6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:48.915719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776aac52-5cff-4bb7-b399-35172060e871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:48.916931 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aac52-5cff-4bb7-b399-35172060e871 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.917506 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aac52-5cff-4bb7-b399-35172060e871 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.918075 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776aac52-5cff-4bb7-b399-35172060e871 admin admin] PATH_INFO: `/v3/projects/e2dded2ffb8141e2a0f6b7c3c320070d/users/3d5d0fce8e0f4a15b7971237dc92327e/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.921732 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aac52-5cff-4bb7-b399-35172060e871 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2dded2ffb8141e2a0f6b7c3c320070d, user_id=3d5d0fce8e0f4a15b7971237dc92327e, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:48.927152 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776aac52-5cff-4bb7-b399-35172060e871 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:48.938731 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-63190df6-cda4-40e0-97a1-4b72943600c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7aaa5f6bf9de4a81b523e256fbc33ca3', 'request_id': 'req-63190df6-cda4-40e0-97a1-4b72943600c4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:48.941048 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1319/2615] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:48 2022] PUT /identity/v3/projects/e2dded2ffb8141e2a0f6b7c3c320070d/users/3d5d0fce8e0f4a15b7971237dc92327e/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:48.945194 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-63190df6-cda4-40e0-97a1-4b72943600c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7aaa5f6bf9de4a81b523e256fbc33ca3', 'request_id': 'req-63190df6-cda4-40e0-97a1-4b72943600c4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:48.951890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ac42c-1d62-4e3c-ab3b-ab7e70ae01f1 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.952272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ac42c-1d62-4e3c-ab3b-ab7e70ae01f1 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.952533 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69ac42c-1d62-4e3c-ab3b-ab7e70ae01f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.953809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-63190df6-cda4-40e0-97a1-4b72943600c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7aaa5f6bf9de4a81b523e256fbc33ca3', 'request_id': 'req-63190df6-cda4-40e0-97a1-4b72943600c4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:48.971008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-63190df6-cda4-40e0-97a1-4b72943600c4 admin admin] The token cache is being invalidate because project 7aaa5f6bf9de4a81b523e256fbc33ca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:48.971434 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-63190df6-cda4-40e0-97a1-4b72943600c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:48.972483 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-63190df6-cda4-40e0-97a1-4b72943600c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:48.975140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1297/2616] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:48 2022] DELETE /identity/v3/projects/7aaa5f6bf9de4a81b523e256fbc33ca3 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:48.979964 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83efc73-2c4d-4de6-bf27-3027356b49da None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:48.980341 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83efc73-2c4d-4de6-bf27-3027356b49da None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:48.980680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83efc73-2c4d-4de6-bf27-3027356b49da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:48.982650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b69ac42c-1d62-4e3c-ab3b-ab7e70ae01f1 None None] MFA Rules not processed for user `3d5d0fce8e0f4a15b7971237dc92327e`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:48.983939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b69ac42c-1d62-4e3c-ab3b-ab7e70ae01f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:49.001640 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a83efc73-2c4d-4de6-bf27-3027356b49da None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:49.002922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a83efc73-2c4d-4de6-bf27-3027356b49da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:49.029029 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:49.051232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:49.068506 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1298/2617] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:31:49.076142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1320/2618] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:49.076372 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3c48b-9d39-414b-b169-f0cc7970f2e6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:49.076661 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3c48b-9d39-414b-b169-f0cc7970f2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:49.076967 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd3c48b-9d39-414b-b169-f0cc7970f2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:49.089682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ac42c-1d62-4e3c-ab3b-ab7e70ae01f1 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:49.091313 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b69ac42c-1d62-4e3c-ab3b-ab7e70ae01f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:49.098297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-bdd3c48b-9d39-414b-b169-f0cc7970f2e6 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:49.099527 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bdd3c48b-9d39-414b-b169-f0cc7970f2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:49.107545 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1299/2619] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:31:49.111704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3c48b-9d39-414b-b169-f0cc7970f2e6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:49.120740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd3c48b-9d39-414b-b169-f0cc7970f2e6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:49.126060 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a472c38-b5ce-4f48-8820-8bc196fd61e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:49.126716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a472c38-b5ce-4f48-8820-8bc196fd61e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:49.126999 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a472c38-b5ce-4f48-8820-8bc196fd61e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:49.127269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a472c38-b5ce-4f48-8820-8bc196fd61e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:49.127973 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a472c38-b5ce-4f48-8820-8bc196fd61e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:31:49.128276 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a472c38-b5ce-4f48-8820-8bc196fd61e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:49.129913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a472c38-b5ce-4f48-8820-8bc196fd61e7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:49.142703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1300/2620] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:31:49.146861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a472c38-b5ce-4f48-8820-8bc196fd61e7 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:49.157210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a472c38-b5ce-4f48-8820-8bc196fd61e7 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:49.159103 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69ac42c-1d62-4e3c-ab3b-ab7e70ae01f1 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:49.162095 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e565a3-7603-485d-8485-5011bd0047b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:49.162749 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e565a3-7603-485d-8485-5011bd0047b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:49.163033 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e565a3-7603-485d-8485-5011bd0047b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:49.163136 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e1a95-2dd3-4352-91d5-e61696e7696d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:49.163308 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e565a3-7603-485d-8485-5011bd0047b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:49.163689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e1a95-2dd3-4352-91d5-e61696e7696d service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:49.163965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e565a3-7603-485d-8485-5011bd0047b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:49.164079 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e1a95-2dd3-4352-91d5-e61696e7696d service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:49.164234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791e1a95-2dd3-4352-91d5-e61696e7696d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:49.165895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e565a3-7603-485d-8485-5011bd0047b8 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:49.174144 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e1a95-2dd3-4352-91d5-e61696e7696d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:49.175643 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791e1a95-2dd3-4352-91d5-e61696e7696d service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:49.186796 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1321/2621] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:49 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:31:49.196373 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1301/2622] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:49 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:31:49.205986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e1a95-2dd3-4352-91d5-e61696e7696d service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:49.216652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791e1a95-2dd3-4352-91d5-e61696e7696d service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:49.279571 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e565a3-7603-485d-8485-5011bd0047b8 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:49.286212 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ec9f2-9ee2-4627-a6ed-0404b49ee518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:49.286927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ec9f2-9ee2-4627-a6ed-0404b49ee518 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:49.287207 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ec9f2-9ee2-4627-a6ed-0404b49ee518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:49.287476 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ec9f2-9ee2-4627-a6ed-0404b49ee518 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:49.288145 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ec9f2-9ee2-4627-a6ed-0404b49ee518 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:49.290096 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ec9f2-9ee2-4627-a6ed-0404b49ee518 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:49.311687 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1322/2623] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:31:49 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:49.316188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ec9f2-9ee2-4627-a6ed-0404b49ee518 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:49.327762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ec9f2-9ee2-4627-a6ed-0404b49ee518 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:49.333451 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda95d9-032d-4cc8-a4b0-f7d7c0f0c6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:49.334178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda95d9-032d-4cc8-a4b0-f7d7c0f0c6fb admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:49.334482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda95d9-032d-4cc8-a4b0-f7d7c0f0c6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:49.334774 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecda95d9-032d-4cc8-a4b0-f7d7c0f0c6fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:49.335469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda95d9-032d-4cc8-a4b0-f7d7c0f0c6fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:49.337112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecda95d9-032d-4cc8-a4b0-f7d7c0f0c6fb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:49.339916 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e565a3-7603-485d-8485-5011bd0047b8 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:49.343881 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b87e51-5eeb-4379-ae66-4f66b2a01d86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:49.349306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b87e51-5eeb-4379-ae66-4f66b2a01d86 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:49.349306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b87e51-5eeb-4379-ae66-4f66b2a01d86 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:49.349306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b87e51-5eeb-4379-ae66-4f66b2a01d86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:49.349703 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1323/2624] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:31:49.350476 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-68b87e51-5eeb-4379-ae66-4f66b2a01d86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:49.354730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda95d9-032d-4cc8-a4b0-f7d7c0f0c6fb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:49.369350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecda95d9-032d-4cc8-a4b0-f7d7c0f0c6fb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:49.374188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6f3af-c26d-4c13-be64-140158b9cfd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:49.375509 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6f3af-c26d-4c13-be64-140158b9cfd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:49.375794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6f3af-c26d-4c13-be64-140158b9cfd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:49.376066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6f3af-c26d-4c13-be64-140158b9cfd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:49.376757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6f3af-c26d-4c13-be64-140158b9cfd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:49.378384 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6f3af-c26d-4c13-be64-140158b9cfd2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:49.389411 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1324/2625] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:49 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:31:49.394213 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6f3af-c26d-4c13-be64-140158b9cfd2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:49.409310 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6f3af-c26d-4c13-be64-140158b9cfd2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:49.414132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc12b9-c719-4fb1-b317-ea1d290529cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:49.414851 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc12b9-c719-4fb1-b317-ea1d290529cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:49.415122 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc12b9-c719-4fb1-b317-ea1d290529cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:49.415394 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6fc12b9-c719-4fb1-b317-ea1d290529cb admin admin] PATH_INFO: `/v3/projects/e75a857bfc7f4a5d93ac3bfc6c0a00d8/users/4af695bcf038421b9c7e58b09ce4d6ff/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:49.419073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b87e51-5eeb-4379-ae66-4f66b2a01d86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:49.420620 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b87e51-5eeb-4379-ae66-4f66b2a01d86 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:49.430998 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc12b9-c719-4fb1-b317-ea1d290529cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e75a857bfc7f4a5d93ac3bfc6c0a00d8, user_id=4af695bcf038421b9c7e58b09ce4d6ff, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:49.431397 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1302/2626] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:49.433633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6fc12b9-c719-4fb1-b317-ea1d290529cb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:49.448709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1325/2627] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:49 2022] PUT /identity/v3/projects/e75a857bfc7f4a5d93ac3bfc6c0a00d8/users/4af695bcf038421b9c7e58b09ce4d6ff/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:49.454051 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175067d7-1f27-4416-837f-57f37894ffc6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:49.454422 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175067d7-1f27-4416-837f-57f37894ffc6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:49.454794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175067d7-1f27-4416-837f-57f37894ffc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:49.477569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-175067d7-1f27-4416-837f-57f37894ffc6 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:49.478791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-175067d7-1f27-4416-837f-57f37894ffc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:49.522075 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:49.552910 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1303/2628] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:49.562601 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc12b9-c719-4fb1-b317-ea1d290529cb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:49.564531 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f6fc12b9-c719-4fb1-b317-ea1d290529cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:49.607772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:49.633332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6fc12b9-c719-4fb1-b317-ea1d290529cb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:49.637174 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9559a4b-b275-41b8-87bc-97698ec88ae2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:49.637813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9559a4b-b275-41b8-87bc-97698ec88ae2 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:49.638096 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9559a4b-b275-41b8-87bc-97698ec88ae2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:49.638363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9559a4b-b275-41b8-87bc-97698ec88ae2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:49.648835 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9559a4b-b275-41b8-87bc-97698ec88ae2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:49.650291 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9559a4b-b275-41b8-87bc-97698ec88ae2 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:49.661472 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1326/2629] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:53.916398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a072f-e924-49e0-b282-b6fb015aafc2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:53.916995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a072f-e924-49e0-b282-b6fb015aafc2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:53.917481 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519a072f-e924-49e0-b282-b6fb015aafc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:53.966302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-519a072f-e924-49e0-b282-b6fb015aafc2 None None] MFA Rules not processed for user `4af695bcf038421b9c7e58b09ce4d6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:53.967995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-519a072f-e924-49e0-b282-b6fb015aafc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:54.060859 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1304/2630] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:54.065818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9559a4b-b275-41b8-87bc-97698ec88ae2 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:54.077065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9559a4b-b275-41b8-87bc-97698ec88ae2 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:54.082204 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8513d-7156-43e7-9939-7bbb98a2512b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:54.083086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8513d-7156-43e7-9939-7bbb98a2512b admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:54.083541 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8513d-7156-43e7-9939-7bbb98a2512b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:54.084012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f8513d-7156-43e7-9939-7bbb98a2512b admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:54.084859 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8513d-7156-43e7-9939-7bbb98a2512b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:54.087019 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f8513d-7156-43e7-9939-7bbb98a2512b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:54.131615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1327/2631] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:54 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:54.132399 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a072f-e924-49e0-b282-b6fb015aafc2 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:54.144989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519a072f-e924-49e0-b282-b6fb015aafc2 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:54.210281 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede36f37-db35-47a1-90fb-6f30a8b0011f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:54.210949 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede36f37-db35-47a1-90fb-6f30a8b0011f admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:54.211228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede36f37-db35-47a1-90fb-6f30a8b0011f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:54.211498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede36f37-db35-47a1-90fb-6f30a8b0011f admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:54.212153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede36f37-db35-47a1-90fb-6f30a8b0011f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:54.214087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede36f37-db35-47a1-90fb-6f30a8b0011f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:54.238179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1305/2632] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:31:54 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:31:54.242540 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8513d-7156-43e7-9939-7bbb98a2512b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:54.253994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f8513d-7156-43e7-9939-7bbb98a2512b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:54.258981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0f80e-63f4-4c31-9393-1ed6c65a84a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:54.259689 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0f80e-63f4-4c31-9393-1ed6c65a84a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:54.260039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0f80e-63f4-4c31-9393-1ed6c65a84a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:54.260380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca0f80e-63f4-4c31-9393-1ed6c65a84a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:54.261232 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0f80e-63f4-4c31-9393-1ed6c65a84a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:54.262858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca0f80e-63f4-4c31-9393-1ed6c65a84a5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:54.274659 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1328/2633] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:54.279476 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede36f37-db35-47a1-90fb-6f30a8b0011f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:54.290821 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede36f37-db35-47a1-90fb-6f30a8b0011f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:54.295608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b7be3-5c4e-43bf-bcfd-5e7162837b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:54.296285 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b7be3-5c4e-43bf-bcfd-5e7162837b48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:54.296565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b7be3-5c4e-43bf-bcfd-5e7162837b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:54.297379 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732b7be3-5c4e-43bf-bcfd-5e7162837b48 admin admin] PATH_INFO: `/v3/projects/31704788ce324f7aa69b5750db8c0625/users/231674e2763e4e859c337542d608deef/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:54.313247 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b7be3-5c4e-43bf-bcfd-5e7162837b48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31704788ce324f7aa69b5750db8c0625, user_id=231674e2763e4e859c337542d608deef, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:54.316023 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732b7be3-5c4e-43bf-bcfd-5e7162837b48 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:54.330304 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1306/2634] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:54 2022] PUT /identity/v3/projects/31704788ce324f7aa69b5750db8c0625/users/231674e2763e4e859c337542d608deef/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:54.334318 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0f80e-63f4-4c31-9393-1ed6c65a84a5 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:54.345457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca0f80e-63f4-4c31-9393-1ed6c65a84a5 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:54.406970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0252b3-f2b8-48f4-b985-47b61faf9cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:54.407792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0252b3-f2b8-48f4-b985-47b61faf9cdf admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:54.408095 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0252b3-f2b8-48f4-b985-47b61faf9cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:54.408373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0252b3-f2b8-48f4-b985-47b61faf9cdf admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:54.409070 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0252b3-f2b8-48f4-b985-47b61faf9cdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:54.410754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0252b3-f2b8-48f4-b985-47b61faf9cdf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:54.421720 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1329/2635] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:54.426738 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b7be3-5c4e-43bf-bcfd-5e7162837b48 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:54.438012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732b7be3-5c4e-43bf-bcfd-5e7162837b48 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:54.443232 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde152c0-f798-4514-809e-2f2043be9d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:54.443921 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde152c0-f798-4514-809e-2f2043be9d75 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:54.444203 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde152c0-f798-4514-809e-2f2043be9d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:54.444479 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde152c0-f798-4514-809e-2f2043be9d75 admin admin] PATH_INFO: `/v3/projects/31704788ce324f7aa69b5750db8c0625/users/231674e2763e4e859c337542d608deef/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:54.446441 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde152c0-f798-4514-809e-2f2043be9d75 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31704788ce324f7aa69b5750db8c0625, user_id=231674e2763e4e859c337542d608deef, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:54.449135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde152c0-f798-4514-809e-2f2043be9d75 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:54.460686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1307/2636] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:54 2022] PUT /identity/v3/projects/31704788ce324f7aa69b5750db8c0625/users/231674e2763e4e859c337542d608deef/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:31:56.861695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0252b3-f2b8-48f4-b985-47b61faf9cdf admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:56.863763 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5c0252b3-f2b8-48f4-b985-47b61faf9cdf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:56.886570 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0252b3-f2b8-48f4-b985-47b61faf9cdf admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:57.024811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff1579-a801-4eec-b7f4-7ff6517b9afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:57.025470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff1579-a801-4eec-b7f4-7ff6517b9afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:57.025751 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff1579-a801-4eec-b7f4-7ff6517b9afe admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:57.026027 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ff1579-a801-4eec-b7f4-7ff6517b9afe admin admin] PATH_INFO: `/v3/users/bb1d794515ed42f58167d8a276bf86fd` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:57.027412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff1579-a801-4eec-b7f4-7ff6517b9afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb1d794515ed42f58167d8a276bf86fd)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:57.029415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ff1579-a801-4eec-b7f4-7ff6517b9afe admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:57.096378 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:57.111954 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-56ff1579-a801-4eec-b7f4-7ff6517b9afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb1d794515ed42f58167d8a276bf86fd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:57.132828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-56ff1579-a801-4eec-b7f4-7ff6517b9afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb1d794515ed42f58167d8a276bf86fd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:57.148145 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-56ff1579-a801-4eec-b7f4-7ff6517b9afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb1d794515ed42f58167d8a276bf86fd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:57.149673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-56ff1579-a801-4eec-b7f4-7ff6517b9afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb1d794515ed42f58167d8a276bf86fd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:57.167608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-56ff1579-a801-4eec-b7f4-7ff6517b9afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb1d794515ed42f58167d8a276bf86fd'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:57.175074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1330/2637] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:56 2022] DELETE /identity/v3/users/bb1d794515ed42f58167d8a276bf86fd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:57.180380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094376b3-1561-4305-841f-836c51ce0fba None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:57.181245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094376b3-1561-4305-841f-836c51ce0fba None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:57.181245 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094376b3-1561-4305-841f-836c51ce0fba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:57.214453 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-094376b3-1561-4305-841f-836c51ce0fba None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:57.215861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-094376b3-1561-4305-841f-836c51ce0fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:57.247183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:57.375005 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1308/2638] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:57.392263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff1579-a801-4eec-b7f4-7ff6517b9afe admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:57.394000 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-56ff1579-a801-4eec-b7f4-7ff6517b9afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:57.525523 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ff1579-a801-4eec-b7f4-7ff6517b9afe admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:57.529808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b5673-2d5a-408d-a637-422e51f1d74a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:57.531884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b5673-2d5a-408d-a637-422e51f1d74a service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:57.532263 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b5673-2d5a-408d-a637-422e51f1d74a service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:57.532617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272b5673-2d5a-408d-a637-422e51f1d74a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:57.547147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b5673-2d5a-408d-a637-422e51f1d74a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:57.549025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272b5673-2d5a-408d-a637-422e51f1d74a service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:57.589249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1331/2639] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:31:58.009532 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094376b3-1561-4305-841f-836c51ce0fba None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:58.012023 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-094376b3-1561-4305-841f-836c51ce0fba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:58.036028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094376b3-1561-4305-841f-836c51ce0fba None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:58.055492 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:58.056568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:58.057973 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:58.058360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d admin admin] PATH_INFO: `/v3/projects/72a577569e4248908fb62870a4a661f2` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:58.059901 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d admin admin] RBAC: Authorizing `identity:delete_project(project_id=72a577569e4248908fb62870a4a661f2)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:58.062072 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:58.179299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72a577569e4248908fb62870a4a661f2', 'request_id': 'req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:58.186745 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72a577569e4248908fb62870a4a661f2', 'request_id': 'req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:58.200112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72a577569e4248908fb62870a4a661f2', 'request_id': 'req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:58.219861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d admin admin] The token cache is being invalidate because project 72a577569e4248908fb62870a4a661f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:58.220624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:58.221776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:58.223838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1309/2640] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:58 2022] DELETE /identity/v3/projects/72a577569e4248908fb62870a4a661f2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:58.228883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b5673-2d5a-408d-a637-422e51f1d74a service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:58.241013 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272b5673-2d5a-408d-a637-422e51f1d74a service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:58.325421 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd61b4b-caf7-4740-8412-e886ee7d8814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:58.326747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd61b4b-caf7-4740-8412-e886ee7d8814 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:58.326747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd61b4b-caf7-4740-8412-e886ee7d8814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:58.326747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd61b4b-caf7-4740-8412-e886ee7d8814 admin admin] PATH_INFO: `/v3/users/3d5d0fce8e0f4a15b7971237dc92327e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:58.328225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd61b4b-caf7-4740-8412-e886ee7d8814 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d5d0fce8e0f4a15b7971237dc92327e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:58.330763 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd61b4b-caf7-4740-8412-e886ee7d8814 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:58.432029 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3dd61b4b-caf7-4740-8412-e886ee7d8814 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d5d0fce8e0f4a15b7971237dc92327e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:58.454563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:58.455936 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3dd61b4b-caf7-4740-8412-e886ee7d8814 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d5d0fce8e0f4a15b7971237dc92327e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:58.473291 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3dd61b4b-caf7-4740-8412-e886ee7d8814 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d5d0fce8e0f4a15b7971237dc92327e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:58.474527 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3dd61b4b-caf7-4740-8412-e886ee7d8814 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d5d0fce8e0f4a15b7971237dc92327e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:58.486383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3dd61b4b-caf7-4740-8412-e886ee7d8814 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d5d0fce8e0f4a15b7971237dc92327e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:58.497532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1332/2641] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:31:58 2022] DELETE /identity/v3/users/3d5d0fce8e0f4a15b7971237dc92327e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:58.888468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:58.890119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:58.910651 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51120a86-6ceb-48ea-8e42-b5fe3ddca10d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:58.979117 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6837946c-a259-4ad9-8309-15f7f89fa14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:58.979768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837946c-a259-4ad9-8309-15f7f89fa14f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:58.980579 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837946c-a259-4ad9-8309-15f7f89fa14f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:58.980579 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6837946c-a259-4ad9-8309-15f7f89fa14f admin admin] PATH_INFO: `/v3/projects/e2dded2ffb8141e2a0f6b7c3c320070d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:58.981836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837946c-a259-4ad9-8309-15f7f89fa14f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2dded2ffb8141e2a0f6b7c3c320070d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:58.983941 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6837946c-a259-4ad9-8309-15f7f89fa14f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:59.044421 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6837946c-a259-4ad9-8309-15f7f89fa14f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2dded2ffb8141e2a0f6b7c3c320070d', 'request_id': 'req-6837946c-a259-4ad9-8309-15f7f89fa14f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:59.046123 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:59.057167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6837946c-a259-4ad9-8309-15f7f89fa14f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2dded2ffb8141e2a0f6b7c3c320070d', 'request_id': 'req-6837946c-a259-4ad9-8309-15f7f89fa14f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:59.071604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6837946c-a259-4ad9-8309-15f7f89fa14f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2dded2ffb8141e2a0f6b7c3c320070d', 'request_id': 'req-6837946c-a259-4ad9-8309-15f7f89fa14f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:59.091486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6837946c-a259-4ad9-8309-15f7f89fa14f admin admin] The token cache is being invalidate because project e2dded2ffb8141e2a0f6b7c3c320070d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:31:59.091933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6837946c-a259-4ad9-8309-15f7f89fa14f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:59.094945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6837946c-a259-4ad9-8309-15f7f89fa14f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:31:59.100858 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1310/2642] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:31:58 2022] DELETE /identity/v3/projects/e2dded2ffb8141e2a0f6b7c3c320070d => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:59.102995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93399e-61ee-4a2a-8a91-62400fe2b5be None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:59.103863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93399e-61ee-4a2a-8a91-62400fe2b5be None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:59.103863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c93399e-61ee-4a2a-8a91-62400fe2b5be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:59.129719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2c93399e-61ee-4a2a-8a91-62400fe2b5be None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:59.131673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2c93399e-61ee-4a2a-8a91-62400fe2b5be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:59.211649 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1333/2643] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:59.222102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c312c45-2d72-415c-a24e-27cb664e1d80 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:59.223230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c312c45-2d72-415c-a24e-27cb664e1d80 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:59.223503 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c312c45-2d72-415c-a24e-27cb664e1d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:59.248746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-2c312c45-2d72-415c-a24e-27cb664e1d80 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:59.250188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2c312c45-2d72-415c-a24e-27cb664e1d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:59.259215 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1311/2644] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:59.263669 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93399e-61ee-4a2a-8a91-62400fe2b5be None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:59.281103 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c93399e-61ee-4a2a-8a91-62400fe2b5be None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:59.289940 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935b05a-8c7f-493e-85ba-65645a01f31e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:59.290747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935b05a-8c7f-493e-85ba-65645a01f31e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:59.291195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935b05a-8c7f-493e-85ba-65645a01f31e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:59.291563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935b05a-8c7f-493e-85ba-65645a01f31e admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:59.292774 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935b05a-8c7f-493e-85ba-65645a01f31e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:31:59.293613 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935b05a-8c7f-493e-85ba-65645a01f31e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:59.295293 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935b05a-8c7f-493e-85ba-65645a01f31e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:59.311933 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1334/2645] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:31:59.313290 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c312c45-2d72-415c-a24e-27cb664e1d80 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:59.326274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c312c45-2d72-415c-a24e-27cb664e1d80 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:59.332145 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dab3e-bf5a-4810-b93b-5ce0541f78b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:59.332634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dab3e-bf5a-4810-b93b-5ce0541f78b3 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:59.332912 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dab3e-bf5a-4810-b93b-5ce0541f78b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:59.333186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4dab3e-bf5a-4810-b93b-5ce0541f78b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:59.334193 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dab3e-bf5a-4810-b93b-5ce0541f78b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:59.336400 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4dab3e-bf5a-4810-b93b-5ce0541f78b3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:59.374517 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1312/2646] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:59 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:59.379343 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935b05a-8c7f-493e-85ba-65645a01f31e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:59.393988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935b05a-8c7f-493e-85ba-65645a01f31e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:59.473146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29332f0-ee89-4452-a49a-1dd00e0b5f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:59.473700 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29332f0-ee89-4452-a49a-1dd00e0b5f45 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:59.473984 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29332f0-ee89-4452-a49a-1dd00e0b5f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:59.474261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29332f0-ee89-4452-a49a-1dd00e0b5f45 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:59.474988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29332f0-ee89-4452-a49a-1dd00e0b5f45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:59.476986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d29332f0-ee89-4452-a49a-1dd00e0b5f45 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:59.510627 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1335/2647] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:31:59 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:31:59.514257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dab3e-bf5a-4810-b93b-5ce0541f78b3 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:59.528235 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4dab3e-bf5a-4810-b93b-5ce0541f78b3 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:59.552648 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa4c31-a782-4504-8b4a-6da2e1cc5a0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:59.553999 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa4c31-a782-4504-8b4a-6da2e1cc5a0c admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:59.554477 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa4c31-a782-4504-8b4a-6da2e1cc5a0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:59.554991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fa4c31-a782-4504-8b4a-6da2e1cc5a0c admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:59.556783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa4c31-a782-4504-8b4a-6da2e1cc5a0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:59.558743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fa4c31-a782-4504-8b4a-6da2e1cc5a0c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:59.572994 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1313/2648] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:31:59.576801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29332f0-ee89-4452-a49a-1dd00e0b5f45 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:59.593351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29332f0-ee89-4452-a49a-1dd00e0b5f45 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:59.600296 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7cc77e-f334-408f-b962-4d5a2c17b928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:59.600942 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cc77e-f334-408f-b962-4d5a2c17b928 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:59.601224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cc77e-f334-408f-b962-4d5a2c17b928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:59.601505 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7cc77e-f334-408f-b962-4d5a2c17b928 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:59.602216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cc77e-f334-408f-b962-4d5a2c17b928 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:59.603906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7cc77e-f334-408f-b962-4d5a2c17b928 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:59.620966 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1336/2649] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:31:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:31:59.622251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa4c31-a782-4504-8b4a-6da2e1cc5a0c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:59.638989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fa4c31-a782-4504-8b4a-6da2e1cc5a0c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:59.649136 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd13f6-2a1b-4c9c-aaaf-8ff6e9d43885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:59.650755 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd13f6-2a1b-4c9c-aaaf-8ff6e9d43885 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:59.651115 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd13f6-2a1b-4c9c-aaaf-8ff6e9d43885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:59.651466 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd13f6-2a1b-4c9c-aaaf-8ff6e9d43885 admin admin] PATH_INFO: `/v3/projects/65977f82a5c34faa82e6fdce41d6dcf7/users/4bbdf6eec39c4abea5ef1122c414e44e/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:59.671236 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd13f6-2a1b-4c9c-aaaf-8ff6e9d43885 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65977f82a5c34faa82e6fdce41d6dcf7, user_id=4bbdf6eec39c4abea5ef1122c414e44e, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:59.679689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd13f6-2a1b-4c9c-aaaf-8ff6e9d43885 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:59.698280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1314/2650] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:31:59 2022] PUT /identity/v3/projects/65977f82a5c34faa82e6fdce41d6dcf7/users/4bbdf6eec39c4abea5ef1122c414e44e/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:31:59.709146 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200d4c5-726d-40b3-9298-d70769297d9d None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:59.709431 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200d4c5-726d-40b3-9298-d70769297d9d None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:59.709702 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f200d4c5-726d-40b3-9298-d70769297d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:59.723546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e629f-7a5d-485e-9895-9b05aaed1df2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:59.724578 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e629f-7a5d-485e-9895-9b05aaed1df2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:59.724578 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5e629f-7a5d-485e-9895-9b05aaed1df2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:59.748792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-f200d4c5-726d-40b3-9298-d70769297d9d None None] MFA Rules not processed for user `4bbdf6eec39c4abea5ef1122c414e44e`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:59.750783 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f200d4c5-726d-40b3-9298-d70769297d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:59.761854 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-6d5e629f-7a5d-485e-9895-9b05aaed1df2 None None] MFA Rules not processed for user `231674e2763e4e859c337542d608deef`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:31:59.763113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6d5e629f-7a5d-485e-9895-9b05aaed1df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:59.801736 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:31:59.841776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1337/2651] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:59 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:59.847556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200d4c5-726d-40b3-9298-d70769297d9d None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:59.853754 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1315/2652] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:31:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:31:59.870870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e629f-7a5d-485e-9895-9b05aaed1df2 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:31:59.872855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-6d5e629f-7a5d-485e-9895-9b05aaed1df2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:59.936567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f200d4c5-726d-40b3-9298-d70769297d9d None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:59.943503 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe505f7-bf8c-461e-8abc-1aabab779fe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:59.944337 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe505f7-bf8c-461e-8abc-1aabab779fe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:59.944592 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe505f7-bf8c-461e-8abc-1aabab779fe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:59.944872 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe505f7-bf8c-461e-8abc-1aabab779fe5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:59.945867 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe505f7-bf8c-461e-8abc-1aabab779fe5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:31:59.948428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe505f7-bf8c-461e-8abc-1aabab779fe5 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:31:59.958957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5e629f-7a5d-485e-9895-9b05aaed1df2 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:31:59.962949 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1747c74-44d2-45dc-b345-6f37c06f32ad service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bcc213ef64924074bd16152228913ef1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:31:59.963703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1747c74-44d2-45dc-b345-6f37c06f32ad service glance] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:31:59.964213 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1747c74-44d2-45dc-b345-6f37c06f32ad service glance] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:31:59.964592 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1747c74-44d2-45dc-b345-6f37c06f32ad service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:31:59.966914 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d1747c74-44d2-45dc-b345-6f37c06f32ad service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:31:59.982629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:00.000525 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1338/2653] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:31:59 2022] POST /identity/v3/projects => generated 379 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:32:00.001437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe505f7-bf8c-461e-8abc-1aabab779fe5 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:00.071909 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1747c74-44d2-45dc-b345-6f37c06f32ad service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:00.073468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1747c74-44d2-45dc-b345-6f37c06f32ad service glance] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:00.083206 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1316/2654] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:31:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:32:00.088061 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe505f7-bf8c-461e-8abc-1aabab779fe5 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:00.097936 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baa269-e614-4242-a780-42b0531c9702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:00.098610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baa269-e614-4242-a780-42b0531c9702 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:00.098920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baa269-e614-4242-a780-42b0531c9702 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:00.099163 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6baa269-e614-4242-a780-42b0531c9702 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:00.099993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baa269-e614-4242-a780-42b0531c9702 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:00.102339 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6baa269-e614-4242-a780-42b0531c9702 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:00.132619 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1339/2655] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:32:00 2022] POST /identity/v3/users => generated 296 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:32:00.148064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1747c74-44d2-45dc-b345-6f37c06f32ad service glance] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:00.178748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1747c74-44d2-45dc-b345-6f37c06f32ad service glance] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:00.192082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f012a35a-6581-497a-9f54-6b1e4958e6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:00.193059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012a35a-6581-497a-9f54-6b1e4958e6dc admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:00.193755 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012a35a-6581-497a-9f54-6b1e4958e6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:00.194209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f012a35a-6581-497a-9f54-6b1e4958e6dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:00.195177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012a35a-6581-497a-9f54-6b1e4958e6dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:00.197200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f012a35a-6581-497a-9f54-6b1e4958e6dc admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:00.218624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1317/2656] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:32:00.222789 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baa269-e614-4242-a780-42b0531c9702 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:00.242163 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6baa269-e614-4242-a780-42b0531c9702 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:00.248373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69efcac-aa1f-41f5-936c-8421cc84abcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:00.249271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69efcac-aa1f-41f5-936c-8421cc84abcf admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:00.249762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69efcac-aa1f-41f5-936c-8421cc84abcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:00.250699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69efcac-aa1f-41f5-936c-8421cc84abcf admin admin] PATH_INFO: `/v3/projects/2ea454c074654fc6b8d8dd86fd0f4722/users/ba13988b462b4682b698160a4bc4a041/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:00.267840 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69efcac-aa1f-41f5-936c-8421cc84abcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea454c074654fc6b8d8dd86fd0f4722, user_id=ba13988b462b4682b698160a4bc4a041, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:00.271757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69efcac-aa1f-41f5-936c-8421cc84abcf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:00.283795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abf20c-c16a-43d9-bcb7-1a7109771199 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:00.284334 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abf20c-c16a-43d9-bcb7-1a7109771199 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:00.284551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abf20c-c16a-43d9-bcb7-1a7109771199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:00.288395 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1340/2657] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:32:00 2022] PUT /identity/v3/projects/2ea454c074654fc6b8d8dd86fd0f4722/users/ba13988b462b4682b698160a4bc4a041/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:00.294701 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69efcac-aa1f-41f5-936c-8421cc84abcf admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:00.321499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-69abf20c-c16a-43d9-bcb7-1a7109771199 None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:00.322873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-69abf20c-c16a-43d9-bcb7-1a7109771199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:00.339936 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:00.382941 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69efcac-aa1f-41f5-936c-8421cc84abcf admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:00.389736 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3481a-99fb-4f66-ac31-f32f3f0fac0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:00.390844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3481a-99fb-4f66-ac31-f32f3f0fac0d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:00.391288 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3481a-99fb-4f66-ac31-f32f3f0fac0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:00.391565 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee3481a-99fb-4f66-ac31-f32f3f0fac0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:00.392346 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3481a-99fb-4f66-ac31-f32f3f0fac0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:00.394270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee3481a-99fb-4f66-ac31-f32f3f0fac0d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:00.398391 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1318/2658] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 1 14:32:00 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:00.411612 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abf20c-c16a-43d9-bcb7-1a7109771199 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:00.413112 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-69abf20c-c16a-43d9-bcb7-1a7109771199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:00.416974 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1341/2659] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:32:00.418186 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3481a-99fb-4f66-ac31-f32f3f0fac0d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:00.431230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee3481a-99fb-4f66-ac31-f32f3f0fac0d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:00.436771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae4ba93-126f-4499-b80a-e6254ba4b7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:00.437532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4ba93-126f-4499-b80a-e6254ba4b7a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:00.437904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4ba93-126f-4499-b80a-e6254ba4b7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:00.438188 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae4ba93-126f-4499-b80a-e6254ba4b7a0 admin admin] PATH_INFO: `/v3/projects/2ea454c074654fc6b8d8dd86fd0f4722/users/ba13988b462b4682b698160a4bc4a041/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:00.440471 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4ba93-126f-4499-b80a-e6254ba4b7a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2ea454c074654fc6b8d8dd86fd0f4722, user_id=ba13988b462b4682b698160a4bc4a041, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:00.443520 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae4ba93-126f-4499-b80a-e6254ba4b7a0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:00.455954 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1342/2660] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:32:00 2022] PUT /identity/v3/projects/2ea454c074654fc6b8d8dd86fd0f4722/users/ba13988b462b4682b698160a4bc4a041/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:32:00.467449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b524d7c-c84b-4e72-9a9c-5174ae7695e4 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:00.467772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b524d7c-c84b-4e72-9a9c-5174ae7695e4 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:00.468008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b524d7c-c84b-4e72-9a9c-5174ae7695e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:00.504737 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8b524d7c-c84b-4e72-9a9c-5174ae7695e4 None None] MFA Rules not processed for user `ba13988b462b4682b698160a4bc4a041`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:00.506203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8b524d7c-c84b-4e72-9a9c-5174ae7695e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:00.506989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abf20c-c16a-43d9-bcb7-1a7109771199 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:00.573957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:00.596098 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a3df6-fefb-4af9-bd0a-585dbe201c3e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:00.596982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a3df6-fefb-4af9-bd0a-585dbe201c3e service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:00.597326 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a3df6-fefb-4af9-bd0a-585dbe201c3e service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:00.601666 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1343/2661] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:00 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:32:00.601864 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460a3df6-fefb-4af9-bd0a-585dbe201c3e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:00.611900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b524d7c-c84b-4e72-9a9c-5174ae7695e4 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:00.615815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8b524d7c-c84b-4e72-9a9c-5174ae7695e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:00.710761 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a3df6-fefb-4af9-bd0a-585dbe201c3e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:00.712384 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b524d7c-c84b-4e72-9a9c-5174ae7695e4 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:00.712533 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460a3df6-fefb-4af9-bd0a-585dbe201c3e service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:00.717806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f213420-6663-4637-b875-881f94bea936 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:00.718446 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f213420-6663-4637-b875-881f94bea936 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:00.719535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f213420-6663-4637-b875-881f94bea936 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:00.719819 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f213420-6663-4637-b875-881f94bea936 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:00.735450 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1319/2662] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:32:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:32:00.826383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:00.859458 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f213420-6663-4637-b875-881f94bea936 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:00.861286 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f213420-6663-4637-b875-881f94bea936 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:00.874426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1344/2663] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:00 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:32:02.379021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a3df6-fefb-4af9-bd0a-585dbe201c3e service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:02.380589 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-460a3df6-fefb-4af9-bd0a-585dbe201c3e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:02.393558 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460a3df6-fefb-4af9-bd0a-585dbe201c3e service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:02.397546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af871d6-8087-4139-9f68-ea2686348993 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:02.398170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af871d6-8087-4139-9f68-ea2686348993 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:02.398449 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af871d6-8087-4139-9f68-ea2686348993 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:02.398771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af871d6-8087-4139-9f68-ea2686348993 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:02.412136 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af871d6-8087-4139-9f68-ea2686348993 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:02.413360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af871d6-8087-4139-9f68-ea2686348993 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:02.425423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1320/2664] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:02 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:06.543381 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f213420-6663-4637-b875-881f94bea936 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:06.623321 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f213420-6663-4637-b875-881f94bea936 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:06.630020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0d426-8fee-44ed-80d3-4598f6f0dd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:06.631238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0d426-8fee-44ed-80d3-4598f6f0dd87 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:06.631701 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0d426-8fee-44ed-80d3-4598f6f0dd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:06.632142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0d426-8fee-44ed-80d3-4598f6f0dd87 admin admin] PATH_INFO: `/v3/users/4bbdf6eec39c4abea5ef1122c414e44e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:06.633567 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0d426-8fee-44ed-80d3-4598f6f0dd87 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4bbdf6eec39c4abea5ef1122c414e44e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:06.635897 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee0d426-8fee-44ed-80d3-4598f6f0dd87 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:06.698133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ee0d426-8fee-44ed-80d3-4598f6f0dd87 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4bbdf6eec39c4abea5ef1122c414e44e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:06.714888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ee0d426-8fee-44ed-80d3-4598f6f0dd87 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4bbdf6eec39c4abea5ef1122c414e44e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:06.726483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ee0d426-8fee-44ed-80d3-4598f6f0dd87 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4bbdf6eec39c4abea5ef1122c414e44e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:06.728684 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ee0d426-8fee-44ed-80d3-4598f6f0dd87 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4bbdf6eec39c4abea5ef1122c414e44e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:06.738776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-6ee0d426-8fee-44ed-80d3-4598f6f0dd87 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4bbdf6eec39c4abea5ef1122c414e44e'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:06.745997 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1345/2665] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:32:06 2022] DELETE /identity/v3/users/4bbdf6eec39c4abea5ef1122c414e44e => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:06.751087 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d988c5-de45-417a-a457-e63dee74b502 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:06.751604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d988c5-de45-417a-a457-e63dee74b502 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:06.751690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d988c5-de45-417a-a457-e63dee74b502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:06.777806 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-18d988c5-de45-417a-a457-e63dee74b502 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:06.779081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-18d988c5-de45-417a-a457-e63dee74b502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:06.853794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1321/2666] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:32:06.865173 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0d426-8fee-44ed-80d3-4598f6f0dd87 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:06.866636 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6ee0d426-8fee-44ed-80d3-4598f6f0dd87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:06.963933 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0d426-8fee-44ed-80d3-4598f6f0dd87 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:06.967885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4802a8a-027a-4402-ac98-8192b4fdd7ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:06.969163 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4802a8a-027a-4402-ac98-8192b4fdd7ab service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:06.969680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4802a8a-027a-4402-ac98-8192b4fdd7ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:06.970033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4802a8a-027a-4402-ac98-8192b4fdd7ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:06.982074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4802a8a-027a-4402-ac98-8192b4fdd7ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:06.982074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4802a8a-027a-4402-ac98-8192b4fdd7ab service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:06.993142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1346/2667] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:32:07.346398 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d988c5-de45-417a-a457-e63dee74b502 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:07.348037 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-18d988c5-de45-417a-a457-e63dee74b502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:07.362423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d988c5-de45-417a-a457-e63dee74b502 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:07.372013 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b152c97-ec62-404d-99c0-237c2fd19b57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:07.372895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b152c97-ec62-404d-99c0-237c2fd19b57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:07.373367 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b152c97-ec62-404d-99c0-237c2fd19b57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:07.373651 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b152c97-ec62-404d-99c0-237c2fd19b57 admin admin] PATH_INFO: `/v3/projects/65977f82a5c34faa82e6fdce41d6dcf7` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:07.375649 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b152c97-ec62-404d-99c0-237c2fd19b57 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65977f82a5c34faa82e6fdce41d6dcf7)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:07.377743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b152c97-ec62-404d-99c0-237c2fd19b57 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:07.466863 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2b152c97-ec62-404d-99c0-237c2fd19b57 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65977f82a5c34faa82e6fdce41d6dcf7', 'request_id': 'req-2b152c97-ec62-404d-99c0-237c2fd19b57'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:07.476407 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2b152c97-ec62-404d-99c0-237c2fd19b57 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65977f82a5c34faa82e6fdce41d6dcf7', 'request_id': 'req-2b152c97-ec62-404d-99c0-237c2fd19b57'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:07.486483 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2b152c97-ec62-404d-99c0-237c2fd19b57 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65977f82a5c34faa82e6fdce41d6dcf7', 'request_id': 'req-2b152c97-ec62-404d-99c0-237c2fd19b57'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:07.501951 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2b152c97-ec62-404d-99c0-237c2fd19b57 admin admin] The token cache is being invalidate because project 65977f82a5c34faa82e6fdce41d6dcf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:32:07.502512 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2b152c97-ec62-404d-99c0-237c2fd19b57 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:07.503202 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2b152c97-ec62-404d-99c0-237c2fd19b57 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:07.505312 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1322/2668] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:32:07 2022] DELETE /identity/v3/projects/65977f82a5c34faa82e6fdce41d6dcf7 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:07.509578 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4802a8a-027a-4402-ac98-8192b4fdd7ab service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:07.520442 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4802a8a-027a-4402-ac98-8192b4fdd7ab service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:07.529808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:07.611800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b66059-d111-4636-b4f0-5bc482fef60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:07.612631 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b66059-d111-4636-b4f0-5bc482fef60a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:07.613007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b66059-d111-4636-b4f0-5bc482fef60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:07.613400 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b66059-d111-4636-b4f0-5bc482fef60a admin admin] PATH_INFO: `/v3/users/ba13988b462b4682b698160a4bc4a041` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:07.614837 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b66059-d111-4636-b4f0-5bc482fef60a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ba13988b462b4682b698160a4bc4a041)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:07.618270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b66059-d111-4636-b4f0-5bc482fef60a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:07.687000 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-57b66059-d111-4636-b4f0-5bc482fef60a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ba13988b462b4682b698160a4bc4a041'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:07.704133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-57b66059-d111-4636-b4f0-5bc482fef60a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ba13988b462b4682b698160a4bc4a041'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:07.712500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-57b66059-d111-4636-b4f0-5bc482fef60a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ba13988b462b4682b698160a4bc4a041'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:07.713330 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-57b66059-d111-4636-b4f0-5bc482fef60a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ba13988b462b4682b698160a4bc4a041'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:07.726014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-57b66059-d111-4636-b4f0-5bc482fef60a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ba13988b462b4682b698160a4bc4a041'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:07.734045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1347/2669] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:32:07 2022] DELETE /identity/v3/users/ba13988b462b4682b698160a4bc4a041 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:08.071417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b152c97-ec62-404d-99c0-237c2fd19b57 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:08.073432 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-2b152c97-ec62-404d-99c0-237c2fd19b57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:08.083764 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:08.092715 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b152c97-ec62-404d-99c0-237c2fd19b57 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:08.194670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df20ad4-8753-489e-9193-d6e179d2d752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:08.195375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df20ad4-8753-489e-9193-d6e179d2d752 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:08.195640 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df20ad4-8753-489e-9193-d6e179d2d752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:08.195918 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df20ad4-8753-489e-9193-d6e179d2d752 admin admin] PATH_INFO: `/v3/projects/2ea454c074654fc6b8d8dd86fd0f4722` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:08.197306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df20ad4-8753-489e-9193-d6e179d2d752 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2ea454c074654fc6b8d8dd86fd0f4722)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:08.199301 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df20ad4-8753-489e-9193-d6e179d2d752 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:08.261049 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6df20ad4-8753-489e-9193-d6e179d2d752 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2ea454c074654fc6b8d8dd86fd0f4722', 'request_id': 'req-6df20ad4-8753-489e-9193-d6e179d2d752'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:08.267294 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6df20ad4-8753-489e-9193-d6e179d2d752 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2ea454c074654fc6b8d8dd86fd0f4722', 'request_id': 'req-6df20ad4-8753-489e-9193-d6e179d2d752'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:08.279499 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6df20ad4-8753-489e-9193-d6e179d2d752 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2ea454c074654fc6b8d8dd86fd0f4722', 'request_id': 'req-6df20ad4-8753-489e-9193-d6e179d2d752'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:08.294229 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6df20ad4-8753-489e-9193-d6e179d2d752 admin admin] The token cache is being invalidate because project 2ea454c074654fc6b8d8dd86fd0f4722 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:32:08.294516 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6df20ad4-8753-489e-9193-d6e179d2d752 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:08.295228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6df20ad4-8753-489e-9193-d6e179d2d752 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:08.297532 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1323/2670] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:32:08 2022] DELETE /identity/v3/projects/2ea454c074654fc6b8d8dd86fd0f4722 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:08.302355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cfa73-ba5f-43c7-afcc-1386929008e0 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:08.302662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cfa73-ba5f-43c7-afcc-1386929008e0 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:08.302942 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82cfa73-ba5f-43c7-afcc-1386929008e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:08.329462 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b82cfa73-ba5f-43c7-afcc-1386929008e0 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:08.330752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b82cfa73-ba5f-43c7-afcc-1386929008e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:08.409339 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1348/2671] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:08.417186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859193c-9cd1-488d-a229-14b7ef0cb60c None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:08.417476 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859193c-9cd1-488d-a229-14b7ef0cb60c None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:08.417756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d859193c-9cd1-488d-a229-14b7ef0cb60c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:08.461223 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d859193c-9cd1-488d-a229-14b7ef0cb60c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:08.463589 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d859193c-9cd1-488d-a229-14b7ef0cb60c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:08.481363 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1324/2672] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:08.487588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cfa73-ba5f-43c7-afcc-1386929008e0 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:08.497845 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82cfa73-ba5f-43c7-afcc-1386929008e0 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:08.506844 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3d582-bb81-4bd0-be64-2239016e7532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:08.508044 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3d582-bb81-4bd0-be64-2239016e7532 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:08.508373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3d582-bb81-4bd0-be64-2239016e7532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:08.508726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b3d582-bb81-4bd0-be64-2239016e7532 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:08.509615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3d582-bb81-4bd0-be64-2239016e7532 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:32:08.510110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3d582-bb81-4bd0-be64-2239016e7532 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:08.511915 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b3d582-bb81-4bd0-be64-2239016e7532 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:08.531262 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1349/2673] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:32:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:32:08.532520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859193c-9cd1-488d-a229-14b7ef0cb60c None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:08.543701 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d859193c-9cd1-488d-a229-14b7ef0cb60c None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:08.549226 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ca5f0-d310-4fd7-8c16-5760e318a09b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:08.549937 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ca5f0-d310-4fd7-8c16-5760e318a09b admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:08.550290 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ca5f0-d310-4fd7-8c16-5760e318a09b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:08.550668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ca5f0-d310-4fd7-8c16-5760e318a09b admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:08.551427 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ca5f0-d310-4fd7-8c16-5760e318a09b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:08.553523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ca5f0-d310-4fd7-8c16-5760e318a09b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:08.590610 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1325/2674] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:32:08 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:32:08.591726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3d582-bb81-4bd0-be64-2239016e7532 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:08.604919 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b3d582-bb81-4bd0-be64-2239016e7532 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:08.620283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:08.680390 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088229a9-396c-48c9-99c5-1fd01e3b8bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:08.680930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088229a9-396c-48c9-99c5-1fd01e3b8bf8 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:08.681210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088229a9-396c-48c9-99c5-1fd01e3b8bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:08.681487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088229a9-396c-48c9-99c5-1fd01e3b8bf8 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:08.682162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088229a9-396c-48c9-99c5-1fd01e3b8bf8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:08.684305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088229a9-396c-48c9-99c5-1fd01e3b8bf8 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:08.715767 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1350/2675] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:32:08 2022] POST /identity/v3/users => generated 290 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:32:08.717107 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ca5f0-d310-4fd7-8c16-5760e318a09b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:08.729445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ca5f0-d310-4fd7-8c16-5760e318a09b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:08.734947 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdfb33-20b4-4ab5-8879-23b21c147d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:08.735618 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdfb33-20b4-4ab5-8879-23b21c147d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:08.735998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdfb33-20b4-4ab5-8879-23b21c147d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:08.736286 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bdfb33-20b4-4ab5-8879-23b21c147d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:08.737140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdfb33-20b4-4ab5-8879-23b21c147d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:08.738919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bdfb33-20b4-4ab5-8879-23b21c147d1c admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:08.751941 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1326/2676] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:32:08.756058 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088229a9-396c-48c9-99c5-1fd01e3b8bf8 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:08.769574 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088229a9-396c-48c9-99c5-1fd01e3b8bf8 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:08.774911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6446bd2-10ba-4973-b54e-46aaada35f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:08.775982 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6446bd2-10ba-4973-b54e-46aaada35f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:08.776361 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6446bd2-10ba-4973-b54e-46aaada35f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:08.776755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6446bd2-10ba-4973-b54e-46aaada35f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:08.777589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6446bd2-10ba-4973-b54e-46aaada35f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:08.779324 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6446bd2-10ba-4973-b54e-46aaada35f38 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:08.794626 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1351/2677] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:32:08.798690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdfb33-20b4-4ab5-8879-23b21c147d1c admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:08.811738 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bdfb33-20b4-4ab5-8879-23b21c147d1c admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:08.820961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87445156-c871-467a-a02a-40bf8958db3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:08.822025 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87445156-c871-467a-a02a-40bf8958db3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:08.822402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87445156-c871-467a-a02a-40bf8958db3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:08.822823 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87445156-c871-467a-a02a-40bf8958db3e admin admin] PATH_INFO: `/v3/projects/f9ed2117586a4e5da51baea977237096/users/f3c8ddc5d26a4263ae441f3f950d387f/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:08.840946 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87445156-c871-467a-a02a-40bf8958db3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9ed2117586a4e5da51baea977237096, user_id=f3c8ddc5d26a4263ae441f3f950d387f, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:08.844276 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87445156-c871-467a-a02a-40bf8958db3e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:08.862930 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1327/2678] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:32:08 2022] PUT /identity/v3/projects/f9ed2117586a4e5da51baea977237096/users/f3c8ddc5d26a4263ae441f3f950d387f/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:08.873500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581baa5-b1a1-4617-ac77-f0f5ed5e0a5a None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:08.873929 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581baa5-b1a1-4617-ac77-f0f5ed5e0a5a None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:08.874352 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0581baa5-b1a1-4617-ac77-f0f5ed5e0a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:08.907857 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-0581baa5-b1a1-4617-ac77-f0f5ed5e0a5a None None] MFA Rules not processed for user `f3c8ddc5d26a4263ae441f3f950d387f`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:08.909092 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0581baa5-b1a1-4617-ac77-f0f5ed5e0a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:08.990244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1352/2679] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:32:09.000365 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87445156-c871-467a-a02a-40bf8958db3e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:09.045436 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:09.096166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87445156-c871-467a-a02a-40bf8958db3e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:09.104237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e38d6d-6305-436e-ad53-171e0724d33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:09.105310 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e38d6d-6305-436e-ad53-171e0724d33e admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:09.105796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e38d6d-6305-436e-ad53-171e0724d33e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:09.106287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e38d6d-6305-436e-ad53-171e0724d33e admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:09.107615 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e38d6d-6305-436e-ad53-171e0724d33e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:09.111445 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e38d6d-6305-436e-ad53-171e0724d33e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:09.159605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1328/2680] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:32:08 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:32:09.167992 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581baa5-b1a1-4617-ac77-f0f5ed5e0a5a None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:09.180010 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0581baa5-b1a1-4617-ac77-f0f5ed5e0a5a None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:09.253647 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee84657-c7fc-441f-ad81-a0fbef8ac079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:09.254184 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee84657-c7fc-441f-ad81-a0fbef8ac079 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:09.254461 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee84657-c7fc-441f-ad81-a0fbef8ac079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:09.254765 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee84657-c7fc-441f-ad81-a0fbef8ac079 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:09.255430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee84657-c7fc-441f-ad81-a0fbef8ac079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:09.260272 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee84657-c7fc-441f-ad81-a0fbef8ac079 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:09.310545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1353/2681] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:32:09 2022] POST /identity/v3/users => generated 297 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:32:09.311730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e38d6d-6305-436e-ad53-171e0724d33e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:09.323106 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e38d6d-6305-436e-ad53-171e0724d33e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:09.328593 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630c675-5400-48f8-a03c-f9ab638a36ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:09.329282 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630c675-5400-48f8-a03c-f9ab638a36ba admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:09.329563 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630c675-5400-48f8-a03c-f9ab638a36ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:09.329834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2630c675-5400-48f8-a03c-f9ab638a36ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:09.330547 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630c675-5400-48f8-a03c-f9ab638a36ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:09.338146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2630c675-5400-48f8-a03c-f9ab638a36ba admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:09.354626 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1329/2682] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:32:09.358640 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee84657-c7fc-441f-ad81-a0fbef8ac079 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:09.377214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee84657-c7fc-441f-ad81-a0fbef8ac079 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:09.386782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9e01a-9f90-4ca2-9098-6e6a4d15231a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:09.387925 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9e01a-9f90-4ca2-9098-6e6a4d15231a admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:09.388405 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9e01a-9f90-4ca2-9098-6e6a4d15231a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:09.388894 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9e01a-9f90-4ca2-9098-6e6a4d15231a admin admin] PATH_INFO: `/v3/projects/441b696599f649cb92fbaf14acbe0a7e/users/ab2f80da2655424489b17c756349d2e0/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:09.412877 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:09.423615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9e01a-9f90-4ca2-9098-6e6a4d15231a admin admin] RBAC: Authorizing `identity:create_grant(project_id=441b696599f649cb92fbaf14acbe0a7e, user_id=ab2f80da2655424489b17c756349d2e0, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:09.427225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9e01a-9f90-4ca2-9098-6e6a4d15231a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:09.446092 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1354/2683] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:32:09 2022] PUT /identity/v3/projects/441b696599f649cb92fbaf14acbe0a7e/users/ab2f80da2655424489b17c756349d2e0/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:09.450689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630c675-5400-48f8-a03c-f9ab638a36ba admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:09.463210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2630c675-5400-48f8-a03c-f9ab638a36ba admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:09.553529 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b48759-1b68-4247-a324-99783aa940de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:09.554195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b48759-1b68-4247-a324-99783aa940de admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:09.554691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b48759-1b68-4247-a324-99783aa940de admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:09.555162 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b48759-1b68-4247-a324-99783aa940de admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:09.555915 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b48759-1b68-4247-a324-99783aa940de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:09.557607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b48759-1b68-4247-a324-99783aa940de admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:09.570754 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1330/2684] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:32:09.574685 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9e01a-9f90-4ca2-9098-6e6a4d15231a admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:09.586613 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9e01a-9f90-4ca2-9098-6e6a4d15231a admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:09.592249 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809006bd-5437-49a8-9a43-5cb962e8b73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:09.593016 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809006bd-5437-49a8-9a43-5cb962e8b73e admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:09.593966 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809006bd-5437-49a8-9a43-5cb962e8b73e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:09.594258 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809006bd-5437-49a8-9a43-5cb962e8b73e admin admin] PATH_INFO: `/v3/projects/441b696599f649cb92fbaf14acbe0a7e/users/ab2f80da2655424489b17c756349d2e0/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:09.596440 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809006bd-5437-49a8-9a43-5cb962e8b73e admin admin] RBAC: Authorizing `identity:create_grant(project_id=441b696599f649cb92fbaf14acbe0a7e, user_id=ab2f80da2655424489b17c756349d2e0, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:09.599140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809006bd-5437-49a8-9a43-5cb962e8b73e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:09.612483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1355/2685] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:32:09 2022] PUT /identity/v3/projects/441b696599f649cb92fbaf14acbe0a7e/users/ab2f80da2655424489b17c756349d2e0/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:09.622527 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751c407-2849-4be9-9efb-ea06617c9267 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:09.622884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751c407-2849-4be9-9efb-ea06617c9267 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:09.623153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e751c407-2849-4be9-9efb-ea06617c9267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:09.653119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-e751c407-2849-4be9-9efb-ea06617c9267 None None] MFA Rules not processed for user `ab2f80da2655424489b17c756349d2e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:09.654474 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e751c407-2849-4be9-9efb-ea06617c9267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:09.738425 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1331/2686] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:09.746164 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809006bd-5437-49a8-9a43-5cb962e8b73e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:09.748349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-809006bd-5437-49a8-9a43-5cb962e8b73e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:09.822074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809006bd-5437-49a8-9a43-5cb962e8b73e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:09.826013 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e53d6-6d4e-4106-ac1e-490f63ca2665 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:09.826692 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e53d6-6d4e-4106-ac1e-490f63ca2665 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:09.826976 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e53d6-6d4e-4106-ac1e-490f63ca2665 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:09.827251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810e53d6-6d4e-4106-ac1e-490f63ca2665 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:09.837156 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e53d6-6d4e-4106-ac1e-490f63ca2665 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:09.838645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810e53d6-6d4e-4106-ac1e-490f63ca2665 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:09.848904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1356/2687] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:32:09.946133 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08a5e8-45a9-4dae-91c7-e907623462a9 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:09.946496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08a5e8-45a9-4dae-91c7-e907623462a9 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:09.946878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08a5e8-45a9-4dae-91c7-e907623462a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:09.969208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-aa08a5e8-45a9-4dae-91c7-e907623462a9 None None] MFA Rules not processed for user `4af695bcf038421b9c7e58b09ce4d6ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:09.970707 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-aa08a5e8-45a9-4dae-91c7-e907623462a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:10.002489 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:10.038389 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1332/2688] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:10.291003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e53d6-6d4e-4106-ac1e-490f63ca2665 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:10.360077 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810e53d6-6d4e-4106-ac1e-490f63ca2665 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:10.364819 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fb3b6-2556-4a81-82b1-cde3eb70c575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:10.365477 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fb3b6-2556-4a81-82b1-cde3eb70c575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:10.365754 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fb3b6-2556-4a81-82b1-cde3eb70c575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:10.366024 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4fb3b6-2556-4a81-82b1-cde3eb70c575 admin admin] PATH_INFO: `/v3/users/f3c8ddc5d26a4263ae441f3f950d387f` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:10.367279 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fb3b6-2556-4a81-82b1-cde3eb70c575 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3c8ddc5d26a4263ae441f3f950d387f)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:10.369250 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4fb3b6-2556-4a81-82b1-cde3eb70c575 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:10.420821 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-bc4fb3b6-2556-4a81-82b1-cde3eb70c575 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3c8ddc5d26a4263ae441f3f950d387f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:10.436326 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-bc4fb3b6-2556-4a81-82b1-cde3eb70c575 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3c8ddc5d26a4263ae441f3f950d387f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:10.446936 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-bc4fb3b6-2556-4a81-82b1-cde3eb70c575 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3c8ddc5d26a4263ae441f3f950d387f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:10.447686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-bc4fb3b6-2556-4a81-82b1-cde3eb70c575 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3c8ddc5d26a4263ae441f3f950d387f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:10.456472 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-bc4fb3b6-2556-4a81-82b1-cde3eb70c575 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3c8ddc5d26a4263ae441f3f950d387f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:10.459576 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:10.464749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1357/2689] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:32:10 2022] DELETE /identity/v3/users/f3c8ddc5d26a4263ae441f3f950d387f => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:10.469720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7edae1-5ef9-40ea-87c2-96f31022e08f None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:10.470268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7edae1-5ef9-40ea-87c2-96f31022e08f None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:10.470624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7edae1-5ef9-40ea-87c2-96f31022e08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:10.496948 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-cc7edae1-5ef9-40ea-87c2-96f31022e08f None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:10.498537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cc7edae1-5ef9-40ea-87c2-96f31022e08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:10.577973 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1333/2690] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:10.592874 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fb3b6-2556-4a81-82b1-cde3eb70c575 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:10.594500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bc4fb3b6-2556-4a81-82b1-cde3eb70c575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:10.684990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4fb3b6-2556-4a81-82b1-cde3eb70c575 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:10.690743 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe6460-5d43-43dd-b8d7-9da0a2baf822 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:10.691392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe6460-5d43-43dd-b8d7-9da0a2baf822 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:10.691757 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe6460-5d43-43dd-b8d7-9da0a2baf822 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:10.692035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefe6460-5d43-43dd-b8d7-9da0a2baf822 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:10.707199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe6460-5d43-43dd-b8d7-9da0a2baf822 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:10.708846 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eefe6460-5d43-43dd-b8d7-9da0a2baf822 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:10.738856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1358/2691] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:11.084807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7edae1-5ef9-40ea-87c2-96f31022e08f None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:11.086713 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-cc7edae1-5ef9-40ea-87c2-96f31022e08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:11.101704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7edae1-5ef9-40ea-87c2-96f31022e08f None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:11.107458 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0107f-0500-4104-a6da-b00ecc865585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:11.108281 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0107f-0500-4104-a6da-b00ecc865585 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:11.114413 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0107f-0500-4104-a6da-b00ecc865585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:11.114791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba0107f-0500-4104-a6da-b00ecc865585 admin admin] PATH_INFO: `/v3/projects/f9ed2117586a4e5da51baea977237096` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:11.116653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0107f-0500-4104-a6da-b00ecc865585 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9ed2117586a4e5da51baea977237096)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:11.119026 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba0107f-0500-4104-a6da-b00ecc865585 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:11.179125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7ba0107f-0500-4104-a6da-b00ecc865585 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9ed2117586a4e5da51baea977237096', 'request_id': 'req-7ba0107f-0500-4104-a6da-b00ecc865585'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:11.185045 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7ba0107f-0500-4104-a6da-b00ecc865585 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9ed2117586a4e5da51baea977237096', 'request_id': 'req-7ba0107f-0500-4104-a6da-b00ecc865585'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:11.195263 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7ba0107f-0500-4104-a6da-b00ecc865585 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9ed2117586a4e5da51baea977237096', 'request_id': 'req-7ba0107f-0500-4104-a6da-b00ecc865585'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:11.207103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7ba0107f-0500-4104-a6da-b00ecc865585 admin admin] The token cache is being invalidate because project f9ed2117586a4e5da51baea977237096 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:32:11.207396 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7ba0107f-0500-4104-a6da-b00ecc865585 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:11.208062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-7ba0107f-0500-4104-a6da-b00ecc865585 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:11.209577 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1334/2692] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:32:11 2022] DELETE /identity/v3/projects/f9ed2117586a4e5da51baea977237096 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:11.213890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe6460-5d43-43dd-b8d7-9da0a2baf822 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:11.224208 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefe6460-5d43-43dd-b8d7-9da0a2baf822 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:11.282020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b41498b-5a89-4d05-92c9-23466779a462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:11.282714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41498b-5a89-4d05-92c9-23466779a462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:11.283000 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41498b-5a89-4d05-92c9-23466779a462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:11.283320 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b41498b-5a89-4d05-92c9-23466779a462 admin admin] PATH_INFO: `/v3/users/ab2f80da2655424489b17c756349d2e0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:11.284467 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41498b-5a89-4d05-92c9-23466779a462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab2f80da2655424489b17c756349d2e0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:11.286375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b41498b-5a89-4d05-92c9-23466779a462 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:11.332970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5b41498b-5a89-4d05-92c9-23466779a462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab2f80da2655424489b17c756349d2e0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:11.344947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5b41498b-5a89-4d05-92c9-23466779a462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab2f80da2655424489b17c756349d2e0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:11.351806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5b41498b-5a89-4d05-92c9-23466779a462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab2f80da2655424489b17c756349d2e0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:11.352475 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5b41498b-5a89-4d05-92c9-23466779a462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab2f80da2655424489b17c756349d2e0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:11.360317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-5b41498b-5a89-4d05-92c9-23466779a462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab2f80da2655424489b17c756349d2e0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:11.366438 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1359/2693] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:32:11 2022] DELETE /identity/v3/users/ab2f80da2655424489b17c756349d2e0 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:11.636664 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0107f-0500-4104-a6da-b00ecc865585 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:11.638209 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7ba0107f-0500-4104-a6da-b00ecc865585 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:11.652695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba0107f-0500-4104-a6da-b00ecc865585 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:11.702435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:11.712730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68615bbc-a902-4c4c-a39a-728ebf26345d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:11.713380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68615bbc-a902-4c4c-a39a-728ebf26345d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:11.713809 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68615bbc-a902-4c4c-a39a-728ebf26345d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:11.714817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68615bbc-a902-4c4c-a39a-728ebf26345d admin admin] PATH_INFO: `/v3/projects/441b696599f649cb92fbaf14acbe0a7e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:11.716165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68615bbc-a902-4c4c-a39a-728ebf26345d admin admin] RBAC: Authorizing `identity:delete_project(project_id=441b696599f649cb92fbaf14acbe0a7e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:11.718199 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68615bbc-a902-4c4c-a39a-728ebf26345d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:11.765656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-68615bbc-a902-4c4c-a39a-728ebf26345d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '441b696599f649cb92fbaf14acbe0a7e', 'request_id': 'req-68615bbc-a902-4c4c-a39a-728ebf26345d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:11.771062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-68615bbc-a902-4c4c-a39a-728ebf26345d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '441b696599f649cb92fbaf14acbe0a7e', 'request_id': 'req-68615bbc-a902-4c4c-a39a-728ebf26345d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:11.779178 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-68615bbc-a902-4c4c-a39a-728ebf26345d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '441b696599f649cb92fbaf14acbe0a7e', 'request_id': 'req-68615bbc-a902-4c4c-a39a-728ebf26345d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:11.791408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-68615bbc-a902-4c4c-a39a-728ebf26345d admin admin] The token cache is being invalidate because project 441b696599f649cb92fbaf14acbe0a7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:32:11.791702 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-68615bbc-a902-4c4c-a39a-728ebf26345d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:11.792437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-68615bbc-a902-4c4c-a39a-728ebf26345d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:11.795192 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1335/2694] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:32:11 2022] DELETE /identity/v3/projects/441b696599f649cb92fbaf14acbe0a7e => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:11.799358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e8046-0a39-4fbf-b161-01de68587935 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:11.799853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e8046-0a39-4fbf-b161-01de68587935 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:11.800229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490e8046-0a39-4fbf-b161-01de68587935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:11.821070 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-490e8046-0a39-4fbf-b161-01de68587935 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:11.822274 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-490e8046-0a39-4fbf-b161-01de68587935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:11.839890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:11.889448 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1360/2695] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:11.897219 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238af76-659a-40a8-9f14-2c223c17fb18 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:11.897585 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238af76-659a-40a8-9f14-2c223c17fb18 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:11.897864 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1238af76-659a-40a8-9f14-2c223c17fb18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:11.918510 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1238af76-659a-40a8-9f14-2c223c17fb18 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:11.919691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1238af76-659a-40a8-9f14-2c223c17fb18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:11.929000 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1336/2696] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:11.933338 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e8046-0a39-4fbf-b161-01de68587935 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:11.943225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490e8046-0a39-4fbf-b161-01de68587935 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:11.948056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d2061-3735-423a-97fe-1b4719bcaee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:11.948668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d2061-3735-423a-97fe-1b4719bcaee6 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:11.948949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d2061-3735-423a-97fe-1b4719bcaee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:11.949225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d2061-3735-423a-97fe-1b4719bcaee6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:11.949947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d2061-3735-423a-97fe-1b4719bcaee6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:32:11.950246 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d2061-3735-423a-97fe-1b4719bcaee6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:11.951864 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d2061-3735-423a-97fe-1b4719bcaee6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:11.964127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1361/2697] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:32:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:32:11.969062 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238af76-659a-40a8-9f14-2c223c17fb18 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:11.978500 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1238af76-659a-40a8-9f14-2c223c17fb18 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:11.983641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9394c-03f8-4ce4-a03b-9f93e6e85ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:11.984410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9394c-03f8-4ce4-a03b-9f93e6e85ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:11.984607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9394c-03f8-4ce4-a03b-9f93e6e85ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:11.984864 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d9394c-03f8-4ce4-a03b-9f93e6e85ea7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:11.985800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9394c-03f8-4ce4-a03b-9f93e6e85ea7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:11.988171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d9394c-03f8-4ce4-a03b-9f93e6e85ea7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:12.038789 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1337/2698] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:32:11 2022] POST /identity/v3/projects => generated 383 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:32:12.039957 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d2061-3735-423a-97fe-1b4719bcaee6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:12.051749 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d2061-3735-423a-97fe-1b4719bcaee6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:12.119522 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2200-eece-410d-9e09-1adfa77d83f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:12.120287 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2200-eece-410d-9e09-1adfa77d83f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:12.120573 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2200-eece-410d-9e09-1adfa77d83f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:12.120849 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b2200-eece-410d-9e09-1adfa77d83f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:12.121546 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b2200-eece-410d-9e09-1adfa77d83f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:12.123537 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05b2200-eece-410d-9e09-1adfa77d83f4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:12.154320 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1362/2699] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:32:12 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:32:12.155668 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9394c-03f8-4ce4-a03b-9f93e6e85ea7 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:12.167507 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d9394c-03f8-4ce4-a03b-9f93e6e85ea7 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:12.173527 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd9a73-66d6-4e64-98b6-4f8a077bbfc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:12.174268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd9a73-66d6-4e64-98b6-4f8a077bbfc4 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:12.174548 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd9a73-66d6-4e64-98b6-4f8a077bbfc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:12.174863 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd9a73-66d6-4e64-98b6-4f8a077bbfc4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:12.175566 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd9a73-66d6-4e64-98b6-4f8a077bbfc4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:12.177418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd9a73-66d6-4e64-98b6-4f8a077bbfc4 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:12.191734 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1338/2700] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:32:12.195934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2200-eece-410d-9e09-1adfa77d83f4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:12.209269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b2200-eece-410d-9e09-1adfa77d83f4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:12.214442 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87f847c-21bf-4142-8ae8-9cac32cf828f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:12.215121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f847c-21bf-4142-8ae8-9cac32cf828f admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:12.215360 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f847c-21bf-4142-8ae8-9cac32cf828f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:12.215655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87f847c-21bf-4142-8ae8-9cac32cf828f admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:12.216344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f847c-21bf-4142-8ae8-9cac32cf828f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:12.218206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87f847c-21bf-4142-8ae8-9cac32cf828f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:12.229457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1363/2701] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:32:12.233875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd9a73-66d6-4e64-98b6-4f8a077bbfc4 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:12.244827 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd9a73-66d6-4e64-98b6-4f8a077bbfc4 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:12.249553 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89f01a-fcf5-4009-8166-e6560600e0c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:12.250858 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89f01a-fcf5-4009-8166-e6560600e0c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:12.251140 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89f01a-fcf5-4009-8166-e6560600e0c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:12.251417 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e89f01a-fcf5-4009-8166-e6560600e0c1 admin admin] PATH_INFO: `/v3/projects/fa12477f71d34ae5aa120e3dc73ceb2a/users/d769b7af71e64ee29f274c320f6776c1/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:12.266271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89f01a-fcf5-4009-8166-e6560600e0c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa12477f71d34ae5aa120e3dc73ceb2a, user_id=d769b7af71e64ee29f274c320f6776c1, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:12.268999 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e89f01a-fcf5-4009-8166-e6560600e0c1 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:12.282534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1339/2702] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:32:12 2022] PUT /identity/v3/projects/fa12477f71d34ae5aa120e3dc73ceb2a/users/d769b7af71e64ee29f274c320f6776c1/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:32:12.351792 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8a189-fa32-4b76-9ecc-26702e1dc5f6 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:12.352074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8a189-fa32-4b76-9ecc-26702e1dc5f6 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:12.352350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d8a189-fa32-4b76-9ecc-26702e1dc5f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:12.380437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b9d8a189-fa32-4b76-9ecc-26702e1dc5f6 None None] MFA Rules not processed for user `d769b7af71e64ee29f274c320f6776c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:12.381990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b9d8a189-fa32-4b76-9ecc-26702e1dc5f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:12.448953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1364/2703] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:12 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:12.457114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89f01a-fcf5-4009-8166-e6560600e0c1 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:12.529699 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e89f01a-fcf5-4009-8166-e6560600e0c1 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:12.535142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e177c-f445-4371-89f8-99a673adc05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:12.535767 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e177c-f445-4371-89f8-99a673adc05d admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:12.536050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e177c-f445-4371-89f8-99a673adc05d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:12.536325 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249e177c-f445-4371-89f8-99a673adc05d admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:12.536998 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e177c-f445-4371-89f8-99a673adc05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:12.538968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249e177c-f445-4371-89f8-99a673adc05d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:12.554827 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:12.572582 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1340/2704] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:32:12 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:32:12.573781 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8a189-fa32-4b76-9ecc-26702e1dc5f6 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:12.584708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d8a189-fa32-4b76-9ecc-26702e1dc5f6 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:12.598142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:12.642685 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e098101-6a7d-4611-91c2-7bb4dc1a7388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:12.643570 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e098101-6a7d-4611-91c2-7bb4dc1a7388 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:12.643854 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e098101-6a7d-4611-91c2-7bb4dc1a7388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:12.644132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e098101-6a7d-4611-91c2-7bb4dc1a7388 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:12.644819 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e098101-6a7d-4611-91c2-7bb4dc1a7388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:12.646811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e098101-6a7d-4611-91c2-7bb4dc1a7388 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:12.668112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1365/2705] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:32:12 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:32:12.673006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e177c-f445-4371-89f8-99a673adc05d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:12.685492 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249e177c-f445-4371-89f8-99a673adc05d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:12.691586 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e45d8-da60-4d21-8473-44365bac9086 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:12.692340 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e45d8-da60-4d21-8473-44365bac9086 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:12.692626 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e45d8-da60-4d21-8473-44365bac9086 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:12.692902 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e45d8-da60-4d21-8473-44365bac9086 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:12.693862 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e45d8-da60-4d21-8473-44365bac9086 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:12.695505 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e45d8-da60-4d21-8473-44365bac9086 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:12.709137 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1341/2706] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:32:12.713297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e098101-6a7d-4611-91c2-7bb4dc1a7388 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:12.725526 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e098101-6a7d-4611-91c2-7bb4dc1a7388 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:12.732525 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc9ccb-12d2-4482-8175-c1e643338556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:12.732920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc9ccb-12d2-4482-8175-c1e643338556 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:12.733202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc9ccb-12d2-4482-8175-c1e643338556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:12.733503 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facc9ccb-12d2-4482-8175-c1e643338556 admin admin] PATH_INFO: `/v3/projects/61c8281a790f431ea4b78b754bd3076d/users/83a7c34e30f844ecb13d79f0008facc0/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:12.752937 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc9ccb-12d2-4482-8175-c1e643338556 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c8281a790f431ea4b78b754bd3076d, user_id=83a7c34e30f844ecb13d79f0008facc0, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:12.756036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facc9ccb-12d2-4482-8175-c1e643338556 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:12.772695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1366/2707] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:32:12 2022] PUT /identity/v3/projects/61c8281a790f431ea4b78b754bd3076d/users/83a7c34e30f844ecb13d79f0008facc0/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:12.776811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e45d8-da60-4d21-8473-44365bac9086 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:12.788634 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e45d8-da60-4d21-8473-44365bac9086 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:12.855295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a647d9-986e-4b01-b9e7-e3bec72add86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:12.856360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a647d9-986e-4b01-b9e7-e3bec72add86 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:12.856824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a647d9-986e-4b01-b9e7-e3bec72add86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:12.857408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a647d9-986e-4b01-b9e7-e3bec72add86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:12.858523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a647d9-986e-4b01-b9e7-e3bec72add86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:12.861530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a647d9-986e-4b01-b9e7-e3bec72add86 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:12.873900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1342/2708] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:12 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:32:12.879138 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc9ccb-12d2-4482-8175-c1e643338556 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:12.897077 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facc9ccb-12d2-4482-8175-c1e643338556 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:12.915219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e909697-7f7e-41d0-a59f-c5fec39317cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:12.916060 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e909697-7f7e-41d0-a59f-c5fec39317cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:12.916450 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e909697-7f7e-41d0-a59f-c5fec39317cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:12.917302 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e909697-7f7e-41d0-a59f-c5fec39317cf admin admin] PATH_INFO: `/v3/projects/61c8281a790f431ea4b78b754bd3076d/users/83a7c34e30f844ecb13d79f0008facc0/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:12.922677 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e909697-7f7e-41d0-a59f-c5fec39317cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=61c8281a790f431ea4b78b754bd3076d, user_id=83a7c34e30f844ecb13d79f0008facc0, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:12.925786 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e909697-7f7e-41d0-a59f-c5fec39317cf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:12.959020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1367/2709] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:32:12 2022] PUT /identity/v3/projects/61c8281a790f431ea4b78b754bd3076d/users/83a7c34e30f844ecb13d79f0008facc0/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:12.960996 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c67c2-3082-4fea-ac4b-b3869937bc26 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:12.961217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c67c2-3082-4fea-ac4b-b3869937bc26 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:12.961494 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c67c2-3082-4fea-ac4b-b3869937bc26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:12.995250 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a63c67c2-3082-4fea-ac4b-b3869937bc26 None None] MFA Rules not processed for user `83a7c34e30f844ecb13d79f0008facc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:12.996505 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a63c67c2-3082-4fea-ac4b-b3869937bc26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:13.094269 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1343/2710] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:12 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:13.105841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e909697-7f7e-41d0-a59f-c5fec39317cf admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:13.107979 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6e909697-7f7e-41d0-a59f-c5fec39317cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:13.170861 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cb14c-6e70-4c51-9670-fb1e40c16bb0 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:13.171608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cb14c-6e70-4c51-9670-fb1e40c16bb0 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:13.172393 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095cb14c-6e70-4c51-9670-fb1e40c16bb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:13.190283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e909697-7f7e-41d0-a59f-c5fec39317cf admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:13.194652 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-095cb14c-6e70-4c51-9670-fb1e40c16bb0 None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:13.194922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5df4a-21d0-4db7-bc70-d03943e7bf21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:13.195525 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5df4a-21d0-4db7-bc70-d03943e7bf21 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:13.195876 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5df4a-21d0-4db7-bc70-d03943e7bf21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:13.196230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b5df4a-21d0-4db7-bc70-d03943e7bf21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:13.196986 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-095cb14c-6e70-4c51-9670-fb1e40c16bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:13.278180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1344/2711] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 1 14:32:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:13.293187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cb14c-6e70-4c51-9670-fb1e40c16bb0 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:13.294066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5df4a-21d0-4db7-bc70-d03943e7bf21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:13.295059 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-095cb14c-6e70-4c51-9670-fb1e40c16bb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:13.295758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b5df4a-21d0-4db7-bc70-d03943e7bf21 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:13.310524 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=100 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:13.327114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1368/2712] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:13 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:13.385687 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095cb14c-6e70-4c51-9670-fb1e40c16bb0 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:13.394644 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a081d-0c26-423f-898e-4e2c717d9490 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:13.395956 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a081d-0c26-423f-898e-4e2c717d9490 service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:13.396305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a081d-0c26-423f-898e-4e2c717d9490 service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:13.396643 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4a081d-0c26-423f-898e-4e2c717d9490 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:13.408243 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a081d-0c26-423f-898e-4e2c717d9490 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:13.410491 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4a081d-0c26-423f-898e-4e2c717d9490 service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:13.421243 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1345/2713] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:32:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:32:17.037705 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5df4a-21d0-4db7-bc70-d03943e7bf21 service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:17.039715 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-12b5df4a-21d0-4db7-bc70-d03943e7bf21 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:17.095718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:17.146065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b5df4a-21d0-4db7-bc70-d03943e7bf21 service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:17.151334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4aaac-3127-4939-b424-d4d5a351982e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:17.151987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4aaac-3127-4939-b424-d4d5a351982e service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:17.152322 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4aaac-3127-4939-b424-d4d5a351982e service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:17.152658 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a4aaac-3127-4939-b424-d4d5a351982e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:17.157505 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-41a4aaac-3127-4939-b424-d4d5a351982e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:17.293545 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4aaac-3127-4939-b424-d4d5a351982e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:17.301843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a4aaac-3127-4939-b424-d4d5a351982e service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:17.314425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1369/2714] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:18.452371 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a081d-0c26-423f-898e-4e2c717d9490 service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:18.454148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3e4a081d-0c26-423f-898e-4e2c717d9490 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:18.467872 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4a081d-0c26-423f-898e-4e2c717d9490 service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:18.475451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dab218-19e9-4296-94fa-7a5f02e07877 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:18.476335 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dab218-19e9-4296-94fa-7a5f02e07877 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:18.476621 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dab218-19e9-4296-94fa-7a5f02e07877 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:18.476897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dab218-19e9-4296-94fa-7a5f02e07877 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:18.488742 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dab218-19e9-4296-94fa-7a5f02e07877 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:18.490203 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4dab218-19e9-4296-94fa-7a5f02e07877 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:18.524669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1346/2715] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:18 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:23.567179 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4aaac-3127-4939-b424-d4d5a351982e service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:23.628850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a4aaac-3127-4939-b424-d4d5a351982e service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:23.633412 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c23c7-5cf6-4627-9da6-f547f9c0d3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:23.634041 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c23c7-5cf6-4627-9da6-f547f9c0d3d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:23.634322 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c23c7-5cf6-4627-9da6-f547f9c0d3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:23.634620 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c23c7-5cf6-4627-9da6-f547f9c0d3d7 admin admin] PATH_INFO: `/v3/users/d769b7af71e64ee29f274c320f6776c1` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:23.635782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c23c7-5cf6-4627-9da6-f547f9c0d3d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d769b7af71e64ee29f274c320f6776c1)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:23.637696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c23c7-5cf6-4627-9da6-f547f9c0d3d7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:23.685293 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-743c23c7-5cf6-4627-9da6-f547f9c0d3d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd769b7af71e64ee29f274c320f6776c1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:23.699410 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-743c23c7-5cf6-4627-9da6-f547f9c0d3d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd769b7af71e64ee29f274c320f6776c1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:23.702280 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:23.710457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-743c23c7-5cf6-4627-9da6-f547f9c0d3d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd769b7af71e64ee29f274c320f6776c1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:23.711584 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-743c23c7-5cf6-4627-9da6-f547f9c0d3d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd769b7af71e64ee29f274c320f6776c1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:23.720217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-743c23c7-5cf6-4627-9da6-f547f9c0d3d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd769b7af71e64ee29f274c320f6776c1'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:23.726259 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1370/2716] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:32:23 2022] DELETE /identity/v3/users/d769b7af71e64ee29f274c320f6776c1 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:23.730782 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01868d6-6435-43e4-a377-ec6c5d3f1e42 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:23.731292 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01868d6-6435-43e4-a377-ec6c5d3f1e42 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:23.731401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01868d6-6435-43e4-a377-ec6c5d3f1e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:23.750729 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a01868d6-6435-43e4-a377-ec6c5d3f1e42 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:23.751977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a01868d6-6435-43e4-a377-ec6c5d3f1e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:23.816189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1347/2717] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:23.826075 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c23c7-5cf6-4627-9da6-f547f9c0d3d7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:23.827494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-743c23c7-5cf6-4627-9da6-f547f9c0d3d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:23.884572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c23c7-5cf6-4627-9da6-f547f9c0d3d7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:23.888281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a95885-4ebe-4d2c-8a03-93aa39f9e869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:23.888895 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a95885-4ebe-4d2c-8a03-93aa39f9e869 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:23.889176 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a95885-4ebe-4d2c-8a03-93aa39f9e869 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:23.889454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a95885-4ebe-4d2c-8a03-93aa39f9e869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:23.898515 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a95885-4ebe-4d2c-8a03-93aa39f9e869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:23.900011 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a95885-4ebe-4d2c-8a03-93aa39f9e869 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:23.910197 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1371/2718] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:24.180884 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01868d6-6435-43e4-a377-ec6c5d3f1e42 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:24.183743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a01868d6-6435-43e4-a377-ec6c5d3f1e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:24.210603 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a01868d6-6435-43e4-a377-ec6c5d3f1e42 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:24.215590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09948a9-3e51-4d62-bfdc-466b92c0fe12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:24.216253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09948a9-3e51-4d62-bfdc-466b92c0fe12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:24.216532 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09948a9-3e51-4d62-bfdc-466b92c0fe12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:24.216806 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09948a9-3e51-4d62-bfdc-466b92c0fe12 admin admin] PATH_INFO: `/v3/projects/fa12477f71d34ae5aa120e3dc73ceb2a` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:24.218008 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09948a9-3e51-4d62-bfdc-466b92c0fe12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa12477f71d34ae5aa120e3dc73ceb2a)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:24.221377 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09948a9-3e51-4d62-bfdc-466b92c0fe12 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:24.281582 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d09948a9-3e51-4d62-bfdc-466b92c0fe12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa12477f71d34ae5aa120e3dc73ceb2a', 'request_id': 'req-d09948a9-3e51-4d62-bfdc-466b92c0fe12'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:24.287610 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d09948a9-3e51-4d62-bfdc-466b92c0fe12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa12477f71d34ae5aa120e3dc73ceb2a', 'request_id': 'req-d09948a9-3e51-4d62-bfdc-466b92c0fe12'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:24.296159 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d09948a9-3e51-4d62-bfdc-466b92c0fe12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa12477f71d34ae5aa120e3dc73ceb2a', 'request_id': 'req-d09948a9-3e51-4d62-bfdc-466b92c0fe12'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:24.308364 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d09948a9-3e51-4d62-bfdc-466b92c0fe12 admin admin] The token cache is being invalidate because project fa12477f71d34ae5aa120e3dc73ceb2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:32:24.308653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d09948a9-3e51-4d62-bfdc-466b92c0fe12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:24.309289 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-d09948a9-3e51-4d62-bfdc-466b92c0fe12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:24.310862 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1348/2719] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:32:24 2022] DELETE /identity/v3/projects/fa12477f71d34ae5aa120e3dc73ceb2a => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:24.315471 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a95885-4ebe-4d2c-8a03-93aa39f9e869 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:24.325366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a95885-4ebe-4d2c-8a03-93aa39f9e869 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:24.393293 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb494129-afc2-4b4b-8403-3fd801c61642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:24.393947 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb494129-afc2-4b4b-8403-3fd801c61642 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:24.394227 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb494129-afc2-4b4b-8403-3fd801c61642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:24.394504 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb494129-afc2-4b4b-8403-3fd801c61642 admin admin] PATH_INFO: `/v3/users/83a7c34e30f844ecb13d79f0008facc0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:24.395771 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb494129-afc2-4b4b-8403-3fd801c61642 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83a7c34e30f844ecb13d79f0008facc0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:24.397760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb494129-afc2-4b4b-8403-3fd801c61642 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:24.446860 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eb494129-afc2-4b4b-8403-3fd801c61642 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83a7c34e30f844ecb13d79f0008facc0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:24.459375 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eb494129-afc2-4b4b-8403-3fd801c61642 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83a7c34e30f844ecb13d79f0008facc0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:24.466365 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eb494129-afc2-4b4b-8403-3fd801c61642 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83a7c34e30f844ecb13d79f0008facc0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:24.467139 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eb494129-afc2-4b4b-8403-3fd801c61642 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83a7c34e30f844ecb13d79f0008facc0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:24.474603 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-eb494129-afc2-4b4b-8403-3fd801c61642 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83a7c34e30f844ecb13d79f0008facc0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:24.482158 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1372/2720] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:32:24 2022] DELETE /identity/v3/users/83a7c34e30f844ecb13d79f0008facc0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:24.791673 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09948a9-3e51-4d62-bfdc-466b92c0fe12 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:24.793149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d09948a9-3e51-4d62-bfdc-466b92c0fe12 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:24.817361 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09948a9-3e51-4d62-bfdc-466b92c0fe12 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:24.829023 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:24.885320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a47d353-13c8-445f-8bad-a384f1b4c191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:24.886078 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47d353-13c8-445f-8bad-a384f1b4c191 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:24.886409 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47d353-13c8-445f-8bad-a384f1b4c191 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:24.886785 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a47d353-13c8-445f-8bad-a384f1b4c191 admin admin] PATH_INFO: `/v3/projects/61c8281a790f431ea4b78b754bd3076d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:24.888012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47d353-13c8-445f-8bad-a384f1b4c191 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61c8281a790f431ea4b78b754bd3076d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:24.890043 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a47d353-13c8-445f-8bad-a384f1b4c191 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:24.944274 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6a47d353-13c8-445f-8bad-a384f1b4c191 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61c8281a790f431ea4b78b754bd3076d', 'request_id': 'req-6a47d353-13c8-445f-8bad-a384f1b4c191'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:24.951358 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6a47d353-13c8-445f-8bad-a384f1b4c191 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61c8281a790f431ea4b78b754bd3076d', 'request_id': 'req-6a47d353-13c8-445f-8bad-a384f1b4c191'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:24.962675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6a47d353-13c8-445f-8bad-a384f1b4c191 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61c8281a790f431ea4b78b754bd3076d', 'request_id': 'req-6a47d353-13c8-445f-8bad-a384f1b4c191'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:24.983210 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6a47d353-13c8-445f-8bad-a384f1b4c191 admin admin] The token cache is being invalidate because project 61c8281a790f431ea4b78b754bd3076d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:32:24.983654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6a47d353-13c8-445f-8bad-a384f1b4c191 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:24.985991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-6a47d353-13c8-445f-8bad-a384f1b4c191 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:24.992974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1349/2721] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:32:24 2022] DELETE /identity/v3/projects/61c8281a790f431ea4b78b754bd3076d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:24.995219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d979dc-00ee-4cf8-83f9-2c308ec84ff2 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:24.995805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d979dc-00ee-4cf8-83f9-2c308ec84ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:24.995805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d979dc-00ee-4cf8-83f9-2c308ec84ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:25.012824 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:25.020338 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c4d979dc-00ee-4cf8-83f9-2c308ec84ff2 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:25.021582 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c4d979dc-00ee-4cf8-83f9-2c308ec84ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:25.102169 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1373/2722] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:32:25.111101 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f0f15-0ee3-49c9-8cf7-4b272d8454e7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:25.111307 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f0f15-0ee3-49c9-8cf7-4b272d8454e7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:25.111553 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f0f15-0ee3-49c9-8cf7-4b272d8454e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:25.133882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-1d2f0f15-0ee3-49c9-8cf7-4b272d8454e7 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:25.135132 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1d2f0f15-0ee3-49c9-8cf7-4b272d8454e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:25.143363 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1350/2723] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:25.147695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d979dc-00ee-4cf8-83f9-2c308ec84ff2 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:25.160726 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d979dc-00ee-4cf8-83f9-2c308ec84ff2 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:25.165717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1e8da-909f-488c-80b3-f853d84d0a53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:25.166323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1e8da-909f-488c-80b3-f853d84d0a53 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:25.166630 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1e8da-909f-488c-80b3-f853d84d0a53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:25.166909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c1e8da-909f-488c-80b3-f853d84d0a53 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:25.167630 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1e8da-909f-488c-80b3-f853d84d0a53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:32:25.167926 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1e8da-909f-488c-80b3-f853d84d0a53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:25.169505 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c1e8da-909f-488c-80b3-f853d84d0a53 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:25.182637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1374/2724] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:32:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:32:25.187089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f0f15-0ee3-49c9-8cf7-4b272d8454e7 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:25.196756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f0f15-0ee3-49c9-8cf7-4b272d8454e7 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:25.201737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117c077-45c0-47a2-9a2c-b4d5f1489759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:25.202351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117c077-45c0-47a2-9a2c-b4d5f1489759 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:25.202686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117c077-45c0-47a2-9a2c-b4d5f1489759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:25.203021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4117c077-45c0-47a2-9a2c-b4d5f1489759 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:25.203659 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117c077-45c0-47a2-9a2c-b4d5f1489759 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:25.207018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4117c077-45c0-47a2-9a2c-b4d5f1489759 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:25.251304 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1351/2725] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:32:25 2022] POST /identity/v3/projects => generated 385 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:32:25.255517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1e8da-909f-488c-80b3-f853d84d0a53 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:25.269096 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c1e8da-909f-488c-80b3-f853d84d0a53 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:25.356149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69c6a-625a-4929-8786-b495fa0675db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:25.356921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69c6a-625a-4929-8786-b495fa0675db admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:25.357307 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69c6a-625a-4929-8786-b495fa0675db admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:25.357685 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a69c6a-625a-4929-8786-b495fa0675db admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:25.359621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a69c6a-625a-4929-8786-b495fa0675db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:25.362228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a69c6a-625a-4929-8786-b495fa0675db admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:25.406469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1375/2726] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:32:25 2022] POST /identity/v3/users => generated 293 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:32:25.410379 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117c077-45c0-47a2-9a2c-b4d5f1489759 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:25.426291 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4117c077-45c0-47a2-9a2c-b4d5f1489759 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:25.434675 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a779dcc-7051-40f6-8aca-043661a9a98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:25.435280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a779dcc-7051-40f6-8aca-043661a9a98a admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:25.435561 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a779dcc-7051-40f6-8aca-043661a9a98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:25.435835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a779dcc-7051-40f6-8aca-043661a9a98a admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:25.436539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a779dcc-7051-40f6-8aca-043661a9a98a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:25.438362 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a779dcc-7051-40f6-8aca-043661a9a98a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:25.450989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1352/2727] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:32:25.459993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69c6a-625a-4929-8786-b495fa0675db admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:25.471466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a69c6a-625a-4929-8786-b495fa0675db admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:25.477425 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbe8198-c120-450e-a2a4-a03eaafaec3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:25.477806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe8198-c120-450e-a2a4-a03eaafaec3a admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:25.478223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe8198-c120-450e-a2a4-a03eaafaec3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:25.478532 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbe8198-c120-450e-a2a4-a03eaafaec3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:25.479583 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe8198-c120-450e-a2a4-a03eaafaec3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:25.481914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbe8198-c120-450e-a2a4-a03eaafaec3a admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:25.502120 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1376/2728] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:32:25.503824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a779dcc-7051-40f6-8aca-043661a9a98a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:25.525345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a779dcc-7051-40f6-8aca-043661a9a98a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:25.532552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c775f03-66e4-471e-bc4a-ab527bda30fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:25.533943 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c775f03-66e4-471e-bc4a-ab527bda30fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:25.533943 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c775f03-66e4-471e-bc4a-ab527bda30fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:25.534303 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c775f03-66e4-471e-bc4a-ab527bda30fc admin admin] PATH_INFO: `/v3/projects/b507947fa2d14ac09edf632f17a2858c/users/ad48b7e86a4b4ea5b6919ab7faabe5ee/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:25.557598 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c775f03-66e4-471e-bc4a-ab527bda30fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b507947fa2d14ac09edf632f17a2858c, user_id=ad48b7e86a4b4ea5b6919ab7faabe5ee, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:25.560935 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c775f03-66e4-471e-bc4a-ab527bda30fc admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:25.576702 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1353/2729] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:32:25 2022] PUT /identity/v3/projects/b507947fa2d14ac09edf632f17a2858c/users/ad48b7e86a4b4ea5b6919ab7faabe5ee/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:25.594794 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3c9c7-932d-4c89-9919-ef81b0bf9d76 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:25.595110 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3c9c7-932d-4c89-9919-ef81b0bf9d76 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:25.595387 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d3c9c7-932d-4c89-9919-ef81b0bf9d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:25.627700 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-63d3c9c7-932d-4c89-9919-ef81b0bf9d76 None None] MFA Rules not processed for user `ad48b7e86a4b4ea5b6919ab7faabe5ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:25.628999 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-63d3c9c7-932d-4c89-9919-ef81b0bf9d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:25.718470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1377/2730] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:25 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:32:25.723125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c775f03-66e4-471e-bc4a-ab527bda30fc admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:25.786754 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:25.821230 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c775f03-66e4-471e-bc4a-ab527bda30fc admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:25.835319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9595a-e072-4639-9f45-a36678925f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:25.836876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9595a-e072-4639-9f45-a36678925f49 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:25.837503 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9595a-e072-4639-9f45-a36678925f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:25.837844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a9595a-e072-4639-9f45-a36678925f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:25.838856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9595a-e072-4639-9f45-a36678925f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:25.854394 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a9595a-e072-4639-9f45-a36678925f49 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:25.891100 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1354/2731] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:32:25 2022] POST /identity/v3/projects => generated 383 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:32:25.892180 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3c9c7-932d-4c89-9919-ef81b0bf9d76 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:25.899078 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:25.907433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d3c9c7-932d-4c89-9919-ef81b0bf9d76 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:25.973658 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df2e0e-6ab0-40ed-be3a-4984ba46e373 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:25.974285 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df2e0e-6ab0-40ed-be3a-4984ba46e373 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:25.974558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df2e0e-6ab0-40ed-be3a-4984ba46e373 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:25.974858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89df2e0e-6ab0-40ed-be3a-4984ba46e373 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:25.975518 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df2e0e-6ab0-40ed-be3a-4984ba46e373 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:25.977453 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89df2e0e-6ab0-40ed-be3a-4984ba46e373 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:26.003404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1378/2732] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:32:25 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:32:26.007472 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9595a-e072-4639-9f45-a36678925f49 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:26.022031 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a9595a-e072-4639-9f45-a36678925f49 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:26.026814 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce6584-12f9-401d-9a51-d8d9a63bd93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:26.027442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce6584-12f9-401d-9a51-d8d9a63bd93d admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:26.027920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce6584-12f9-401d-9a51-d8d9a63bd93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:26.028195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ce6584-12f9-401d-9a51-d8d9a63bd93d admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:26.028899 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce6584-12f9-401d-9a51-d8d9a63bd93d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:26.030525 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ce6584-12f9-401d-9a51-d8d9a63bd93d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:26.041985 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1355/2733] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:32:26.046128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df2e0e-6ab0-40ed-be3a-4984ba46e373 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:26.057775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89df2e0e-6ab0-40ed-be3a-4984ba46e373 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:26.065589 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9230a81-0004-4530-8995-ea85af9adc8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:26.066259 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9230a81-0004-4530-8995-ea85af9adc8e admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:26.066633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9230a81-0004-4530-8995-ea85af9adc8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:26.067288 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9230a81-0004-4530-8995-ea85af9adc8e admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:26.068610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9230a81-0004-4530-8995-ea85af9adc8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:26.071220 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9230a81-0004-4530-8995-ea85af9adc8e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:26.088542 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1379/2734] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:32:26.089735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce6584-12f9-401d-9a51-d8d9a63bd93d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:26.102682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ce6584-12f9-401d-9a51-d8d9a63bd93d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:26.105589 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c6d70-07ed-48e5-b886-823b01333df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:26.106272 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c6d70-07ed-48e5-b886-823b01333df6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:26.106550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c6d70-07ed-48e5-b886-823b01333df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:26.106862 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936c6d70-07ed-48e5-b886-823b01333df6 admin admin] PATH_INFO: `/v3/projects/2b21ea9e80b044c5ba2c37792a353277/users/133a89cce0ed4ebf868ba8a62447ed3d/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:26.126803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c6d70-07ed-48e5-b886-823b01333df6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b21ea9e80b044c5ba2c37792a353277, user_id=133a89cce0ed4ebf868ba8a62447ed3d, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:26.129514 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936c6d70-07ed-48e5-b886-823b01333df6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:26.149286 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1356/2735] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:32:26 2022] PUT /identity/v3/projects/2b21ea9e80b044c5ba2c37792a353277/users/133a89cce0ed4ebf868ba8a62447ed3d/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:26.159646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a9f6e-ef75-4987-9ab9-bf01bb541b85 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:26.159911 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a9f6e-ef75-4987-9ab9-bf01bb541b85 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:26.160193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19a9f6e-ef75-4987-9ab9-bf01bb541b85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:26.194285 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b19a9f6e-ef75-4987-9ab9-bf01bb541b85 None None] MFA Rules not processed for user `133a89cce0ed4ebf868ba8a62447ed3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:26.195591 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b19a9f6e-ef75-4987-9ab9-bf01bb541b85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:26.271091 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1380/2736] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:32:26.275354 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c6d70-07ed-48e5-b886-823b01333df6 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:26.348817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936c6d70-07ed-48e5-b886-823b01333df6 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:26.354423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b7031-5d9f-4c87-8278-a1f06087799e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:26.355223 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b7031-5d9f-4c87-8278-a1f06087799e admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:26.355550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b7031-5d9f-4c87-8278-a1f06087799e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:26.355927 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b7031-5d9f-4c87-8278-a1f06087799e admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:26.356736 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b7031-5d9f-4c87-8278-a1f06087799e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:26.358778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-549b7031-5d9f-4c87-8278-a1f06087799e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:26.391882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1357/2737] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:32:26 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:32:26.394267 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a9f6e-ef75-4987-9ab9-bf01bb541b85 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:26.408312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19a9f6e-ef75-4987-9ab9-bf01bb541b85 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:26.478337 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c11cd-00c9-4fa8-a055-00d8f9ad9ca9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:26.478995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c11cd-00c9-4fa8-a055-00d8f9ad9ca9 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:26.479275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c11cd-00c9-4fa8-a055-00d8f9ad9ca9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:26.479546 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7c11cd-00c9-4fa8-a055-00d8f9ad9ca9 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:26.480203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c11cd-00c9-4fa8-a055-00d8f9ad9ca9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:26.482130 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7c11cd-00c9-4fa8-a055-00d8f9ad9ca9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:26.509022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:26.509022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1381/2738] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:32:26 2022] POST /identity/v3/users => generated 299 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:32:26.510623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b7031-5d9f-4c87-8278-a1f06087799e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:26.521654 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b7031-5d9f-4c87-8278-a1f06087799e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:26.526145 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3eb75-be26-4cbc-85a3-2a605b28d479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:26.537285 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3eb75-be26-4cbc-85a3-2a605b28d479 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:26.537573 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3eb75-be26-4cbc-85a3-2a605b28d479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:26.537844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3eb75-be26-4cbc-85a3-2a605b28d479 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:26.538560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3eb75-be26-4cbc-85a3-2a605b28d479 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:26.540196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3eb75-be26-4cbc-85a3-2a605b28d479 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:26.553177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1358/2739] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:32:26.557351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c11cd-00c9-4fa8-a055-00d8f9ad9ca9 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:26.569331 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7c11cd-00c9-4fa8-a055-00d8f9ad9ca9 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:26.574064 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97e70e-a10a-4397-9933-3d3ae34abc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:26.574836 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97e70e-a10a-4397-9933-3d3ae34abc57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:26.575033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97e70e-a10a-4397-9933-3d3ae34abc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:26.575358 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e97e70e-a10a-4397-9933-3d3ae34abc57 admin admin] PATH_INFO: `/v3/projects/a6e762399b3248f782cabb6f49ac4042/users/0b453a857dea45a4922d59f76bcfafe4/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:26.590270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97e70e-a10a-4397-9933-3d3ae34abc57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e762399b3248f782cabb6f49ac4042, user_id=0b453a857dea45a4922d59f76bcfafe4, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:26.592955 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e97e70e-a10a-4397-9933-3d3ae34abc57 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:26.606555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1382/2740] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:32:26 2022] PUT /identity/v3/projects/a6e762399b3248f782cabb6f49ac4042/users/0b453a857dea45a4922d59f76bcfafe4/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:32:26.611200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3eb75-be26-4cbc-85a3-2a605b28d479 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:26.621160 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3eb75-be26-4cbc-85a3-2a605b28d479 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:26.678401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a57149-e587-4822-a7b2-59c00efe70bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:26.678972 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a57149-e587-4822-a7b2-59c00efe70bc admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:26.679279 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a57149-e587-4822-a7b2-59c00efe70bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:26.679553 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a57149-e587-4822-a7b2-59c00efe70bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:26.680237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a57149-e587-4822-a7b2-59c00efe70bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:26.681847 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a57149-e587-4822-a7b2-59c00efe70bc admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:26.683895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:26.696142 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1359/2741] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:26 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:32:26.697618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97e70e-a10a-4397-9933-3d3ae34abc57 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:26.707902 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e97e70e-a10a-4397-9933-3d3ae34abc57 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:26.712499 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5364562-a106-413c-bb3c-966266aa72b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:26.713149 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5364562-a106-413c-bb3c-966266aa72b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:26.713428 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5364562-a106-413c-bb3c-966266aa72b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:26.713702 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5364562-a106-413c-bb3c-966266aa72b3 admin admin] PATH_INFO: `/v3/projects/a6e762399b3248f782cabb6f49ac4042/users/0b453a857dea45a4922d59f76bcfafe4/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:26.715691 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5364562-a106-413c-bb3c-966266aa72b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a6e762399b3248f782cabb6f49ac4042, user_id=0b453a857dea45a4922d59f76bcfafe4, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:26.718862 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5364562-a106-413c-bb3c-966266aa72b3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:26.729238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1383/2742] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:32:26 2022] PUT /identity/v3/projects/a6e762399b3248f782cabb6f49ac4042/users/0b453a857dea45a4922d59f76bcfafe4/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:26.741257 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537bc41-890f-459e-9dcf-ece40a267a37 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:26.741557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537bc41-890f-459e-9dcf-ece40a267a37 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:26.741834 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9537bc41-890f-459e-9dcf-ece40a267a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:26.774657 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9537bc41-890f-459e-9dcf-ece40a267a37 None None] MFA Rules not processed for user `0b453a857dea45a4922d59f76bcfafe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:26.775875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9537bc41-890f-459e-9dcf-ece40a267a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:26.846217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1360/2743] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:26.858115 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5364562-a106-413c-bb3c-966266aa72b3 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:26.860335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a5364562-a106-413c-bb3c-966266aa72b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:26.924459 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5364562-a106-413c-bb3c-966266aa72b3 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:26.928312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13286b-5dc9-43b4-a908-c758411e757f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:26.929021 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13286b-5dc9-43b4-a908-c758411e757f service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:26.929234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13286b-5dc9-43b4-a908-c758411e757f service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:26.929501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d13286b-5dc9-43b4-a908-c758411e757f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:26.996426 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13286b-5dc9-43b4-a908-c758411e757f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:26.998189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d13286b-5dc9-43b4-a908-c758411e757f service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:27.007752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1384/2744] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:28.595693 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537bc41-890f-459e-9dcf-ece40a267a37 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:28.605397 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9537bc41-890f-459e-9dcf-ece40a267a37 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:28.609900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b40d0d-1de8-462f-8099-c1034e7b4e49 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:28.610507 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b40d0d-1de8-462f-8099-c1034e7b4e49 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:28.610817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b40d0d-1de8-462f-8099-c1034e7b4e49 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:28.611092 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b40d0d-1de8-462f-8099-c1034e7b4e49 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:28.672414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b40d0d-1de8-462f-8099-c1034e7b4e49 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:28.673856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b40d0d-1de8-462f-8099-c1034e7b4e49 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:28.684698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1361/2745] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:29.236965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13286b-5dc9-43b4-a908-c758411e757f service cinder] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:29.240014 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5d13286b-5dc9-43b4-a908-c758411e757f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:29.250098 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d13286b-5dc9-43b4-a908-c758411e757f service cinder] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:29.254886 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f64ca4b-efb0-41eb-9ca0-6c717f680ca5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:29.255783 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64ca4b-efb0-41eb-9ca0-6c717f680ca5 service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:29.256340 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64ca4b-efb0-41eb-9ca0-6c717f680ca5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:29.256838 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f64ca4b-efb0-41eb-9ca0-6c717f680ca5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:29.269920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64ca4b-efb0-41eb-9ca0-6c717f680ca5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:29.271818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f64ca4b-efb0-41eb-9ca0-6c717f680ca5 service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:29.284712 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1385/2746] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:29 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:33.242441 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b40d0d-1de8-462f-8099-c1034e7b4e49 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:33.454710 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b40d0d-1de8-462f-8099-c1034e7b4e49 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:33.459316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42a4a7-2760-484d-af2f-69700785cefd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:33.459962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42a4a7-2760-484d-af2f-69700785cefd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:33.460410 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42a4a7-2760-484d-af2f-69700785cefd admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:33.460682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42a4a7-2760-484d-af2f-69700785cefd admin admin] PATH_INFO: `/v3/users/ad48b7e86a4b4ea5b6919ab7faabe5ee` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:33.461912 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42a4a7-2760-484d-af2f-69700785cefd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ad48b7e86a4b4ea5b6919ab7faabe5ee)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:33.463855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42a4a7-2760-484d-af2f-69700785cefd admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:33.494523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:33.544595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ae42a4a7-2760-484d-af2f-69700785cefd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ad48b7e86a4b4ea5b6919ab7faabe5ee'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:33.558291 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ae42a4a7-2760-484d-af2f-69700785cefd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ad48b7e86a4b4ea5b6919ab7faabe5ee'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:33.580278 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ae42a4a7-2760-484d-af2f-69700785cefd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ad48b7e86a4b4ea5b6919ab7faabe5ee'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:33.580278 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ae42a4a7-2760-484d-af2f-69700785cefd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ad48b7e86a4b4ea5b6919ab7faabe5ee'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:33.595120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-ae42a4a7-2760-484d-af2f-69700785cefd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ad48b7e86a4b4ea5b6919ab7faabe5ee'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:33.610630 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1362/2747] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:32:33 2022] DELETE /identity/v3/users/ad48b7e86a4b4ea5b6919ab7faabe5ee => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:33.611504 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2eac2-257a-4fe5-b9f3-f290ded7b404 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:33.612035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2eac2-257a-4fe5-b9f3-f290ded7b404 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:33.612314 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f2eac2-257a-4fe5-b9f3-f290ded7b404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:33.642206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-94f2eac2-257a-4fe5-b9f3-f290ded7b404 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:33.643526 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-94f2eac2-257a-4fe5-b9f3-f290ded7b404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:33.713684 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1386/2748] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:33.723403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42a4a7-2760-484d-af2f-69700785cefd admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:33.724812 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ae42a4a7-2760-484d-af2f-69700785cefd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:33.786317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42a4a7-2760-484d-af2f-69700785cefd admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:33.789939 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fbc02-ddda-40fb-a35a-440e0ff0f310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:33.790560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fbc02-ddda-40fb-a35a-440e0ff0f310 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:33.790867 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fbc02-ddda-40fb-a35a-440e0ff0f310 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:33.791137 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fbc02-ddda-40fb-a35a-440e0ff0f310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:33.801451 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fbc02-ddda-40fb-a35a-440e0ff0f310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:33.803056 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fbc02-ddda-40fb-a35a-440e0ff0f310 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:33.813362 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1363/2749] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:34.115066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2eac2-257a-4fe5-b9f3-f290ded7b404 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:34.116698 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-94f2eac2-257a-4fe5-b9f3-f290ded7b404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:34.127186 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:34.135678 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f2eac2-257a-4fe5-b9f3-f290ded7b404 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:34.141472 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea9de-4bbf-4d50-9571-547c18b2b65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:34.142381 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea9de-4bbf-4d50-9571-547c18b2b65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:34.142883 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea9de-4bbf-4d50-9571-547c18b2b65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:34.143610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cea9de-4bbf-4d50-9571-547c18b2b65d admin admin] PATH_INFO: `/v3/projects/b507947fa2d14ac09edf632f17a2858c` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:34.145117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cea9de-4bbf-4d50-9571-547c18b2b65d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b507947fa2d14ac09edf632f17a2858c)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:34.147385 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cea9de-4bbf-4d50-9571-547c18b2b65d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:34.209417 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-55cea9de-4bbf-4d50-9571-547c18b2b65d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b507947fa2d14ac09edf632f17a2858c', 'request_id': 'req-55cea9de-4bbf-4d50-9571-547c18b2b65d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:34.216299 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-55cea9de-4bbf-4d50-9571-547c18b2b65d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b507947fa2d14ac09edf632f17a2858c', 'request_id': 'req-55cea9de-4bbf-4d50-9571-547c18b2b65d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:34.227220 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-55cea9de-4bbf-4d50-9571-547c18b2b65d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b507947fa2d14ac09edf632f17a2858c', 'request_id': 'req-55cea9de-4bbf-4d50-9571-547c18b2b65d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:34.242529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-55cea9de-4bbf-4d50-9571-547c18b2b65d admin admin] The token cache is being invalidate because project b507947fa2d14ac09edf632f17a2858c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:32:34.243343 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-55cea9de-4bbf-4d50-9571-547c18b2b65d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:34.244381 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-55cea9de-4bbf-4d50-9571-547c18b2b65d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:34.246686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1387/2750] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:32:34 2022] DELETE /identity/v3/projects/b507947fa2d14ac09edf632f17a2858c => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:34.251063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fbc02-ddda-40fb-a35a-440e0ff0f310 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:34.260876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fbc02-ddda-40fb-a35a-440e0ff0f310 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:34.369394 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e85f4-e78a-4164-95e3-d6fbd34d754b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:34.370774 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e85f4-e78a-4164-95e3-d6fbd34d754b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:34.371330 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e85f4-e78a-4164-95e3-d6fbd34d754b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:34.371760 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35e85f4-e78a-4164-95e3-d6fbd34d754b admin admin] PATH_INFO: `/v3/users/133a89cce0ed4ebf868ba8a62447ed3d` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:34.376779 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e85f4-e78a-4164-95e3-d6fbd34d754b admin admin] RBAC: Authorizing `identity:delete_user(user_id=133a89cce0ed4ebf868ba8a62447ed3d)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:34.380093 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35e85f4-e78a-4164-95e3-d6fbd34d754b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:34.438212 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:34.441166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c35e85f4-e78a-4164-95e3-d6fbd34d754b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '133a89cce0ed4ebf868ba8a62447ed3d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:34.452460 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c35e85f4-e78a-4164-95e3-d6fbd34d754b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '133a89cce0ed4ebf868ba8a62447ed3d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:34.468074 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c35e85f4-e78a-4164-95e3-d6fbd34d754b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '133a89cce0ed4ebf868ba8a62447ed3d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:34.470615 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c35e85f4-e78a-4164-95e3-d6fbd34d754b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '133a89cce0ed4ebf868ba8a62447ed3d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:34.479063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c35e85f4-e78a-4164-95e3-d6fbd34d754b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '133a89cce0ed4ebf868ba8a62447ed3d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:34.486983 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1364/2751] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:32:34 2022] DELETE /identity/v3/users/133a89cce0ed4ebf868ba8a62447ed3d => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:34.883682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea9de-4bbf-4d50-9571-547c18b2b65d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:34.885606 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-55cea9de-4bbf-4d50-9571-547c18b2b65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:34.926979 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cea9de-4bbf-4d50-9571-547c18b2b65d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:35.027587 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e717b-56ed-429c-b124-9624180e5eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:35.028483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e717b-56ed-429c-b124-9624180e5eaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:35.028762 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e717b-56ed-429c-b124-9624180e5eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:35.029037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66e717b-56ed-429c-b124-9624180e5eaf admin admin] PATH_INFO: `/v3/projects/2b21ea9e80b044c5ba2c37792a353277` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:35.030225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e717b-56ed-429c-b124-9624180e5eaf admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b21ea9e80b044c5ba2c37792a353277)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:35.032244 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66e717b-56ed-429c-b124-9624180e5eaf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:35.092039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a66e717b-56ed-429c-b124-9624180e5eaf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b21ea9e80b044c5ba2c37792a353277', 'request_id': 'req-a66e717b-56ed-429c-b124-9624180e5eaf'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:35.103422 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a66e717b-56ed-429c-b124-9624180e5eaf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b21ea9e80b044c5ba2c37792a353277', 'request_id': 'req-a66e717b-56ed-429c-b124-9624180e5eaf'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:35.110191 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a66e717b-56ed-429c-b124-9624180e5eaf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b21ea9e80b044c5ba2c37792a353277', 'request_id': 'req-a66e717b-56ed-429c-b124-9624180e5eaf'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:35.126036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a66e717b-56ed-429c-b124-9624180e5eaf admin admin] The token cache is being invalidate because project 2b21ea9e80b044c5ba2c37792a353277 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:32:35.126399 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a66e717b-56ed-429c-b124-9624180e5eaf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:35.127224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a66e717b-56ed-429c-b124-9624180e5eaf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:35.129128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1388/2752] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:32:34 2022] DELETE /identity/v3/projects/2b21ea9e80b044c5ba2c37792a353277 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:35.132917 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e85f4-e78a-4164-95e3-d6fbd34d754b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:35.134601 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-c35e85f4-e78a-4164-95e3-d6fbd34d754b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:35.159708 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35e85f4-e78a-4164-95e3-d6fbd34d754b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:35.251954 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ea588-0a08-44e0-8c4c-ecb039bb428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:35.252608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ea588-0a08-44e0-8c4c-ecb039bb428f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:35.252871 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ea588-0a08-44e0-8c4c-ecb039bb428f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:35.253328 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ea588-0a08-44e0-8c4c-ecb039bb428f admin admin] PATH_INFO: `/v3/users/0b453a857dea45a4922d59f76bcfafe4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:35.254539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ea588-0a08-44e0-8c4c-ecb039bb428f admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b453a857dea45a4922d59f76bcfafe4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:35.256550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ea588-0a08-44e0-8c4c-ecb039bb428f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:35.313844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-992ea588-0a08-44e0-8c4c-ecb039bb428f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b453a857dea45a4922d59f76bcfafe4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:35.323015 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-992ea588-0a08-44e0-8c4c-ecb039bb428f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b453a857dea45a4922d59f76bcfafe4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:35.338058 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-992ea588-0a08-44e0-8c4c-ecb039bb428f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b453a857dea45a4922d59f76bcfafe4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:35.339074 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-992ea588-0a08-44e0-8c4c-ecb039bb428f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b453a857dea45a4922d59f76bcfafe4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:35.348562 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-992ea588-0a08-44e0-8c4c-ecb039bb428f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b453a857dea45a4922d59f76bcfafe4'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:35.357960 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1365/2753] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:32:35 2022] DELETE /identity/v3/users/0b453a857dea45a4922d59f76bcfafe4 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:35.809132 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e717b-56ed-429c-b124-9624180e5eaf admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:35.811143 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a66e717b-56ed-429c-b124-9624180e5eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:35.828024 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66e717b-56ed-429c-b124-9624180e5eaf admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:35.850445 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:35.900722 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df61758d-1cd9-40d3-b602-a8ea7b47fa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:35.902097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61758d-1cd9-40d3-b602-a8ea7b47fa53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:35.902385 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61758d-1cd9-40d3-b602-a8ea7b47fa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:35.902701 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df61758d-1cd9-40d3-b602-a8ea7b47fa53 admin admin] PATH_INFO: `/v3/projects/a6e762399b3248f782cabb6f49ac4042` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:35.903931 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61758d-1cd9-40d3-b602-a8ea7b47fa53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a6e762399b3248f782cabb6f49ac4042)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:35.906457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df61758d-1cd9-40d3-b602-a8ea7b47fa53 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:35.963339 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-df61758d-1cd9-40d3-b602-a8ea7b47fa53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a6e762399b3248f782cabb6f49ac4042', 'request_id': 'req-df61758d-1cd9-40d3-b602-a8ea7b47fa53'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:35.970373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-df61758d-1cd9-40d3-b602-a8ea7b47fa53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a6e762399b3248f782cabb6f49ac4042', 'request_id': 'req-df61758d-1cd9-40d3-b602-a8ea7b47fa53'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:35.976322 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-df61758d-1cd9-40d3-b602-a8ea7b47fa53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a6e762399b3248f782cabb6f49ac4042', 'request_id': 'req-df61758d-1cd9-40d3-b602-a8ea7b47fa53'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:35.992193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-df61758d-1cd9-40d3-b602-a8ea7b47fa53 admin admin] The token cache is being invalidate because project a6e762399b3248f782cabb6f49ac4042 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:32:35.992483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-df61758d-1cd9-40d3-b602-a8ea7b47fa53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:35.993116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-df61758d-1cd9-40d3-b602-a8ea7b47fa53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:32:35.999607 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eeffa-fefc-4273-9645-4f7aa7267ec2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:35.999896 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eeffa-fefc-4273-9645-4f7aa7267ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:36.000171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eeffa-fefc-4273-9645-4f7aa7267ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:36.002672 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1389/2754] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:32:35 2022] DELETE /identity/v3/projects/a6e762399b3248f782cabb6f49ac4042 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:36.020502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-ce7eeffa-fefc-4273-9645-4f7aa7267ec2 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:36.021963 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-ce7eeffa-fefc-4273-9645-4f7aa7267ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:36.068532 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=85,keystone:INSERT=2,keystone:DELETE=13 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:36.095412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1366/2755] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:36.103724 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bd4af-f16f-454a-bb9b-2316080fb1c8 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:36.104378 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bd4af-f16f-454a-bb9b-2316080fb1c8 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:36.104664 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3bd4af-f16f-454a-bb9b-2316080fb1c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:36.127086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6c3bd4af-f16f-454a-bb9b-2316080fb1c8 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:36.128465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6c3bd4af-f16f-454a-bb9b-2316080fb1c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:36.138740 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1390/2756] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:36.143673 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7eeffa-fefc-4273-9645-4f7aa7267ec2 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:36.155754 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7eeffa-fefc-4273-9645-4f7aa7267ec2 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:36.160556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06042eb-7413-450f-ace7-a1efe3a33280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:36.161277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06042eb-7413-450f-ace7-a1efe3a33280 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:36.161616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06042eb-7413-450f-ace7-a1efe3a33280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:36.161957 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06042eb-7413-450f-ace7-a1efe3a33280 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:36.162787 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06042eb-7413-450f-ace7-a1efe3a33280 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:32:36.163157 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06042eb-7413-450f-ace7-a1efe3a33280 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:36.164862 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06042eb-7413-450f-ace7-a1efe3a33280 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:36.178848 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1367/2757] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:32:36.183408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3bd4af-f16f-454a-bb9b-2316080fb1c8 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:36.193841 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3bd4af-f16f-454a-bb9b-2316080fb1c8 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:36.199151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778d167-2790-4d23-8f5c-107d176093ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:36.199868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778d167-2790-4d23-8f5c-107d176093ca admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:36.200255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778d167-2790-4d23-8f5c-107d176093ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:36.200595 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f778d167-2790-4d23-8f5c-107d176093ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:36.201345 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778d167-2790-4d23-8f5c-107d176093ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:36.203427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f778d167-2790-4d23-8f5c-107d176093ca admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:36.236147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1391/2758] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:32:36 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:32:36.237503 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06042eb-7413-450f-ace7-a1efe3a33280 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:36.248856 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06042eb-7413-450f-ace7-a1efe3a33280 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:36.327017 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd27ea-3e3d-425f-8f71-56cfc69a1043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:36.327797 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd27ea-3e3d-425f-8f71-56cfc69a1043 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:36.328171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd27ea-3e3d-425f-8f71-56cfc69a1043 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:36.328470 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cd27ea-3e3d-425f-8f71-56cfc69a1043 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:36.329151 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd27ea-3e3d-425f-8f71-56cfc69a1043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:36.331198 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cd27ea-3e3d-425f-8f71-56cfc69a1043 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:36.357285 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1368/2759] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:32:36 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:32:36.362202 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778d167-2790-4d23-8f5c-107d176093ca admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:36.372937 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f778d167-2790-4d23-8f5c-107d176093ca admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:36.377695 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a3862-8715-4a95-b93c-9ce2f00d031d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:36.378313 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a3862-8715-4a95-b93c-9ce2f00d031d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:36.378608 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a3862-8715-4a95-b93c-9ce2f00d031d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:36.378910 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922a3862-8715-4a95-b93c-9ce2f00d031d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:36.379627 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a3862-8715-4a95-b93c-9ce2f00d031d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:36.381242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922a3862-8715-4a95-b93c-9ce2f00d031d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:36.394713 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1392/2760] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:32:36.396039 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd27ea-3e3d-425f-8f71-56cfc69a1043 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:36.406682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cd27ea-3e3d-425f-8f71-56cfc69a1043 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:36.412704 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a80a9-0494-486f-aba7-1ffd91b70d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:36.413318 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a80a9-0494-486f-aba7-1ffd91b70d98 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:36.413590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a80a9-0494-486f-aba7-1ffd91b70d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:36.413874 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a80a9-0494-486f-aba7-1ffd91b70d98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:36.414553 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a80a9-0494-486f-aba7-1ffd91b70d98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:36.416372 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a80a9-0494-486f-aba7-1ffd91b70d98 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:36.427879 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1369/2761] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:32:36.432210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a3862-8715-4a95-b93c-9ce2f00d031d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:36.442733 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922a3862-8715-4a95-b93c-9ce2f00d031d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:36.448178 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72f560-b5d0-4f17-9735-1ffdd62daec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:36.448738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72f560-b5d0-4f17-9735-1ffdd62daec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:36.449016 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72f560-b5d0-4f17-9735-1ffdd62daec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:36.449309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e72f560-b5d0-4f17-9735-1ffdd62daec3 admin admin] PATH_INFO: `/v3/projects/a1b37511351d42d082268c063219779f/users/7018547aa749456fa7ec87ee5d50094d/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:36.464214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72f560-b5d0-4f17-9735-1ffdd62daec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b37511351d42d082268c063219779f, user_id=7018547aa749456fa7ec87ee5d50094d, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:36.466871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e72f560-b5d0-4f17-9735-1ffdd62daec3 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:36.481170 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1393/2762] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:32:36 2022] PUT /identity/v3/projects/a1b37511351d42d082268c063219779f/users/7018547aa749456fa7ec87ee5d50094d/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:32:36.486490 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691be531-edc7-4e0f-bcbd-66f5a5141768 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:36.487660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691be531-edc7-4e0f-bcbd-66f5a5141768 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:36.487660 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691be531-edc7-4e0f-bcbd-66f5a5141768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:36.508496 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-691be531-edc7-4e0f-bcbd-66f5a5141768 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:36.509740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-691be531-edc7-4e0f-bcbd-66f5a5141768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:36.601860 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1370/2763] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:36.615875 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72f560-b5d0-4f17-9735-1ffdd62daec3 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:36.617611 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7e72f560-b5d0-4f17-9735-1ffdd62daec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:36.666112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:36.679735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e72f560-b5d0-4f17-9735-1ffdd62daec3 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:36.685342 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c24abf-1b72-40d0-b9fb-28d6eeb10eb0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:36.686127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c24abf-1b72-40d0-b9fb-28d6eeb10eb0 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:36.686782 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c24abf-1b72-40d0-b9fb-28d6eeb10eb0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:36.687152 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c24abf-1b72-40d0-b9fb-28d6eeb10eb0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:36.697432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c24abf-1b72-40d0-b9fb-28d6eeb10eb0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:36.698993 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c24abf-1b72-40d0-b9fb-28d6eeb10eb0 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:36.721712 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1394/2764] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:37.260876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b053b3-88f4-4400-87ca-31df35cb9cc7 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:37.261154 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b053b3-88f4-4400-87ca-31df35cb9cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:37.261430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b053b3-88f4-4400-87ca-31df35cb9cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:37.296228 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-d4b053b3-88f4-4400-87ca-31df35cb9cc7 None None] MFA Rules not processed for user `c86a9d7b668944d58b995fe157256ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:37.297515 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d4b053b3-88f4-4400-87ca-31df35cb9cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:37.352940 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:37.367195 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1371/2765] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:37.480694 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27df78-5b81-4dd9-b772-a8ea55961bd9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:37.481259 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27df78-5b81-4dd9-b772-a8ea55961bd9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:37.481259 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b27df78-5b81-4dd9-b772-a8ea55961bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:37.521384 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-8b27df78-5b81-4dd9-b772-a8ea55961bd9 None None] MFA Rules not processed for user `7018547aa749456fa7ec87ee5d50094d`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:37.522942 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8b27df78-5b81-4dd9-b772-a8ea55961bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:37.600020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1395/2766] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:37 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:37.612109 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b053b3-88f4-4400-87ca-31df35cb9cc7 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:37.613568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d4b053b3-88f4-4400-87ca-31df35cb9cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:37.691651 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b053b3-88f4-4400-87ca-31df35cb9cc7 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:37.695683 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bbaae-cd8c-46db-ba45-797d1aab98b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:37.696309 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bbaae-cd8c-46db-ba45-797d1aab98b0 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:37.696585 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bbaae-cd8c-46db-ba45-797d1aab98b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:37.696855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2bbaae-cd8c-46db-ba45-797d1aab98b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:37.705605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2bbaae-cd8c-46db-ba45-797d1aab98b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:37.707079 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2bbaae-cd8c-46db-ba45-797d1aab98b0 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:37.716326 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1372/2767] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:37 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:39.114738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9efe9e-b39f-4192-8d3d-eacc4bb2ce2f None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:39.114738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9efe9e-b39f-4192-8d3d-eacc4bb2ce2f None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:39.114738 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9efe9e-b39f-4192-8d3d-eacc4bb2ce2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:39.134283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-ad9efe9e-b39f-4192-8d3d-eacc4bb2ce2f None None] MFA Rules not processed for user `7018547aa749456fa7ec87ee5d50094d`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:39.135551 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ad9efe9e-b39f-4192-8d3d-eacc4bb2ce2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:39.151128 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1396/2768] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:32:39.643068 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bbaae-cd8c-46db-ba45-797d1aab98b0 service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:39.644831 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3b2bbaae-cd8c-46db-ba45-797d1aab98b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:39.659144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2bbaae-cd8c-46db-ba45-797d1aab98b0 service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:39.663046 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d714e530-1783-46bc-a9dc-376b0692dbff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:39.663659 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714e530-1783-46bc-a9dc-376b0692dbff service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:39.663934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714e530-1783-46bc-a9dc-376b0692dbff service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:39.664204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d714e530-1783-46bc-a9dc-376b0692dbff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:39.665931 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-d714e530-1783-46bc-a9dc-376b0692dbff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:39.731883 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714e530-1783-46bc-a9dc-376b0692dbff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:39.733342 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d714e530-1783-46bc-a9dc-376b0692dbff service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:39.744212 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1373/2769] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:43.516332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9efe9e-b39f-4192-8d3d-eacc4bb2ce2f None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:43.526341 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9efe9e-b39f-4192-8d3d-eacc4bb2ce2f None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:43.530036 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacdde0-54cc-4c74-b351-391bc0a2ad0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:43.531743 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacdde0-54cc-4c74-b351-391bc0a2ad0d service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:43.532022 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacdde0-54cc-4c74-b351-391bc0a2ad0d service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:43.532295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccacdde0-54cc-4c74-b351-391bc0a2ad0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:43.534407 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ccacdde0-54cc-4c74-b351-391bc0a2ad0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:43.610003 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccacdde0-54cc-4c74-b351-391bc0a2ad0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:43.611520 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccacdde0-54cc-4c74-b351-391bc0a2ad0d service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:43.624241 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1397/2770] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:49.739221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=59 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:53.618399 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=75 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:32:58.416824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f0a0e-1cfd-4b4a-b268-0ee3524e5d4a None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:58.417350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f0a0e-1cfd-4b4a-b268-0ee3524e5d4a None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:58.417350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57f0a0e-1cfd-4b4a-b268-0ee3524e5d4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:58.436443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-a57f0a0e-1cfd-4b4a-b268-0ee3524e5d4a None None] MFA Rules not processed for user `7018547aa749456fa7ec87ee5d50094d`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:32:58.438237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a57f0a0e-1cfd-4b4a-b268-0ee3524e5d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:58.445292 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1374/2771] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:32:58 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:32:58.677599 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacdde0-54cc-4c74-b351-391bc0a2ad0d service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:58.686747 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccacdde0-54cc-4c74-b351-391bc0a2ad0d service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:58.690376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ced4ef-5590-45cc-bd71-27ea3db9ad54 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:58.691012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ced4ef-5590-45cc-bd71-27ea3db9ad54 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:58.691291 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ced4ef-5590-45cc-bd71-27ea3db9ad54 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:58.691568 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0ced4ef-5590-45cc-bd71-27ea3db9ad54 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:58.693283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-f0ced4ef-5590-45cc-bd71-27ea3db9ad54 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:58.703572 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ced4ef-5590-45cc-bd71-27ea3db9ad54 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:58.705007 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0ced4ef-5590-45cc-bd71-27ea3db9ad54 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:58.713229 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1398/2772] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:58 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:32:59.021144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f0a0e-1cfd-4b4a-b268-0ee3524e5d4a None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:32:59.022632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a57f0a0e-1cfd-4b4a-b268-0ee3524e5d4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:59.096044 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57f0a0e-1cfd-4b4a-b268-0ee3524e5d4a None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:32:59.100971 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e901159-a8b4-4c3d-8219-d7ef971cd764 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210ee6c390849e7a630a677ec52e966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:32:59.101590 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e901159-a8b4-4c3d-8219-d7ef971cd764 service placement] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:32:59.101873 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e901159-a8b4-4c3d-8219-d7ef971cd764 service placement] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:32:59.102149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e901159-a8b4-4c3d-8219-d7ef971cd764 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:32:59.103933 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0e901159-a8b4-4c3d-8219-d7ef971cd764 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:32:59.115560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e901159-a8b4-4c3d-8219-d7ef971cd764 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:32:59.117171 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e901159-a8b4-4c3d-8219-d7ef971cd764 service placement] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:32:59.127557 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1375/2773] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:32:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:33:01.033575 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ced4ef-5590-45cc-bd71-27ea3db9ad54 service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:01.042292 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0ced4ef-5590-45cc-bd71-27ea3db9ad54 service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:01.045958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4d2932-74de-47ae-bc63-543448199d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:01.047133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d2932-74de-47ae-bc63-543448199d28 service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:01.047413 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d2932-74de-47ae-bc63-543448199d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:01.047739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4d2932-74de-47ae-bc63-543448199d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:01.049492 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-de4d2932-74de-47ae-bc63-543448199d28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:01.059114 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d2932-74de-47ae-bc63-543448199d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:01.060535 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4d2932-74de-47ae-bc63-543448199d28 service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:01.069091 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1399/2774] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:33:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:33:07.920753 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e901159-a8b4-4c3d-8219-d7ef971cd764 service placement] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:07.922737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0e901159-a8b4-4c3d-8219-d7ef971cd764 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:07.938588 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e901159-a8b4-4c3d-8219-d7ef971cd764 service placement] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:07.944251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbece34-bb7d-4a54-9687-fb0d06ad8acd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:07.945134 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbece34-bb7d-4a54-9687-fb0d06ad8acd service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:07.945412 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbece34-bb7d-4a54-9687-fb0d06ad8acd service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:07.945686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcbece34-bb7d-4a54-9687-fb0d06ad8acd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:07.947471 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bcbece34-bb7d-4a54-9687-fb0d06ad8acd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:07.959820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbece34-bb7d-4a54-9687-fb0d06ad8acd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:07.961411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcbece34-bb7d-4a54-9687-fb0d06ad8acd service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:07.972857 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1376/2775] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:33:07 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:33:11.065447 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=12 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:16.460765 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e41689-fff8-49ec-a1a8-4981ac43f632 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:16.461349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e41689-fff8-49ec-a1a8-4981ac43f632 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:16.461349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e41689-fff8-49ec-a1a8-4981ac43f632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:16.510729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-30e41689-fff8-49ec-a1a8-4981ac43f632 None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:16.511927 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-30e41689-fff8-49ec-a1a8-4981ac43f632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:16.577066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1400/2776] 10.222.0.70 () {58 vars in 1009 bytes} [Mon Aug 1 14:33:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:33:16.621265 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbece34-bb7d-4a54-9687-fb0d06ad8acd service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:16.622698 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-bcbece34-bb7d-4a54-9687-fb0d06ad8acd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:16.711321 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcbece34-bb7d-4a54-9687-fb0d06ad8acd service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:16.716186 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce5d0b-5fea-4178-a974-224add0ecfae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:16.716794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce5d0b-5fea-4178-a974-224add0ecfae service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:16.717072 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce5d0b-5fea-4178-a974-224add0ecfae service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:16.717341 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dce5d0b-5fea-4178-a974-224add0ecfae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:16.725569 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce5d0b-5fea-4178-a974-224add0ecfae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:16.727179 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dce5d0b-5fea-4178-a974-224add0ecfae service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:16.735664 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1377/2777] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:33:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:33:26.574277 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=40 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:26.732166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=82 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:32.107741 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7aefb-6b3e-44dc-aced-ebd6f0fd7151 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:32.108879 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7aefb-6b3e-44dc-aced-ebd6f0fd7151 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:32.109033 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da7aefb-6b3e-44dc-aced-ebd6f0fd7151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:32.128858 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-1da7aefb-6b3e-44dc-aced-ebd6f0fd7151 None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:33:32.130210 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-1da7aefb-6b3e-44dc-aced-ebd6f0fd7151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:33:32.137359 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1401/2778] 10.222.0.70 () {58 vars in 967 bytes} [Mon Aug 1 14:33:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:33:32.149568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce5d0b-5fea-4178-a974-224add0ecfae service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:32.160655 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dce5d0b-5fea-4178-a974-224add0ecfae service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:32.165568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e37a2b-b49a-4147-a6a3-594fbdb8a5ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:32.166161 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e37a2b-b49a-4147-a6a3-594fbdb8a5ed service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:32.166435 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e37a2b-b49a-4147-a6a3-594fbdb8a5ed service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:32.166744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e37a2b-b49a-4147-a6a3-594fbdb8a5ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:32.175732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e37a2b-b49a-4147-a6a3-594fbdb8a5ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:32.177324 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e37a2b-b49a-4147-a6a3-594fbdb8a5ed service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:32.185707 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1378/2779] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:33:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:33:34.126252 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7aefb-6b3e-44dc-aced-ebd6f0fd7151 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:34.139943 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da7aefb-6b3e-44dc-aced-ebd6f0fd7151 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:34.146073 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26852335-eed3-4acb-ad25-f0e807083d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:34.146793 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26852335-eed3-4acb-ad25-f0e807083d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:34.147109 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26852335-eed3-4acb-ad25-f0e807083d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:34.147423 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26852335-eed3-4acb-ad25-f0e807083d8e admin admin] PATH_INFO: `/v3/users/7018547aa749456fa7ec87ee5d50094d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:34.148708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26852335-eed3-4acb-ad25-f0e807083d8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=7018547aa749456fa7ec87ee5d50094d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:34.150817 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26852335-eed3-4acb-ad25-f0e807083d8e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:34.332873 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-26852335-eed3-4acb-ad25-f0e807083d8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7018547aa749456fa7ec87ee5d50094d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:34.344592 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-26852335-eed3-4acb-ad25-f0e807083d8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7018547aa749456fa7ec87ee5d50094d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:34.351373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-26852335-eed3-4acb-ad25-f0e807083d8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7018547aa749456fa7ec87ee5d50094d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:34.352060 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-26852335-eed3-4acb-ad25-f0e807083d8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7018547aa749456fa7ec87ee5d50094d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:34.360409 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-26852335-eed3-4acb-ad25-f0e807083d8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7018547aa749456fa7ec87ee5d50094d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:34.366704 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1402/2780] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:33:34 2022] DELETE /identity/v3/users/7018547aa749456fa7ec87ee5d50094d => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:34.543004 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e37a2b-b49a-4147-a6a3-594fbdb8a5ed service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:33:34.554338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e37a2b-b49a-4147-a6a3-594fbdb8a5ed service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:33:34.616838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:33:34.617669 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:33:34.617826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:33:34.618102 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2 admin admin] PATH_INFO: `/v3/projects/a1b37511351d42d082268c063219779f` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:33:34.619430 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b37511351d42d082268c063219779f)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:33:34.621375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:33:34.681317 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b37511351d42d082268c063219779f', 'request_id': 'req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:34.687571 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b37511351d42d082268c063219779f', 'request_id': 'req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:34.696211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b37511351d42d082268c063219779f', 'request_id': 'req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:34.707820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2 admin admin] The token cache is being invalidate because project a1b37511351d42d082268c063219779f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:33:34.708110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:34.708751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:33:34.710280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1379/2781] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:33:34 2022] DELETE /identity/v3/projects/a1b37511351d42d082268c063219779f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:33:44.363121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=32,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:33:44.704771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:07.691095 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26852335-eed3-4acb-ad25-f0e807083d8e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:07.692761 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-26852335-eed3-4acb-ad25-f0e807083d8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:07.770442 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26852335-eed3-4acb-ad25-f0e807083d8e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:07.833214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63200825-d289-4ca7-8ea0-30d1c11dccf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:07.833834 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63200825-d289-4ca7-8ea0-30d1c11dccf7 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:07.834116 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63200825-d289-4ca7-8ea0-30d1c11dccf7 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:07.834389 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63200825-d289-4ca7-8ea0-30d1c11dccf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:07.836199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-63200825-d289-4ca7-8ea0-30d1c11dccf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:07.895004 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63200825-d289-4ca7-8ea0-30d1c11dccf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:07.896564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63200825-d289-4ca7-8ea0-30d1c11dccf7 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:07.906189 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1403/2782] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:34:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:34:16.396984 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:34:16.398595 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:16.415805 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e096ae72-7cb6-4e48-82e3-1c19bd2615a2 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:34:16.423507 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffdba2-2f58-429b-9909-3eba1450569c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:34:16.424411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffdba2-2f58-429b-9909-3eba1450569c service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:16.424695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffdba2-2f58-429b-9909-3eba1450569c service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:16.425040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fffdba2-2f58-429b-9909-3eba1450569c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:16.426977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8fffdba2-2f58-429b-9909-3eba1450569c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:16.441416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffdba2-2f58-429b-9909-3eba1450569c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:34:16.443119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fffdba2-2f58-429b-9909-3eba1450569c service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:34:16.459189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1380/2783] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:34:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:34:17.901474 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=84 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:19.383392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbc2d9-1b7b-41ac-b588-db0b105f60ed None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:34:19.384035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbc2d9-1b7b-41ac-b588-db0b105f60ed None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:34:19.384150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fbc2d9-1b7b-41ac-b588-db0b105f60ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:34:19.403101 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d4fbc2d9-1b7b-41ac-b588-db0b105f60ed None None] MFA Rules not processed for user `c86a9d7b668944d58b995fe157256ef8`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:34:19.404335 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d4fbc2d9-1b7b-41ac-b588-db0b105f60ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:34:19.411087 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1404/2784] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:34:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:34:26.450221 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=6 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:34:29.397970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:35:11.420694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffdba2-2f58-429b-9909-3eba1450569c service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:35:11.436680 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fffdba2-2f58-429b-9909-3eba1450569c service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:35:11.444191 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c42ae-03d8-467c-84be-7d92506fc483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:35:11.445173 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c42ae-03d8-467c-84be-7d92506fc483 service nova] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:35:11.445664 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c42ae-03d8-467c-84be-7d92506fc483 service nova] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:35:11.445947 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789c42ae-03d8-467c-84be-7d92506fc483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:35:11.448639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-789c42ae-03d8-467c-84be-7d92506fc483 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:35:11.465975 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c42ae-03d8-467c-84be-7d92506fc483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:35:11.468794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789c42ae-03d8-467c-84be-7d92506fc483 service nova] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:35:11.480717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1381/2785] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:35:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:35:20.169179 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ee349-0f19-4f6d-a7c1-fb2d86938b11 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:35:20.170177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ee349-0f19-4f6d-a7c1-fb2d86938b11 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:35:20.170285 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2ee349-0f19-4f6d-a7c1-fb2d86938b11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:35:20.191966 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-cd2ee349-0f19-4f6d-a7c1-fb2d86938b11 None None] MFA Rules not processed for user `83ab2b0e5f244881900f6f3f7f591983`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:35:20.193164 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cd2ee349-0f19-4f6d-a7c1-fb2d86938b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:35:20.247165 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1405/2786] 10.222.0.70 () {58 vars in 967 bytes} [Mon Aug 1 14:35:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:35:20.294004 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c42ae-03d8-467c-84be-7d92506fc483 service nova] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:35:20.295963 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-789c42ae-03d8-467c-84be-7d92506fc483 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:35:20.367997 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789c42ae-03d8-467c-84be-7d92506fc483 service nova] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:35:20.373769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc2ace-95ce-42ec-9e65-941978ee3c4d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '98cccf60a5424986b2e92b523542a640', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:35:20.374465 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc2ace-95ce-42ec-9e65-941978ee3c4d service swift] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:35:20.374769 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc2ace-95ce-42ec-9e65-941978ee3c4d service swift] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:35:20.375069 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc2ace-95ce-42ec-9e65-941978ee3c4d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:35:20.383457 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc2ace-95ce-42ec-9e65-941978ee3c4d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:35:20.385024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc2ace-95ce-42ec-9e65-941978ee3c4d service swift] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:35:20.393217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1382/2787] 10.222.0.70 () {60 vars in 1384 bytes} [Mon Aug 1 14:35:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 01 14:35:27.042162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ee349-0f19-4f6d-a7c1-fb2d86938b11 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:35:27.043730 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cd2ee349-0f19-4f6d-a7c1-fb2d86938b11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:35:27.112147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2ee349-0f19-4f6d-a7c1-fb2d86938b11 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:35:27.116710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b6425-90d4-4f6a-b901-3b801cce2bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:35:27.117348 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b6425-90d4-4f6a-b901-3b801cce2bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:35:27.117626 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b6425-90d4-4f6a-b901-3b801cce2bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:35:27.117897 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6b6425-90d4-4f6a-b901-3b801cce2bb6 admin admin] PATH_INFO: `/v3/users/4af695bcf038421b9c7e58b09ce4d6ff` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:35:27.119100 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b6425-90d4-4f6a-b901-3b801cce2bb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4af695bcf038421b9c7e58b09ce4d6ff)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:35:27.121008 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6b6425-90d4-4f6a-b901-3b801cce2bb6 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:35:27.168556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0f6b6425-90d4-4f6a-b901-3b801cce2bb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4af695bcf038421b9c7e58b09ce4d6ff'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:27.180536 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0f6b6425-90d4-4f6a-b901-3b801cce2bb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4af695bcf038421b9c7e58b09ce4d6ff'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:27.187955 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0f6b6425-90d4-4f6a-b901-3b801cce2bb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4af695bcf038421b9c7e58b09ce4d6ff'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:27.188649 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0f6b6425-90d4-4f6a-b901-3b801cce2bb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4af695bcf038421b9c7e58b09ce4d6ff'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:27.196031 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0f6b6425-90d4-4f6a-b901-3b801cce2bb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4af695bcf038421b9c7e58b09ce4d6ff'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:27.202125 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1406/2788] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:35:27 2022] DELETE /identity/v3/users/4af695bcf038421b9c7e58b09ce4d6ff => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:35:27.389753 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc2ace-95ce-42ec-9e65-941978ee3c4d service swift] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:35:27.402974 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc2ace-95ce-42ec-9e65-941978ee3c4d service swift] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:35:27.463403 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b03ce7-f766-4bbf-96e4-576803481b8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:35:27.464052 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b03ce7-f766-4bbf-96e4-576803481b8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:35:27.464331 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b03ce7-f766-4bbf-96e4-576803481b8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:35:27.464603 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b03ce7-f766-4bbf-96e4-576803481b8d admin admin] PATH_INFO: `/v3/projects/e75a857bfc7f4a5d93ac3bfc6c0a00d8` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:35:27.465765 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b03ce7-f766-4bbf-96e4-576803481b8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e75a857bfc7f4a5d93ac3bfc6c0a00d8)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:35:27.468206 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b03ce7-f766-4bbf-96e4-576803481b8d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:35:27.523107 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-00b03ce7-f766-4bbf-96e4-576803481b8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e75a857bfc7f4a5d93ac3bfc6c0a00d8', 'request_id': 'req-00b03ce7-f766-4bbf-96e4-576803481b8d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:27.528606 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-00b03ce7-f766-4bbf-96e4-576803481b8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e75a857bfc7f4a5d93ac3bfc6c0a00d8', 'request_id': 'req-00b03ce7-f766-4bbf-96e4-576803481b8d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:27.536549 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-00b03ce7-f766-4bbf-96e4-576803481b8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e75a857bfc7f4a5d93ac3bfc6c0a00d8', 'request_id': 'req-00b03ce7-f766-4bbf-96e4-576803481b8d'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:27.552028 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-00b03ce7-f766-4bbf-96e4-576803481b8d admin admin] The token cache is being invalidate because project e75a857bfc7f4a5d93ac3bfc6c0a00d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:35:27.552319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-00b03ce7-f766-4bbf-96e4-576803481b8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:27.552978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-00b03ce7-f766-4bbf-96e4-576803481b8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:27.554534 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1383/2789] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:35:27 2022] DELETE /identity/v3/projects/e75a857bfc7f4a5d93ac3bfc6c0a00d8 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:35:27.565843 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b6425-90d4-4f6a-b901-3b801cce2bb6 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:35:27.567309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0f6b6425-90d4-4f6a-b901-3b801cce2bb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:35:27.581406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6b6425-90d4-4f6a-b901-3b801cce2bb6 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:35:27.607500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:35:27.647429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903338c-47f1-4b90-9e69-b394b6cc59b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:35:27.648090 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903338c-47f1-4b90-9e69-b394b6cc59b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:35:27.648340 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903338c-47f1-4b90-9e69-b394b6cc59b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:35:27.648610 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2903338c-47f1-4b90-9e69-b394b6cc59b2 admin admin] PATH_INFO: `/v3/users/231674e2763e4e859c337542d608deef` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:35:27.649775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903338c-47f1-4b90-9e69-b394b6cc59b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=231674e2763e4e859c337542d608deef)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:35:27.651705 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2903338c-47f1-4b90-9e69-b394b6cc59b2 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:35:27.699148 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2903338c-47f1-4b90-9e69-b394b6cc59b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231674e2763e4e859c337542d608deef'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:27.710882 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2903338c-47f1-4b90-9e69-b394b6cc59b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231674e2763e4e859c337542d608deef'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:27.719083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2903338c-47f1-4b90-9e69-b394b6cc59b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231674e2763e4e859c337542d608deef'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:27.719083 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2903338c-47f1-4b90-9e69-b394b6cc59b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231674e2763e4e859c337542d608deef'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:27.725813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-2903338c-47f1-4b90-9e69-b394b6cc59b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231674e2763e4e859c337542d608deef'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:27.732674 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1407/2790] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:35:27 2022] DELETE /identity/v3/users/231674e2763e4e859c337542d608deef => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:35:27.904923 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b03ce7-f766-4bbf-96e4-576803481b8d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:35:27.906468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-00b03ce7-f766-4bbf-96e4-576803481b8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:35:27.919298 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b03ce7-f766-4bbf-96e4-576803481b8d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:35:27.923064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:35:27.979663 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:35:27.980231 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:35:27.980512 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:35:27.980787 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f admin admin] PATH_INFO: `/v3/projects/31704788ce324f7aa69b5750db8c0625` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:35:27.982053 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f admin admin] RBAC: Authorizing `identity:delete_project(project_id=31704788ce324f7aa69b5750db8c0625)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:35:27.983986 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:35:28.031730 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31704788ce324f7aa69b5750db8c0625', 'request_id': 'req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:28.037748 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31704788ce324f7aa69b5750db8c0625', 'request_id': 'req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:28.045035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31704788ce324f7aa69b5750db8c0625', 'request_id': 'req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:28.055927 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f admin admin] The token cache is being invalidate because project 31704788ce324f7aa69b5750db8c0625 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:35:28.056212 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:28.056839 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:35:28.058336 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1384/2791] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:35:27 2022] DELETE /identity/v3/projects/31704788ce324f7aa69b5750db8c0625 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:35:37.728793 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=42,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:35:38.052883 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:35:55.435434 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903338c-47f1-4b90-9e69-b394b6cc59b2 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:35:55.437588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2903338c-47f1-4b90-9e69-b394b6cc59b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:35:55.523808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2903338c-47f1-4b90-9e69-b394b6cc59b2 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:35:55.584331 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522c96a-3b56-4990-ba7a-d3413293e1cb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210ee6c390849e7a630a677ec52e966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:35:55.584884 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522c96a-3b56-4990-ba7a-d3413293e1cb service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:35:55.585162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522c96a-3b56-4990-ba7a-d3413293e1cb service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:35:55.585435 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2522c96a-3b56-4990-ba7a-d3413293e1cb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:35:55.587182 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2522c96a-3b56-4990-ba7a-d3413293e1cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:35:55.598363 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522c96a-3b56-4990-ba7a-d3413293e1cb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:35:55.599971 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2522c96a-3b56-4990-ba7a-d3413293e1cb service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:35:55.610449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1408/2792] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:35:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:36:01.547551 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:01.549220 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:01.609040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c05c6f1-d5f7-4335-bc4d-0ee4c027054f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:01.613100 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc307a-9616-4625-9572-bbd98d36cf50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:01.613712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc307a-9616-4625-9572-bbd98d36cf50 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:01.613987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc307a-9616-4625-9572-bbd98d36cf50 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:01.614254 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fc307a-9616-4625-9572-bbd98d36cf50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:01.616321 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f8fc307a-9616-4625-9572-bbd98d36cf50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:01.678795 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc307a-9616-4625-9572-bbd98d36cf50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:01.680244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fc307a-9616-4625-9572-bbd98d36cf50 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:01.689783 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1385/2793] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:36:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:36:04.823183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522c96a-3b56-4990-ba7a-d3413293e1cb service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:04.824650 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2522c96a-3b56-4990-ba7a-d3413293e1cb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:04.839198 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2522c96a-3b56-4990-ba7a-d3413293e1cb service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:04.846216 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792b4a6-7a06-450c-aa75-45107a0b0aca service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210ee6c390849e7a630a677ec52e966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:04.847045 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792b4a6-7a06-450c-aa75-45107a0b0aca service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:04.847323 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792b4a6-7a06-450c-aa75-45107a0b0aca service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:04.847598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9792b4a6-7a06-450c-aa75-45107a0b0aca service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:04.849466 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-9792b4a6-7a06-450c-aa75-45107a0b0aca service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:04.863518 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792b4a6-7a06-450c-aa75-45107a0b0aca service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:04.865215 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9792b4a6-7a06-450c-aa75-45107a0b0aca service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:04.879863 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1409/2794] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:36:04 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:36:04.893829 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc307a-9616-4625-9572-bbd98d36cf50 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:04.896341 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f8fc307a-9616-4625-9572-bbd98d36cf50 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:04.921238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fc307a-9616-4625-9572-bbd98d36cf50 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:04.926927 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e85e9-39ae-4c0b-b35a-d7f825c14bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:04.927688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e85e9-39ae-4c0b-b35a-d7f825c14bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:04.928082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e85e9-39ae-4c0b-b35a-d7f825c14bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:04.928426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e85e9-39ae-4c0b-b35a-d7f825c14bd3 admin admin] PATH_INFO: `/v3/users/c86a9d7b668944d58b995fe157256ef8` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:04.929670 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e85e9-39ae-4c0b-b35a-d7f825c14bd3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c86a9d7b668944d58b995fe157256ef8)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:04.931766 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e85e9-39ae-4c0b-b35a-d7f825c14bd3 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:04.988287 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2a9e85e9-39ae-4c0b-b35a-d7f825c14bd3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c86a9d7b668944d58b995fe157256ef8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:05.000364 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2a9e85e9-39ae-4c0b-b35a-d7f825c14bd3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c86a9d7b668944d58b995fe157256ef8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:05.014915 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2a9e85e9-39ae-4c0b-b35a-d7f825c14bd3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c86a9d7b668944d58b995fe157256ef8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:05.015753 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2a9e85e9-39ae-4c0b-b35a-d7f825c14bd3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c86a9d7b668944d58b995fe157256ef8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:05.023636 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-2a9e85e9-39ae-4c0b-b35a-d7f825c14bd3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c86a9d7b668944d58b995fe157256ef8'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:05.031604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1386/2795] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:36:04 2022] DELETE /identity/v3/users/c86a9d7b668944d58b995fe157256ef8 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:05.219578 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792b4a6-7a06-450c-aa75-45107a0b0aca service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:05.231209 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9792b4a6-7a06-450c-aa75-45107a0b0aca service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:05.291746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8c48f0-bc5d-4302-8040-18e242f13323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:05.292388 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c48f0-bc5d-4302-8040-18e242f13323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:05.292665 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c48f0-bc5d-4302-8040-18e242f13323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:05.292939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8c48f0-bc5d-4302-8040-18e242f13323 admin admin] PATH_INFO: `/v3/projects/6ff3fcdd41b2470897d4f424c783543a` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:05.294133 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c48f0-bc5d-4302-8040-18e242f13323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ff3fcdd41b2470897d4f424c783543a)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:05.296060 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8c48f0-bc5d-4302-8040-18e242f13323 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:05.320493 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=100 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:05.345752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3f8c48f0-bc5d-4302-8040-18e242f13323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ff3fcdd41b2470897d4f424c783543a', 'request_id': 'req-3f8c48f0-bc5d-4302-8040-18e242f13323'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:05.351949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3f8c48f0-bc5d-4302-8040-18e242f13323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ff3fcdd41b2470897d4f424c783543a', 'request_id': 'req-3f8c48f0-bc5d-4302-8040-18e242f13323'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:05.357505 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3f8c48f0-bc5d-4302-8040-18e242f13323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ff3fcdd41b2470897d4f424c783543a', 'request_id': 'req-3f8c48f0-bc5d-4302-8040-18e242f13323'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:05.370015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3f8c48f0-bc5d-4302-8040-18e242f13323 admin admin] The token cache is being invalidate because project 6ff3fcdd41b2470897d4f424c783543a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:36:05.370313 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3f8c48f0-bc5d-4302-8040-18e242f13323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:05.370991 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-3f8c48f0-bc5d-4302-8040-18e242f13323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:05.372519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1410/2796] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:36:05 2022] DELETE /identity/v3/projects/6ff3fcdd41b2470897d4f424c783543a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:05.378129 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67581fd9-815d-4a78-a1c2-eadc93bfc0a2 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:05.378418 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67581fd9-815d-4a78-a1c2-eadc93bfc0a2 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:05.378723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67581fd9-815d-4a78-a1c2-eadc93bfc0a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:05.398423 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-67581fd9-815d-4a78-a1c2-eadc93bfc0a2 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:05.399657 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-67581fd9-815d-4a78-a1c2-eadc93bfc0a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:05.417120 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:05.462641 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1387/2797] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:05.471839 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870cf0d-1cae-47c3-8b00-a85e2390cad5 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:05.472118 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870cf0d-1cae-47c3-8b00-a85e2390cad5 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:05.472392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a870cf0d-1cae-47c3-8b00-a85e2390cad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:05.494710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-a870cf0d-1cae-47c3-8b00-a85e2390cad5 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:05.495930 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a870cf0d-1cae-47c3-8b00-a85e2390cad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:05.505685 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1411/2798] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:05.510682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67581fd9-815d-4a78-a1c2-eadc93bfc0a2 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:05.521960 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67581fd9-815d-4a78-a1c2-eadc93bfc0a2 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:05.526889 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270164b2-e668-4784-b6e6-bad4816e6205 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:05.527530 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270164b2-e668-4784-b6e6-bad4816e6205 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:05.528342 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270164b2-e668-4784-b6e6-bad4816e6205 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:05.528619 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270164b2-e668-4784-b6e6-bad4816e6205 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:05.529311 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270164b2-e668-4784-b6e6-bad4816e6205 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:36:05.529620 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270164b2-e668-4784-b6e6-bad4816e6205 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:05.531280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270164b2-e668-4784-b6e6-bad4816e6205 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:05.543800 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1388/2799] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:36:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:36:05.548254 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870cf0d-1cae-47c3-8b00-a85e2390cad5 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:05.558746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a870cf0d-1cae-47c3-8b00-a85e2390cad5 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:05.564144 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529259ee-dde0-4939-a914-d1854c3995ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:05.564766 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529259ee-dde0-4939-a914-d1854c3995ad admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:05.565040 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529259ee-dde0-4939-a914-d1854c3995ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:05.565312 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529259ee-dde0-4939-a914-d1854c3995ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:05.566020 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529259ee-dde0-4939-a914-d1854c3995ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:05.567951 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529259ee-dde0-4939-a914-d1854c3995ad admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:05.597939 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1412/2800] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:36:05 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:36:05.602253 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270164b2-e668-4784-b6e6-bad4816e6205 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:05.612395 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270164b2-e668-4784-b6e6-bad4816e6205 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:05.670762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6a174-fd3f-44f8-9cab-eb75c521a206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:05.671386 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6a174-fd3f-44f8-9cab-eb75c521a206 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:05.671667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6a174-fd3f-44f8-9cab-eb75c521a206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:05.671944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced6a174-fd3f-44f8-9cab-eb75c521a206 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:05.672609 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6a174-fd3f-44f8-9cab-eb75c521a206 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:05.674536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced6a174-fd3f-44f8-9cab-eb75c521a206 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:05.694701 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1389/2801] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:36:05 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:36:05.699086 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529259ee-dde0-4939-a914-d1854c3995ad admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:05.709379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529259ee-dde0-4939-a914-d1854c3995ad admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:05.713995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396ed40-145c-4071-88cf-13661a1a5526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:05.714618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396ed40-145c-4071-88cf-13661a1a5526 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:05.714909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396ed40-145c-4071-88cf-13661a1a5526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:05.715699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396ed40-145c-4071-88cf-13661a1a5526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:05.716399 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396ed40-145c-4071-88cf-13661a1a5526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:05.717989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396ed40-145c-4071-88cf-13661a1a5526 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:05.727894 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1413/2802] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:05.732416 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6a174-fd3f-44f8-9cab-eb75c521a206 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:05.742639 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced6a174-fd3f-44f8-9cab-eb75c521a206 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:05.747277 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbffb117-c002-48f0-9dae-d8e3dff6c7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:05.747878 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffb117-c002-48f0-9dae-d8e3dff6c7bf admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:05.748156 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffb117-c002-48f0-9dae-d8e3dff6c7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:05.748433 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbffb117-c002-48f0-9dae-d8e3dff6c7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:05.749150 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffb117-c002-48f0-9dae-d8e3dff6c7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:05.750796 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbffb117-c002-48f0-9dae-d8e3dff6c7bf admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:05.761237 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1390/2803] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:05 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:36:05.765499 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396ed40-145c-4071-88cf-13661a1a5526 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:05.775482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396ed40-145c-4071-88cf-13661a1a5526 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:05.780617 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcb531-af6c-4607-a702-730eac43cb64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:05.781266 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcb531-af6c-4607-a702-730eac43cb64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:05.781548 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcb531-af6c-4607-a702-730eac43cb64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:05.781823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8dcb531-af6c-4607-a702-730eac43cb64 admin admin] PATH_INFO: `/v3/projects/b7637dc6acb64ad5bfdf1ae35f8d53c7/users/bd66dd9532634ca88ac9d271915054ed/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:05.796710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcb531-af6c-4607-a702-730eac43cb64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7637dc6acb64ad5bfdf1ae35f8d53c7, user_id=bd66dd9532634ca88ac9d271915054ed, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:05.799420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8dcb531-af6c-4607-a702-730eac43cb64 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:05.812663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1414/2804] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:36:05 2022] PUT /identity/v3/projects/b7637dc6acb64ad5bfdf1ae35f8d53c7/users/bd66dd9532634ca88ac9d271915054ed/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:05.824114 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4aee9-eec0-4649-9383-5d12f7849ffb None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:05.824401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4aee9-eec0-4649-9383-5d12f7849ffb None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:05.824676 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4aee9-eec0-4649-9383-5d12f7849ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:05.853685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0bd4aee9-eec0-4649-9383-5d12f7849ffb None None] MFA Rules not processed for user `bd66dd9532634ca88ac9d271915054ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:05.854838 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0bd4aee9-eec0-4649-9383-5d12f7849ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:05.921121 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1391/2805] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:36:05.932278 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcb531-af6c-4607-a702-730eac43cb64 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:05.934119 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c8dcb531-af6c-4607-a702-730eac43cb64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:06.011878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8dcb531-af6c-4607-a702-730eac43cb64 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:06.018301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7e3411-9468-484f-9b81-cf6a433d3a37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e856fd5aff914cfb8b8dd86b39c89bd0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin', 'ResellerAdmin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:06.018950 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e3411-9468-484f-9b81-cf6a433d3a37 service nova] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:06.019230 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e3411-9468-484f-9b81-cf6a433d3a37 service nova] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:06.019505 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7e3411-9468-484f-9b81-cf6a433d3a37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:06.027255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e3411-9468-484f-9b81-cf6a433d3a37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:06.029444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7e3411-9468-484f-9b81-cf6a433d3a37 service nova] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:06.039223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1415/2806] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:36:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:36:11.295789 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4aee9-eec0-4649-9383-5d12f7849ffb None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:11.313321 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:11.365836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4aee9-eec0-4649-9383-5d12f7849ffb None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:11.370413 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309ef0d-765d-40ba-8b5c-9fe2f2c79bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:11.371084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309ef0d-765d-40ba-8b5c-9fe2f2c79bbd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:11.371360 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309ef0d-765d-40ba-8b5c-9fe2f2c79bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:11.371632 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309ef0d-765d-40ba-8b5c-9fe2f2c79bbd admin admin] PATH_INFO: `/v3/users/bd66dd9532634ca88ac9d271915054ed` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:11.372827 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309ef0d-765d-40ba-8b5c-9fe2f2c79bbd admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd66dd9532634ca88ac9d271915054ed)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:11.374786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309ef0d-765d-40ba-8b5c-9fe2f2c79bbd admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:11.421523 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4309ef0d-765d-40ba-8b5c-9fe2f2c79bbd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd66dd9532634ca88ac9d271915054ed'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:11.429605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4309ef0d-765d-40ba-8b5c-9fe2f2c79bbd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd66dd9532634ca88ac9d271915054ed'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:11.441388 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4309ef0d-765d-40ba-8b5c-9fe2f2c79bbd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd66dd9532634ca88ac9d271915054ed'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:11.442019 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4309ef0d-765d-40ba-8b5c-9fe2f2c79bbd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd66dd9532634ca88ac9d271915054ed'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:11.449085 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4309ef0d-765d-40ba-8b5c-9fe2f2c79bbd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd66dd9532634ca88ac9d271915054ed'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:11.455465 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1392/2807] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:36:11 2022] DELETE /identity/v3/users/bd66dd9532634ca88ac9d271915054ed => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:11.459995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2da64-1bf5-4d23-aa82-dcc713f8d37c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:11.460483 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2da64-1bf5-4d23-aa82-dcc713f8d37c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:11.460592 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be2da64-1bf5-4d23-aa82-dcc713f8d37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:11.479805 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-6be2da64-1bf5-4d23-aa82-dcc713f8d37c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:11.481013 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6be2da64-1bf5-4d23-aa82-dcc713f8d37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:11.508359 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:11.547309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1416/2808] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:11.557524 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309ef0d-765d-40ba-8b5c-9fe2f2c79bbd admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:11.559885 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4309ef0d-765d-40ba-8b5c-9fe2f2c79bbd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:11.618905 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309ef0d-765d-40ba-8b5c-9fe2f2c79bbd admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:11.623756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54ab9f3-c55c-4aca-89a0-d5e7a0daf152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:11.624565 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ab9f3-c55c-4aca-89a0-d5e7a0daf152 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:11.624855 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ab9f3-c55c-4aca-89a0-d5e7a0daf152 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:11.625126 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54ab9f3-c55c-4aca-89a0-d5e7a0daf152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:11.634155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ab9f3-c55c-4aca-89a0-d5e7a0daf152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:11.635631 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54ab9f3-c55c-4aca-89a0-d5e7a0daf152 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:11.645520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1393/2809] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:36:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:36:11.914546 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2da64-1bf5-4d23-aa82-dcc713f8d37c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:11.916119 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-6be2da64-1bf5-4d23-aa82-dcc713f8d37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:11.928583 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be2da64-1bf5-4d23-aa82-dcc713f8d37c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:11.933199 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973c3331-48f6-4eba-8070-0709e2e137c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:11.934433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c3331-48f6-4eba-8070-0709e2e137c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:11.934729 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c3331-48f6-4eba-8070-0709e2e137c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:11.935009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973c3331-48f6-4eba-8070-0709e2e137c0 admin admin] PATH_INFO: `/v3/projects/b7637dc6acb64ad5bfdf1ae35f8d53c7` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:11.936193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c3331-48f6-4eba-8070-0709e2e137c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7637dc6acb64ad5bfdf1ae35f8d53c7)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:11.938652 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973c3331-48f6-4eba-8070-0709e2e137c0 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:11.986217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-973c3331-48f6-4eba-8070-0709e2e137c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7637dc6acb64ad5bfdf1ae35f8d53c7', 'request_id': 'req-973c3331-48f6-4eba-8070-0709e2e137c0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:11.992449 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-973c3331-48f6-4eba-8070-0709e2e137c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7637dc6acb64ad5bfdf1ae35f8d53c7', 'request_id': 'req-973c3331-48f6-4eba-8070-0709e2e137c0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:11.998708 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-973c3331-48f6-4eba-8070-0709e2e137c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7637dc6acb64ad5bfdf1ae35f8d53c7', 'request_id': 'req-973c3331-48f6-4eba-8070-0709e2e137c0'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:12.011613 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-973c3331-48f6-4eba-8070-0709e2e137c0 admin admin] The token cache is being invalidate because project b7637dc6acb64ad5bfdf1ae35f8d53c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:36:12.012064 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-973c3331-48f6-4eba-8070-0709e2e137c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:12.012718 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-973c3331-48f6-4eba-8070-0709e2e137c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:12.014370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1417/2810] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:36:11 2022] DELETE /identity/v3/projects/b7637dc6acb64ad5bfdf1ae35f8d53c7 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:12.019309 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3594ae2-759a-48f9-ab44-49fec9b709f6 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:12.019597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3594ae2-759a-48f9-ab44-49fec9b709f6 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:12.019875 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3594ae2-759a-48f9-ab44-49fec9b709f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:12.038863 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-b3594ae2-759a-48f9-ab44-49fec9b709f6 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:12.039995 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b3594ae2-759a-48f9-ab44-49fec9b709f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:12.075187 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:12.101265 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1394/2811] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:12.109856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c0209-bbe1-40b8-bdcc-11950a09f09b None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:12.110142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c0209-bbe1-40b8-bdcc-11950a09f09b None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:12.110414 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c0209-bbe1-40b8-bdcc-11950a09f09b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:12.131080 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7e4c0209-bbe1-40b8-bdcc-11950a09f09b None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:12.132270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7e4c0209-bbe1-40b8-bdcc-11950a09f09b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:12.140070 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1418/2812] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:12.144295 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3594ae2-759a-48f9-ab44-49fec9b709f6 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:12.154204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3594ae2-759a-48f9-ab44-49fec9b709f6 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:12.159325 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799be4b5-fb4f-4074-bb34-91a821cfea83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:12.160338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799be4b5-fb4f-4074-bb34-91a821cfea83 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:12.160822 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799be4b5-fb4f-4074-bb34-91a821cfea83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:12.161154 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799be4b5-fb4f-4074-bb34-91a821cfea83 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:12.161944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799be4b5-fb4f-4074-bb34-91a821cfea83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:36:12.162305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799be4b5-fb4f-4074-bb34-91a821cfea83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:12.164385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799be4b5-fb4f-4074-bb34-91a821cfea83 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:12.179674 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1395/2813] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:36:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:36:12.185408 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c0209-bbe1-40b8-bdcc-11950a09f09b None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:12.195355 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c0209-bbe1-40b8-bdcc-11950a09f09b None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:12.200410 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdcebf-0de7-4999-9e47-387de50b3310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:12.201015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdcebf-0de7-4999-9e47-387de50b3310 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:12.201297 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdcebf-0de7-4999-9e47-387de50b3310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:12.201569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefdcebf-0de7-4999-9e47-387de50b3310 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:12.202219 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdcebf-0de7-4999-9e47-387de50b3310 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:12.204151 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefdcebf-0de7-4999-9e47-387de50b3310 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:12.230316 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1419/2814] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:36:12 2022] POST /identity/v3/projects => generated 405 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:36:12.235299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799be4b5-fb4f-4074-bb34-91a821cfea83 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:12.246392 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799be4b5-fb4f-4074-bb34-91a821cfea83 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:12.314026 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8f7fc-b65a-4687-af72-ebec5ab5184d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:12.314714 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8f7fc-b65a-4687-af72-ebec5ab5184d admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:12.314863 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8f7fc-b65a-4687-af72-ebec5ab5184d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:12.315117 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab8f7fc-b65a-4687-af72-ebec5ab5184d admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:12.315776 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8f7fc-b65a-4687-af72-ebec5ab5184d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:12.317713 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab8f7fc-b65a-4687-af72-ebec5ab5184d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:12.338568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1396/2815] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:36:12 2022] POST /identity/v3/users => generated 303 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:36:12.342848 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdcebf-0de7-4999-9e47-387de50b3310 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:12.352984 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefdcebf-0de7-4999-9e47-387de50b3310 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:12.357583 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af595e8-5b69-4034-813a-9991cbde2969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:12.358167 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af595e8-5b69-4034-813a-9991cbde2969 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:12.358443 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af595e8-5b69-4034-813a-9991cbde2969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:12.358743 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af595e8-5b69-4034-813a-9991cbde2969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:12.359429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af595e8-5b69-4034-813a-9991cbde2969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:12.360988 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af595e8-5b69-4034-813a-9991cbde2969 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:12.371918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1420/2816] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:12.375718 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8f7fc-b65a-4687-af72-ebec5ab5184d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:12.385824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab8f7fc-b65a-4687-af72-ebec5ab5184d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:12.391111 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750c58a8-f981-47bb-b6bc-131147790b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:12.391723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c58a8-f981-47bb-b6bc-131147790b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:12.392038 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c58a8-f981-47bb-b6bc-131147790b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:12.392312 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750c58a8-f981-47bb-b6bc-131147790b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:12.393001 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c58a8-f981-47bb-b6bc-131147790b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:12.394635 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750c58a8-f981-47bb-b6bc-131147790b38 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:12.405372 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1397/2817] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:12.409531 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af595e8-5b69-4034-813a-9991cbde2969 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:12.419831 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af595e8-5b69-4034-813a-9991cbde2969 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:12.424499 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314ab2f-1f37-4b7c-95c9-102c917afbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:12.425147 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314ab2f-1f37-4b7c-95c9-102c917afbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:12.425427 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314ab2f-1f37-4b7c-95c9-102c917afbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:12.425696 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314ab2f-1f37-4b7c-95c9-102c917afbfb admin admin] PATH_INFO: `/v3/projects/f1e6cb910ee04b34a80d9bc8f9d71daf/users/e546c563581c4754a62f3cd3ac198d43/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:12.442224 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314ab2f-1f37-4b7c-95c9-102c917afbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e6cb910ee04b34a80d9bc8f9d71daf, user_id=e546c563581c4754a62f3cd3ac198d43, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:12.444920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d314ab2f-1f37-4b7c-95c9-102c917afbfb admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:12.459615 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1421/2818] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:36:12 2022] PUT /identity/v3/projects/f1e6cb910ee04b34a80d9bc8f9d71daf/users/e546c563581c4754a62f3cd3ac198d43/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:12.471756 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b276e09-70ba-42a0-80a6-f9a2e73d1e13 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:12.472044 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b276e09-70ba-42a0-80a6-f9a2e73d1e13 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:12.472316 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b276e09-70ba-42a0-80a6-f9a2e73d1e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:12.499920 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-7b276e09-70ba-42a0-80a6-f9a2e73d1e13 None None] MFA Rules not processed for user `e546c563581c4754a62f3cd3ac198d43`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:12.501167 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-7b276e09-70ba-42a0-80a6-f9a2e73d1e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:12.564400 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1398/2819] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:12.568885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314ab2f-1f37-4b7c-95c9-102c917afbfb admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:12.620385 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:12.633823 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314ab2f-1f37-4b7c-95c9-102c917afbfb admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:12.639558 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc5f45-76f1-4a16-af0b-35e7b1062d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:12.640162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc5f45-76f1-4a16-af0b-35e7b1062d92 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:12.640455 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc5f45-76f1-4a16-af0b-35e7b1062d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:12.640703 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fc5f45-76f1-4a16-af0b-35e7b1062d92 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:12.641350 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc5f45-76f1-4a16-af0b-35e7b1062d92 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:12.643298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fc5f45-76f1-4a16-af0b-35e7b1062d92 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:12.670117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1422/2820] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:36:12 2022] POST /identity/v3/projects => generated 405 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:36:12.675164 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b276e09-70ba-42a0-80a6-f9a2e73d1e13 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:12.686932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b276e09-70ba-42a0-80a6-f9a2e73d1e13 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:12.718976 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:12.745050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f65c4-374a-4622-ba9a-dc1d9933423f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:12.745665 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f65c4-374a-4622-ba9a-dc1d9933423f admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:12.745944 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f65c4-374a-4622-ba9a-dc1d9933423f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:12.746217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329f65c4-374a-4622-ba9a-dc1d9933423f admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:12.747558 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f65c4-374a-4622-ba9a-dc1d9933423f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:12.749492 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329f65c4-374a-4622-ba9a-dc1d9933423f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:12.770511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1399/2821] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:36:12 2022] POST /identity/v3/users => generated 309 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:36:12.774709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc5f45-76f1-4a16-af0b-35e7b1062d92 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:12.785050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fc5f45-76f1-4a16-af0b-35e7b1062d92 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:12.789498 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e1a6e-8758-43c3-a387-140ddff530af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:12.790093 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e1a6e-8758-43c3-a387-140ddff530af admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:12.790366 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e1a6e-8758-43c3-a387-140ddff530af admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:12.790673 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047e1a6e-8758-43c3-a387-140ddff530af admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:12.791352 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e1a6e-8758-43c3-a387-140ddff530af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:12.792918 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047e1a6e-8758-43c3-a387-140ddff530af admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:12.804177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1423/2822] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:12.808539 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f65c4-374a-4622-ba9a-dc1d9933423f admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:12.819088 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329f65c4-374a-4622-ba9a-dc1d9933423f admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:12.823853 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720b18a-1590-4423-8bc5-4202df809468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:12.824505 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b18a-1590-4423-8bc5-4202df809468 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:12.824782 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b18a-1590-4423-8bc5-4202df809468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:12.825054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4720b18a-1590-4423-8bc5-4202df809468 admin admin] PATH_INFO: `/v3/projects/54934665fc9248b298756fd07793a197/users/af16a2dec4c04471b61d751a8cbadd57/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:12.840891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720b18a-1590-4423-8bc5-4202df809468 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54934665fc9248b298756fd07793a197, user_id=af16a2dec4c04471b61d751a8cbadd57, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:12.843576 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4720b18a-1590-4423-8bc5-4202df809468 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:12.856846 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1400/2823] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:36:12 2022] PUT /identity/v3/projects/54934665fc9248b298756fd07793a197/users/af16a2dec4c04471b61d751a8cbadd57/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:36:12.861066 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e1a6e-8758-43c3-a387-140ddff530af admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:12.872283 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047e1a6e-8758-43c3-a387-140ddff530af admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:12.927162 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0c8234-7cd5-4d61-bdb1-962c3748b22c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:12.927766 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c8234-7cd5-4d61-bdb1-962c3748b22c admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:12.928049 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c8234-7cd5-4d61-bdb1-962c3748b22c admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:12.928321 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0c8234-7cd5-4d61-bdb1-962c3748b22c admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:12.929004 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c8234-7cd5-4d61-bdb1-962c3748b22c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:12.930606 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0c8234-7cd5-4d61-bdb1-962c3748b22c admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:12.940830 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1424/2824] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:12.945006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720b18a-1590-4423-8bc5-4202df809468 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:12.956446 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4720b18a-1590-4423-8bc5-4202df809468 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:12.961039 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cafc4-7aa2-401b-a37e-ac7b64a0d2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:12.961689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cafc4-7aa2-401b-a37e-ac7b64a0d2c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:12.961965 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cafc4-7aa2-401b-a37e-ac7b64a0d2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:12.962238 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cafc4-7aa2-401b-a37e-ac7b64a0d2c6 admin admin] PATH_INFO: `/v3/projects/54934665fc9248b298756fd07793a197/users/af16a2dec4c04471b61d751a8cbadd57/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:12.965234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413cafc4-7aa2-401b-a37e-ac7b64a0d2c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=54934665fc9248b298756fd07793a197, user_id=af16a2dec4c04471b61d751a8cbadd57, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:12.967911 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-413cafc4-7aa2-401b-a37e-ac7b64a0d2c6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:12.978138 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1401/2825] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:36:12 2022] PUT /identity/v3/projects/54934665fc9248b298756fd07793a197/users/af16a2dec4c04471b61d751a8cbadd57/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:36:13.049206 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe828b87-e9dc-471d-8b7f-6eef20f4d4ab None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:13.049488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe828b87-e9dc-471d-8b7f-6eef20f4d4ab None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:13.049758 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe828b87-e9dc-471d-8b7f-6eef20f4d4ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:13.078076 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-fe828b87-e9dc-471d-8b7f-6eef20f4d4ab None None] MFA Rules not processed for user `af16a2dec4c04471b61d751a8cbadd57`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:13.079214 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-fe828b87-e9dc-471d-8b7f-6eef20f4d4ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:13.146044 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1425/2826] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:13 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:13.157211 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cafc4-7aa2-401b-a37e-ac7b64a0d2c6 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:13.158895 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-413cafc4-7aa2-401b-a37e-ac7b64a0d2c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:13.214825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413cafc4-7aa2-401b-a37e-ac7b64a0d2c6 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:13.219181 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952a0cb0-4a8f-439f-ac8b-c36ac4ecb756 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:13.219786 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0cb0-4a8f-439f-ac8b-c36ac4ecb756 service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:13.220067 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0cb0-4a8f-439f-ac8b-c36ac4ecb756 service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:13.220334 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952a0cb0-4a8f-439f-ac8b-c36ac4ecb756 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:13.229259 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a0cb0-4a8f-439f-ac8b-c36ac4ecb756 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:13.231264 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952a0cb0-4a8f-439f-ac8b-c36ac4ecb756 service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:13.240697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1402/2827] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:36:13 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:36:13.388332 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe828b87-e9dc-471d-8b7f-6eef20f4d4ab None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:13.440769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:13.457571 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe828b87-e9dc-471d-8b7f-6eef20f4d4ab None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:13.462193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13c2a9-2967-4b40-9933-aadf9c777985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:13.462855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13c2a9-2967-4b40-9933-aadf9c777985 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:13.463135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13c2a9-2967-4b40-9933-aadf9c777985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:13.463430 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f13c2a9-2967-4b40-9933-aadf9c777985 admin admin] PATH_INFO: `/v3/users/e546c563581c4754a62f3cd3ac198d43` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:13.464602 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13c2a9-2967-4b40-9933-aadf9c777985 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e546c563581c4754a62f3cd3ac198d43)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:13.467163 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f13c2a9-2967-4b40-9933-aadf9c777985 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:13.514012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8f13c2a9-2967-4b40-9933-aadf9c777985 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e546c563581c4754a62f3cd3ac198d43'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:13.525645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8f13c2a9-2967-4b40-9933-aadf9c777985 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e546c563581c4754a62f3cd3ac198d43'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:13.533370 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8f13c2a9-2967-4b40-9933-aadf9c777985 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e546c563581c4754a62f3cd3ac198d43'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:13.534085 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8f13c2a9-2967-4b40-9933-aadf9c777985 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e546c563581c4754a62f3cd3ac198d43'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:13.541670 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-8f13c2a9-2967-4b40-9933-aadf9c777985 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e546c563581c4754a62f3cd3ac198d43'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:13.547746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1426/2828] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:36:13 2022] DELETE /identity/v3/users/e546c563581c4754a62f3cd3ac198d43 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:13.552408 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e343ee-6a3a-465e-a875-0bed5079cf24 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:13.552876 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e343ee-6a3a-465e-a875-0bed5079cf24 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:13.552977 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e343ee-6a3a-465e-a875-0bed5079cf24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:13.571330 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-22e343ee-6a3a-465e-a875-0bed5079cf24 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:13.572771 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-22e343ee-6a3a-465e-a875-0bed5079cf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:13.630146 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1403/2829] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:13.641255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13c2a9-2967-4b40-9933-aadf9c777985 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:13.642859 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-8f13c2a9-2967-4b40-9933-aadf9c777985 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:13.704197 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f13c2a9-2967-4b40-9933-aadf9c777985 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:13.707925 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2adc68-6e03-4956-8b19-88267bb2a19d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:13.708534 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2adc68-6e03-4956-8b19-88267bb2a19d service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:13.708813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2adc68-6e03-4956-8b19-88267bb2a19d service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:13.709085 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2adc68-6e03-4956-8b19-88267bb2a19d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:13.721424 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2adc68-6e03-4956-8b19-88267bb2a19d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:13.722914 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2adc68-6e03-4956-8b19-88267bb2a19d service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:13.733994 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1427/2830] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:36:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:36:14.018431 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e343ee-6a3a-465e-a875-0bed5079cf24 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:14.019890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-22e343ee-6a3a-465e-a875-0bed5079cf24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:14.032746 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e343ee-6a3a-465e-a875-0bed5079cf24 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:14.038620 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:14.038808 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:14.038913 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:14.039182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6 admin admin] PATH_INFO: `/v3/projects/f1e6cb910ee04b34a80d9bc8f9d71daf` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:14.040385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1e6cb910ee04b34a80d9bc8f9d71daf)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:14.042375 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:14.074751 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:14.094030 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e6cb910ee04b34a80d9bc8f9d71daf', 'request_id': 'req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:14.099605 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e6cb910ee04b34a80d9bc8f9d71daf', 'request_id': 'req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:14.108081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e6cb910ee04b34a80d9bc8f9d71daf', 'request_id': 'req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:14.119665 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6 admin admin] The token cache is being invalidate because project f1e6cb910ee04b34a80d9bc8f9d71daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:36:14.119962 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:14.120571 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:14.122110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1404/2831] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:36:14 2022] DELETE /identity/v3/projects/f1e6cb910ee04b34a80d9bc8f9d71daf => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:14.126112 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2adc68-6e03-4956-8b19-88267bb2a19d service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:14.136711 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2adc68-6e03-4956-8b19-88267bb2a19d service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:14.194121 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b4ee3a-ece5-411c-81d0-0c14b76a53db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:14.194797 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4ee3a-ece5-411c-81d0-0c14b76a53db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:14.195094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4ee3a-ece5-411c-81d0-0c14b76a53db admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:14.195351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b4ee3a-ece5-411c-81d0-0c14b76a53db admin admin] PATH_INFO: `/v3/users/af16a2dec4c04471b61d751a8cbadd57` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:14.196504 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4ee3a-ece5-411c-81d0-0c14b76a53db admin admin] RBAC: Authorizing `identity:delete_user(user_id=af16a2dec4c04471b61d751a8cbadd57)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:14.198721 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b4ee3a-ece5-411c-81d0-0c14b76a53db admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:14.209306 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:14.245862 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-20b4ee3a-ece5-411c-81d0-0c14b76a53db admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af16a2dec4c04471b61d751a8cbadd57'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:14.257563 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-20b4ee3a-ece5-411c-81d0-0c14b76a53db admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af16a2dec4c04471b61d751a8cbadd57'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:14.264775 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-20b4ee3a-ece5-411c-81d0-0c14b76a53db admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af16a2dec4c04471b61d751a8cbadd57'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:14.265439 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-20b4ee3a-ece5-411c-81d0-0c14b76a53db admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af16a2dec4c04471b61d751a8cbadd57'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:14.272334 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-20b4ee3a-ece5-411c-81d0-0c14b76a53db admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af16a2dec4c04471b61d751a8cbadd57'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:14.279012 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1428/2832] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:36:14 2022] DELETE /identity/v3/users/af16a2dec4c04471b61d751a8cbadd57 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:14.551656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:14.553127 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:14.566694 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbd4ed7-1e8f-406f-a4bf-0152565cb7b6 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:14.631889 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7fbed5a-a28b-4f9d-ba00-848af20e4868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:14.632540 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbed5a-a28b-4f9d-ba00-848af20e4868 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:14.632821 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbed5a-a28b-4f9d-ba00-848af20e4868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:14.633097 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7fbed5a-a28b-4f9d-ba00-848af20e4868 admin admin] PATH_INFO: `/v3/projects/54934665fc9248b298756fd07793a197` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:14.634251 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbed5a-a28b-4f9d-ba00-848af20e4868 admin admin] RBAC: Authorizing `identity:delete_project(project_id=54934665fc9248b298756fd07793a197)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:14.636208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7fbed5a-a28b-4f9d-ba00-848af20e4868 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:14.681978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c7fbed5a-a28b-4f9d-ba00-848af20e4868 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '54934665fc9248b298756fd07793a197', 'request_id': 'req-c7fbed5a-a28b-4f9d-ba00-848af20e4868'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:14.688035 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c7fbed5a-a28b-4f9d-ba00-848af20e4868 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '54934665fc9248b298756fd07793a197', 'request_id': 'req-c7fbed5a-a28b-4f9d-ba00-848af20e4868'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:14.695560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c7fbed5a-a28b-4f9d-ba00-848af20e4868 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '54934665fc9248b298756fd07793a197', 'request_id': 'req-c7fbed5a-a28b-4f9d-ba00-848af20e4868'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:14.707603 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c7fbed5a-a28b-4f9d-ba00-848af20e4868 admin admin] The token cache is being invalidate because project 54934665fc9248b298756fd07793a197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:36:14.707885 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c7fbed5a-a28b-4f9d-ba00-848af20e4868 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:14.708525 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-c7fbed5a-a28b-4f9d-ba00-848af20e4868 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:14.710024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1405/2833] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:36:14 2022] DELETE /identity/v3/projects/54934665fc9248b298756fd07793a197 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:14.714899 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf4840-b934-4799-a33a-7b5ff558aee9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:14.715399 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf4840-b934-4799-a33a-7b5ff558aee9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:14.715500 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cf4840-b934-4799-a33a-7b5ff558aee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:14.734432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-23cf4840-b934-4799-a33a-7b5ff558aee9 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:14.735658 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-23cf4840-b934-4799-a33a-7b5ff558aee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:14.795789 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1429/2834] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:14.803604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d0ccb-1925-4b49-b987-714cd4e52441 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:14.803891 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d0ccb-1925-4b49-b987-714cd4e52441 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:14.804165 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6d0ccb-1925-4b49-b987-714cd4e52441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:14.824197 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-8d6d0ccb-1925-4b49-b987-714cd4e52441 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:14.825989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8d6d0ccb-1925-4b49-b987-714cd4e52441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:14.834002 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1406/2835] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:14.838217 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf4840-b934-4799-a33a-7b5ff558aee9 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:14.848057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cf4840-b934-4799-a33a-7b5ff558aee9 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:14.852655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637de48-509e-4252-80f5-7c0ca1beb374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:14.853250 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637de48-509e-4252-80f5-7c0ca1beb374 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:14.853529 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637de48-509e-4252-80f5-7c0ca1beb374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:14.853801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637de48-509e-4252-80f5-7c0ca1beb374 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:14.854493 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637de48-509e-4252-80f5-7c0ca1beb374 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:36:14.854828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637de48-509e-4252-80f5-7c0ca1beb374 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:14.856413 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637de48-509e-4252-80f5-7c0ca1beb374 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:14.867812 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1430/2836] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:36:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:36:14.872580 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d0ccb-1925-4b49-b987-714cd4e52441 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:14.881802 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6d0ccb-1925-4b49-b987-714cd4e52441 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:14.886473 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c69686-0b4f-4be6-bef9-8745bd2f251d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:14.887837 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c69686-0b4f-4be6-bef9-8745bd2f251d admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:14.888117 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c69686-0b4f-4be6-bef9-8745bd2f251d admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:14.888392 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c69686-0b4f-4be6-bef9-8745bd2f251d admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:14.889144 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c69686-0b4f-4be6-bef9-8745bd2f251d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:14.891095 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c69686-0b4f-4be6-bef9-8745bd2f251d admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:14.918805 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1407/2837] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:36:14 2022] POST /identity/v3/projects => generated 405 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:36:14.923065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637de48-509e-4252-80f5-7c0ca1beb374 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:14.934850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637de48-509e-4252-80f5-7c0ca1beb374 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:14.996103 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f14dd-4da1-4275-85f7-06563e16f493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:14.997268 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f14dd-4da1-4275-85f7-06563e16f493 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:14.997760 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f14dd-4da1-4275-85f7-06563e16f493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:14.998039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184f14dd-4da1-4275-85f7-06563e16f493 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:14.998769 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f14dd-4da1-4275-85f7-06563e16f493 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:15.000684 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184f14dd-4da1-4275-85f7-06563e16f493 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:15.024032 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1431/2838] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:36:14 2022] POST /identity/v3/users => generated 303 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:36:15.028723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c69686-0b4f-4be6-bef9-8745bd2f251d admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:15.039064 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c69686-0b4f-4be6-bef9-8745bd2f251d admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:15.043716 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed4984-8ebb-4e9d-94a1-f82313bc01a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:15.044319 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed4984-8ebb-4e9d-94a1-f82313bc01a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:15.044601 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed4984-8ebb-4e9d-94a1-f82313bc01a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:15.044870 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ed4984-8ebb-4e9d-94a1-f82313bc01a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:15.045559 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed4984-8ebb-4e9d-94a1-f82313bc01a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:15.047214 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ed4984-8ebb-4e9d-94a1-f82313bc01a7 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:15.056948 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1408/2839] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:15.060736 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f14dd-4da1-4275-85f7-06563e16f493 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:15.066959 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:15.070800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184f14dd-4da1-4275-85f7-06563e16f493 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:15.078337 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d285cea2-4dbf-4700-b92d-37901f56c771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:15.078987 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285cea2-4dbf-4700-b92d-37901f56c771 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:15.079269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285cea2-4dbf-4700-b92d-37901f56c771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:15.079553 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d285cea2-4dbf-4700-b92d-37901f56c771 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:15.080220 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285cea2-4dbf-4700-b92d-37901f56c771 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:15.081801 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d285cea2-4dbf-4700-b92d-37901f56c771 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:15.094373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1432/2840] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:15 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:15.098897 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed4984-8ebb-4e9d-94a1-f82313bc01a7 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:15.105306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:15.110157 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ed4984-8ebb-4e9d-94a1-f82313bc01a7 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:15.116166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f3b4d-8611-4ff5-b8e1-668aca99d45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:15.116903 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f3b4d-8611-4ff5-b8e1-668aca99d45a admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:15.117338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f3b4d-8611-4ff5-b8e1-668aca99d45a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:15.117824 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f3b4d-8611-4ff5-b8e1-668aca99d45a admin admin] PATH_INFO: `/v3/projects/cfc9310588644e779ab9c29b9a4d236d/users/73c8ce2ab9f4440e8171e15d90a06560/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:15.132405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f3b4d-8611-4ff5-b8e1-668aca99d45a admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfc9310588644e779ab9c29b9a4d236d, user_id=73c8ce2ab9f4440e8171e15d90a06560, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:15.135109 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03f3b4d-8611-4ff5-b8e1-668aca99d45a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:15.148280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1409/2841] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:36:15 2022] PUT /identity/v3/projects/cfc9310588644e779ab9c29b9a4d236d/users/73c8ce2ab9f4440e8171e15d90a06560/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:15.153862 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945de01-df98-4aca-8ec3-f776697125e9 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:15.154150 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945de01-df98-4aca-8ec3-f776697125e9 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:15.154424 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b945de01-df98-4aca-8ec3-f776697125e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:15.172709 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-b945de01-df98-4aca-8ec3-f776697125e9 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:15.173910 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b945de01-df98-4aca-8ec3-f776697125e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:15.233094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1433/2842] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:15.242440 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f3b4d-8611-4ff5-b8e1-668aca99d45a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:15.244182 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f03f3b4d-8611-4ff5-b8e1-668aca99d45a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:15.301401 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f3b4d-8611-4ff5-b8e1-668aca99d45a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:15.305065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fa05f-b570-4a24-abcb-17afc4cd0ced service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:15.305687 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fa05f-b570-4a24-abcb-17afc4cd0ced service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:15.305966 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fa05f-b570-4a24-abcb-17afc4cd0ced service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:15.306241 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2fa05f-b570-4a24-abcb-17afc4cd0ced service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:15.315155 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fa05f-b570-4a24-abcb-17afc4cd0ced service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:15.316600 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2fa05f-b570-4a24-abcb-17afc4cd0ced service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:15.326371 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1410/2843] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:36:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:36:15.944981 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce147c-4c72-4c42-8f92-7a95def8216c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:15.945463 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce147c-4c72-4c42-8f92-7a95def8216c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:15.945564 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ce147c-4c72-4c42-8f92-7a95def8216c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:15.974752 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-d0ce147c-4c72-4c42-8f92-7a95def8216c None None] MFA Rules not processed for user `73c8ce2ab9f4440e8171e15d90a06560`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:15.976667 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-d0ce147c-4c72-4c42-8f92-7a95def8216c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:16.053995 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1434/2844] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:15 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:16.058468 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fa05f-b570-4a24-abcb-17afc4cd0ced service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:16.068773 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2fa05f-b570-4a24-abcb-17afc4cd0ced service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:16.073645 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90062e07-eaf1-4513-a866-2658e0093892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:16.074335 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90062e07-eaf1-4513-a866-2658e0093892 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:16.074635 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90062e07-eaf1-4513-a866-2658e0093892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:16.075842 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90062e07-eaf1-4513-a866-2658e0093892 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:16.076178 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90062e07-eaf1-4513-a866-2658e0093892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:16.078297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90062e07-eaf1-4513-a866-2658e0093892 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:16.106502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1411/2845] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:36:16 2022] POST /identity/v3/projects => generated 405 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:36:16.110523 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce147c-4c72-4c42-8f92-7a95def8216c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:16.121152 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ce147c-4c72-4c42-8f92-7a95def8216c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:16.178719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed574b73-fc11-4ec6-88b9-128ad732599f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:16.179392 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed574b73-fc11-4ec6-88b9-128ad732599f admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:16.179717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed574b73-fc11-4ec6-88b9-128ad732599f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:16.180042 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed574b73-fc11-4ec6-88b9-128ad732599f admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:16.180739 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed574b73-fc11-4ec6-88b9-128ad732599f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:16.182746 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed574b73-fc11-4ec6-88b9-128ad732599f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:16.205339 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1435/2846] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:36:16 2022] POST /identity/v3/users => generated 309 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:36:16.209339 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90062e07-eaf1-4513-a866-2658e0093892 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:16.221320 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90062e07-eaf1-4513-a866-2658e0093892 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:16.225927 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7b572-2392-499f-8bb9-e1accfc93cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:16.226537 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7b572-2392-499f-8bb9-e1accfc93cb2 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:16.226852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7b572-2392-499f-8bb9-e1accfc93cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:16.227130 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7b572-2392-499f-8bb9-e1accfc93cb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:16.227825 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7b572-2392-499f-8bb9-e1accfc93cb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:16.229438 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7b572-2392-499f-8bb9-e1accfc93cb2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:16.243332 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1412/2847] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:16.247447 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed574b73-fc11-4ec6-88b9-128ad732599f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:16.258972 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed574b73-fc11-4ec6-88b9-128ad732599f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:16.263933 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73ecbb-6390-4b42-9d64-c3371e18ac0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:16.264624 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73ecbb-6390-4b42-9d64-c3371e18ac0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:16.264904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73ecbb-6390-4b42-9d64-c3371e18ac0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:16.265177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a73ecbb-6390-4b42-9d64-c3371e18ac0b admin admin] PATH_INFO: `/v3/projects/1e3b1143e7264ce4b8c843dfe84a5dd2/users/fae257a6098d4b91ad574395f73bdb09/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:16.277719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:16.284167 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73ecbb-6390-4b42-9d64-c3371e18ac0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3b1143e7264ce4b8c843dfe84a5dd2, user_id=fae257a6098d4b91ad574395f73bdb09, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:16.287555 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a73ecbb-6390-4b42-9d64-c3371e18ac0b admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:16.303228 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1436/2848] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:36:16 2022] PUT /identity/v3/projects/1e3b1143e7264ce4b8c843dfe84a5dd2/users/fae257a6098d4b91ad574395f73bdb09/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:16.306961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7b572-2392-499f-8bb9-e1accfc93cb2 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:16.317200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7b572-2392-499f-8bb9-e1accfc93cb2 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:16.372984 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5349a8-4ba5-4d73-9a8e-ab308d326679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:16.373524 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5349a8-4ba5-4d73-9a8e-ab308d326679 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:16.373807 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5349a8-4ba5-4d73-9a8e-ab308d326679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:16.374083 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5349a8-4ba5-4d73-9a8e-ab308d326679 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:16.374792 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5349a8-4ba5-4d73-9a8e-ab308d326679 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:16.376402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5349a8-4ba5-4d73-9a8e-ab308d326679 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:16.385997 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1413/2849] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:16 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:36:16.391361 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73ecbb-6390-4b42-9d64-c3371e18ac0b admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:16.401655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a73ecbb-6390-4b42-9d64-c3371e18ac0b admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:16.406814 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29229594-dda3-4e1f-b419-3794467e6764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:16.407457 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29229594-dda3-4e1f-b419-3794467e6764 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:16.407731 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29229594-dda3-4e1f-b419-3794467e6764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:16.407996 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29229594-dda3-4e1f-b419-3794467e6764 admin admin] PATH_INFO: `/v3/projects/1e3b1143e7264ce4b8c843dfe84a5dd2/users/fae257a6098d4b91ad574395f73bdb09/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:16.409934 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29229594-dda3-4e1f-b419-3794467e6764 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e3b1143e7264ce4b8c843dfe84a5dd2, user_id=fae257a6098d4b91ad574395f73bdb09, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:16.412576 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29229594-dda3-4e1f-b419-3794467e6764 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:16.422813 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1437/2850] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:36:16 2022] PUT /identity/v3/projects/1e3b1143e7264ce4b8c843dfe84a5dd2/users/fae257a6098d4b91ad574395f73bdb09/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:17.055691 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195217e3-c31b-42eb-9be1-b6150a8d03d3 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:17.055978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195217e3-c31b-42eb-9be1-b6150a8d03d3 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:17.056252 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195217e3-c31b-42eb-9be1-b6150a8d03d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:17.085385 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-195217e3-c31b-42eb-9be1-b6150a8d03d3 None None] MFA Rules not processed for user `fae257a6098d4b91ad574395f73bdb09`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:17.086885 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-195217e3-c31b-42eb-9be1-b6150a8d03d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:17.121804 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:17.163006 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1414/2851] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:17 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:18.378135 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29229594-dda3-4e1f-b419-3794467e6764 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:18.379949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-29229594-dda3-4e1f-b419-3794467e6764 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:18.444999 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195217e3-c31b-42eb-9be1-b6150a8d03d3 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:18.465437 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29229594-dda3-4e1f-b419-3794467e6764 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:18.471271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0b943-4e08-41c9-8b43-47e587608085 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210ee6c390849e7a630a677ec52e966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:18.472011 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0b943-4e08-41c9-8b43-47e587608085 service placement] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:18.472295 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0b943-4e08-41c9-8b43-47e587608085 service placement] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:18.472569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e0b943-4e08-41c9-8b43-47e587608085 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:18.474333 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-b7e0b943-4e08-41c9-8b43-47e587608085 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:18.487289 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0b943-4e08-41c9-8b43-47e587608085 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:18.489195 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e0b943-4e08-41c9-8b43-47e587608085 service placement] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:18.499745 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1438/2852] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:36:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:36:18.510337 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195217e3-c31b-42eb-9be1-b6150a8d03d3 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:18.515283 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cab090-e8be-4662-8496-41aab26cbf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:18.515928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cab090-e8be-4662-8496-41aab26cbf4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:18.516208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cab090-e8be-4662-8496-41aab26cbf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:18.516482 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7cab090-e8be-4662-8496-41aab26cbf4b admin admin] PATH_INFO: `/v3/users/73c8ce2ab9f4440e8171e15d90a06560` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:18.517656 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cab090-e8be-4662-8496-41aab26cbf4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c8ce2ab9f4440e8171e15d90a06560)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:18.519690 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7cab090-e8be-4662-8496-41aab26cbf4b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:18.565411 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a7cab090-e8be-4662-8496-41aab26cbf4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c8ce2ab9f4440e8171e15d90a06560'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:18.573414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a7cab090-e8be-4662-8496-41aab26cbf4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c8ce2ab9f4440e8171e15d90a06560'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:18.585572 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a7cab090-e8be-4662-8496-41aab26cbf4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c8ce2ab9f4440e8171e15d90a06560'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:18.586216 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a7cab090-e8be-4662-8496-41aab26cbf4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c8ce2ab9f4440e8171e15d90a06560'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:18.593945 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-a7cab090-e8be-4662-8496-41aab26cbf4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c8ce2ab9f4440e8171e15d90a06560'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:18.599887 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1415/2853] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:36:18 2022] DELETE /identity/v3/users/73c8ce2ab9f4440e8171e15d90a06560 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:18.784606 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0b943-4e08-41c9-8b43-47e587608085 service placement] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:18.795315 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e0b943-4e08-41c9-8b43-47e587608085 service placement] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:18.855196 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde59383-070d-4c8c-bbab-d78a5f79f9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:18.855845 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde59383-070d-4c8c-bbab-d78a5f79f9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:18.856103 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde59383-070d-4c8c-bbab-d78a5f79f9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:18.856371 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde59383-070d-4c8c-bbab-d78a5f79f9b4 admin admin] PATH_INFO: `/v3/projects/cfc9310588644e779ab9c29b9a4d236d` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:18.857501 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde59383-070d-4c8c-bbab-d78a5f79f9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfc9310588644e779ab9c29b9a4d236d)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:18.859494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde59383-070d-4c8c-bbab-d78a5f79f9b4 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:18.905614 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cde59383-070d-4c8c-bbab-d78a5f79f9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfc9310588644e779ab9c29b9a4d236d', 'request_id': 'req-cde59383-070d-4c8c-bbab-d78a5f79f9b4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:18.911654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cde59383-070d-4c8c-bbab-d78a5f79f9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfc9310588644e779ab9c29b9a4d236d', 'request_id': 'req-cde59383-070d-4c8c-bbab-d78a5f79f9b4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:18.917239 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cde59383-070d-4c8c-bbab-d78a5f79f9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfc9310588644e779ab9c29b9a4d236d', 'request_id': 'req-cde59383-070d-4c8c-bbab-d78a5f79f9b4'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:18.920756 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:18.930298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cde59383-070d-4c8c-bbab-d78a5f79f9b4 admin admin] The token cache is being invalidate because project cfc9310588644e779ab9c29b9a4d236d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:36:18.930829 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cde59383-070d-4c8c-bbab-d78a5f79f9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:18.931748 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-cde59383-070d-4c8c-bbab-d78a5f79f9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:18.933349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1439/2854] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:36:18 2022] DELETE /identity/v3/projects/cfc9310588644e779ab9c29b9a4d236d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:18.937611 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cab090-e8be-4662-8496-41aab26cbf4b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:18.938968 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-a7cab090-e8be-4662-8496-41aab26cbf4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:18.952705 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7cab090-e8be-4662-8496-41aab26cbf4b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:19.003931 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:19.016989 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ce18be-7d7b-4486-89ed-77bfa9a7b611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:19.017667 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce18be-7d7b-4486-89ed-77bfa9a7b611 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:19.017951 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce18be-7d7b-4486-89ed-77bfa9a7b611 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:19.018217 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ce18be-7d7b-4486-89ed-77bfa9a7b611 admin admin] PATH_INFO: `/v3/users/fae257a6098d4b91ad574395f73bdb09` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:19.019414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce18be-7d7b-4486-89ed-77bfa9a7b611 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fae257a6098d4b91ad574395f73bdb09)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:19.021344 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ce18be-7d7b-4486-89ed-77bfa9a7b611 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:19.070352 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-86ce18be-7d7b-4486-89ed-77bfa9a7b611 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fae257a6098d4b91ad574395f73bdb09'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:19.079232 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-86ce18be-7d7b-4486-89ed-77bfa9a7b611 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fae257a6098d4b91ad574395f73bdb09'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:19.091584 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-86ce18be-7d7b-4486-89ed-77bfa9a7b611 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fae257a6098d4b91ad574395f73bdb09'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:19.092240 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-86ce18be-7d7b-4486-89ed-77bfa9a7b611 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fae257a6098d4b91ad574395f73bdb09'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:19.099170 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-86ce18be-7d7b-4486-89ed-77bfa9a7b611 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fae257a6098d4b91ad574395f73bdb09'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:19.105027 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1416/2855] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:36:18 2022] DELETE /identity/v3/users/fae257a6098d4b91ad574395f73bdb09 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:19.276177 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde59383-070d-4c8c-bbab-d78a5f79f9b4 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:19.277645 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-cde59383-070d-4c8c-bbab-d78a5f79f9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:19.294193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde59383-070d-4c8c-bbab-d78a5f79f9b4 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:19.352063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0efd42-db66-46e3-9ffc-a45dd2f8220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:19.352699 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0efd42-db66-46e3-9ffc-a45dd2f8220d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:19.352979 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0efd42-db66-46e3-9ffc-a45dd2f8220d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:19.353250 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0efd42-db66-46e3-9ffc-a45dd2f8220d admin admin] PATH_INFO: `/v3/projects/1e3b1143e7264ce4b8c843dfe84a5dd2` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:19.354383 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0efd42-db66-46e3-9ffc-a45dd2f8220d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e3b1143e7264ce4b8c843dfe84a5dd2)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:19.356309 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad0efd42-db66-46e3-9ffc-a45dd2f8220d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:19.402850 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ad0efd42-db66-46e3-9ffc-a45dd2f8220d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e3b1143e7264ce4b8c843dfe84a5dd2', 'request_id': 'req-ad0efd42-db66-46e3-9ffc-a45dd2f8220d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:19.409205 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ad0efd42-db66-46e3-9ffc-a45dd2f8220d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e3b1143e7264ce4b8c843dfe84a5dd2', 'request_id': 'req-ad0efd42-db66-46e3-9ffc-a45dd2f8220d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:19.414892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ad0efd42-db66-46e3-9ffc-a45dd2f8220d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e3b1143e7264ce4b8c843dfe84a5dd2', 'request_id': 'req-ad0efd42-db66-46e3-9ffc-a45dd2f8220d'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:19.428225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ad0efd42-db66-46e3-9ffc-a45dd2f8220d admin admin] The token cache is being invalidate because project 1e3b1143e7264ce4b8c843dfe84a5dd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:36:19.428510 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ad0efd42-db66-46e3-9ffc-a45dd2f8220d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:19.429126 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-ad0efd42-db66-46e3-9ffc-a45dd2f8220d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:19.430719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1440/2856] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:36:19 2022] DELETE /identity/v3/projects/1e3b1143e7264ce4b8c843dfe84a5dd2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:19.436119 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f9ec-ce43-46ba-8a07-be6dd6e78a61 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:19.436414 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f9ec-ce43-46ba-8a07-be6dd6e78a61 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:19.436684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9053f9ec-ce43-46ba-8a07-be6dd6e78a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:19.455922 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-9053f9ec-ce43-46ba-8a07-be6dd6e78a61 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:19.457072 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-9053f9ec-ce43-46ba-8a07-be6dd6e78a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:19.515666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1417/2857] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:19.523271 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b647ebc-d4d3-4441-8210-3caf69995d5c None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:19.523556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b647ebc-d4d3-4441-8210-3caf69995d5c None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:19.523822 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b647ebc-d4d3-4441-8210-3caf69995d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:19.542885 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-2b647ebc-d4d3-4441-8210-3caf69995d5c None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:19.544618 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-2b647ebc-d4d3-4441-8210-3caf69995d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:19.552416 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1441/2858] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:19.556576 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053f9ec-ce43-46ba-8a07-be6dd6e78a61 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:19.568663 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9053f9ec-ce43-46ba-8a07-be6dd6e78a61 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:19.574552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c8a5f-f32e-4d9b-acab-5545fc11e1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:19.575249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c8a5f-f32e-4d9b-acab-5545fc11e1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:19.575532 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c8a5f-f32e-4d9b-acab-5545fc11e1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:19.575798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644c8a5f-f32e-4d9b-acab-5545fc11e1b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:19.576491 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c8a5f-f32e-4d9b-acab-5545fc11e1b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:36:19.576791 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c8a5f-f32e-4d9b-acab-5545fc11e1b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:19.578402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644c8a5f-f32e-4d9b-acab-5545fc11e1b8 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:19.590570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1418/2859] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:36:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:36:19.595039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b647ebc-d4d3-4441-8210-3caf69995d5c None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:19.604280 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b647ebc-d4d3-4441-8210-3caf69995d5c None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:19.609602 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023be04-8a7e-4451-82da-c7f404094649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:19.610203 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023be04-8a7e-4451-82da-c7f404094649 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:19.610485 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023be04-8a7e-4451-82da-c7f404094649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:19.610800 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c023be04-8a7e-4451-82da-c7f404094649 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:19.611444 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023be04-8a7e-4451-82da-c7f404094649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:19.613339 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c023be04-8a7e-4451-82da-c7f404094649 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:19.640811 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1442/2860] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:36:19 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:36:19.644961 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c8a5f-f32e-4d9b-acab-5545fc11e1b8 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:19.655057 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644c8a5f-f32e-4d9b-acab-5545fc11e1b8 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:19.707236 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:19.715050 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddacf2e-466e-4e19-863c-7015cab24304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:19.715772 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddacf2e-466e-4e19-863c-7015cab24304 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:19.716244 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddacf2e-466e-4e19-863c-7015cab24304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:19.716729 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddacf2e-466e-4e19-863c-7015cab24304 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:19.717576 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddacf2e-466e-4e19-863c-7015cab24304 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:19.719546 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddacf2e-466e-4e19-863c-7015cab24304 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:19.740973 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1419/2861] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:36:19 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:36:19.745094 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023be04-8a7e-4451-82da-c7f404094649 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:19.755890 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c023be04-8a7e-4451-82da-c7f404094649 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:19.760590 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9792471-dddf-4fe3-a5de-c6d19dc8d4d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:19.761183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9792471-dddf-4fe3-a5de-c6d19dc8d4d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:19.761456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9792471-dddf-4fe3-a5de-c6d19dc8d4d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:19.761724 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9792471-dddf-4fe3-a5de-c6d19dc8d4d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:19.762406 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9792471-dddf-4fe3-a5de-c6d19dc8d4d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:19.764142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9792471-dddf-4fe3-a5de-c6d19dc8d4d1 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:19.775880 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1443/2862] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:19.780442 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddacf2e-466e-4e19-863c-7015cab24304 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:19.790712 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddacf2e-466e-4e19-863c-7015cab24304 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:19.795865 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ccb52-35b4-4396-b348-a709b8a57a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:19.796456 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ccb52-35b4-4396-b348-a709b8a57a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:19.796752 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ccb52-35b4-4396-b348-a709b8a57a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:19.797022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ccb52-35b4-4396-b348-a709b8a57a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:19.797702 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ccb52-35b4-4396-b348-a709b8a57a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:19.799338 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ccb52-35b4-4396-b348-a709b8a57a7f admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:19.809584 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1420/2863] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:19.813870 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9792471-dddf-4fe3-a5de-c6d19dc8d4d1 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:19.824336 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9792471-dddf-4fe3-a5de-c6d19dc8d4d1 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:19.829055 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eea671-7d45-4272-b011-437a12c04a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:19.829703 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eea671-7d45-4272-b011-437a12c04a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:19.829986 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eea671-7d45-4272-b011-437a12c04a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:19.830256 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eea671-7d45-4272-b011-437a12c04a38 admin admin] PATH_INFO: `/v3/projects/a7addf75bb7644fdb960e06bf127597a/users/11c06ae919924d60be719c3f1b7e8844/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:19.845317 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eea671-7d45-4272-b011-437a12c04a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a7addf75bb7644fdb960e06bf127597a, user_id=11c06ae919924d60be719c3f1b7e8844, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:19.848063 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36eea671-7d45-4272-b011-437a12c04a38 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:19.861200 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1444/2864] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:36:19 2022] PUT /identity/v3/projects/a7addf75bb7644fdb960e06bf127597a/users/11c06ae919924d60be719c3f1b7e8844/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:19.871452 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6702-1bfa-4a69-a620-5c07b4c196c3 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:19.871836 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6702-1bfa-4a69-a620-5c07b4c196c3 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:19.872177 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6702-1bfa-4a69-a620-5c07b4c196c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:19.900394 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-094b6702-1bfa-4a69-a620-5c07b4c196c3 None None] MFA Rules not processed for user `11c06ae919924d60be719c3f1b7e8844`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:19.901608 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-094b6702-1bfa-4a69-a620-5c07b4c196c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:19.965063 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1421/2865] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:19.970013 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eea671-7d45-4272-b011-437a12c04a38 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:19.997889 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:20.037293 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eea671-7d45-4272-b011-437a12c04a38 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:20.041949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f509f-ffd0-4085-a080-431ec866d8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:20.042556 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f509f-ffd0-4085-a080-431ec866d8af admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:20.042864 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f509f-ffd0-4085-a080-431ec866d8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:20.043140 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878f509f-ffd0-4085-a080-431ec866d8af admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:20.044401 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f509f-ffd0-4085-a080-431ec866d8af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:20.046305 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878f509f-ffd0-4085-a080-431ec866d8af admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:20.072663 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1445/2866] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:36:19 2022] POST /identity/v3/projects => generated 381 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:36:20.076815 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6702-1bfa-4a69-a620-5c07b4c196c3 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:20.087511 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6702-1bfa-4a69-a620-5c07b4c196c3 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:20.144012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db185681-ad45-4d59-bae8-52419feafb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:20.144626 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db185681-ad45-4d59-bae8-52419feafb08 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:20.144902 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db185681-ad45-4d59-bae8-52419feafb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:20.145180 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db185681-ad45-4d59-bae8-52419feafb08 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:20.145820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db185681-ad45-4d59-bae8-52419feafb08 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:20.147779 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db185681-ad45-4d59-bae8-52419feafb08 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:20.168684 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1422/2867] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:36:20 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:36:20.173380 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f509f-ffd0-4085-a080-431ec866d8af admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:20.183525 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878f509f-ffd0-4085-a080-431ec866d8af admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:20.189225 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6d10a-3994-483b-b2c1-0e887f60bc7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:20.189838 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6d10a-3994-483b-b2c1-0e887f60bc7d admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:20.190175 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6d10a-3994-483b-b2c1-0e887f60bc7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:20.190391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c6d10a-3994-483b-b2c1-0e887f60bc7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:20.191129 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6d10a-3994-483b-b2c1-0e887f60bc7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:20.192731 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c6d10a-3994-483b-b2c1-0e887f60bc7d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:20.204298 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1446/2868] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:20.208469 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db185681-ad45-4d59-bae8-52419feafb08 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:20.219604 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db185681-ad45-4d59-bae8-52419feafb08 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:20.224089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead275c-c2cc-4ebb-84a5-439476a7fcf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:20.224743 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead275c-c2cc-4ebb-84a5-439476a7fcf9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:20.225023 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead275c-c2cc-4ebb-84a5-439476a7fcf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:20.225297 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fead275c-c2cc-4ebb-84a5-439476a7fcf9 admin admin] PATH_INFO: `/v3/projects/95a26393947040479b138354ff46465e/users/e22248d6bbde4102b6d9c22a30f27b4b/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:20.239904 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead275c-c2cc-4ebb-84a5-439476a7fcf9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a26393947040479b138354ff46465e, user_id=e22248d6bbde4102b6d9c22a30f27b4b, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:20.242628 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fead275c-c2cc-4ebb-84a5-439476a7fcf9 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:20.255314 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1423/2869] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:36:20 2022] PUT /identity/v3/projects/95a26393947040479b138354ff46465e/users/e22248d6bbde4102b6d9c22a30f27b4b/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:20.259261 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6d10a-3994-483b-b2c1-0e887f60bc7d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:20.270339 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c6d10a-3994-483b-b2c1-0e887f60bc7d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:20.326254 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae1aaf9-c6be-4834-b14e-e50aaaf79b90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:20.326900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1aaf9-c6be-4834-b14e-e50aaaf79b90 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:20.327183 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1aaf9-c6be-4834-b14e-e50aaaf79b90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:20.327460 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae1aaf9-c6be-4834-b14e-e50aaaf79b90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:20.328142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1aaf9-c6be-4834-b14e-e50aaaf79b90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:20.329728 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae1aaf9-c6be-4834-b14e-e50aaaf79b90 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:20.339250 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1447/2870] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:20 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:20.343947 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead275c-c2cc-4ebb-84a5-439476a7fcf9 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:20.354122 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fead275c-c2cc-4ebb-84a5-439476a7fcf9 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:20.358845 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3707703-dca9-4b35-abaa-9325f359d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:20.359503 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3707703-dca9-4b35-abaa-9325f359d305 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:20.359779 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3707703-dca9-4b35-abaa-9325f359d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:20.360052 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3707703-dca9-4b35-abaa-9325f359d305 admin admin] PATH_INFO: `/v3/projects/95a26393947040479b138354ff46465e/users/e22248d6bbde4102b6d9c22a30f27b4b/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:20.362231 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3707703-dca9-4b35-abaa-9325f359d305 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95a26393947040479b138354ff46465e, user_id=e22248d6bbde4102b6d9c22a30f27b4b, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:20.366103 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3707703-dca9-4b35-abaa-9325f359d305 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:20.379723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1424/2871] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:36:20 2022] PUT /identity/v3/projects/95a26393947040479b138354ff46465e/users/e22248d6bbde4102b6d9c22a30f27b4b/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:36:20.391898 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd888424-81db-470b-a968-2ffa22c67687 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:20.392185 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd888424-81db-470b-a968-2ffa22c67687 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:20.392458 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd888424-81db-470b-a968-2ffa22c67687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:20.420621 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-bd888424-81db-470b-a968-2ffa22c67687 None None] MFA Rules not processed for user `e22248d6bbde4102b6d9c22a30f27b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:20.421904 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-bd888424-81db-470b-a968-2ffa22c67687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:20.490491 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1448/2872] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:20 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:20.503100 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3707703-dca9-4b35-abaa-9325f359d305 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:20.504871 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-b3707703-dca9-4b35-abaa-9325f359d305 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:20.525666 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:20.563931 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3707703-dca9-4b35-abaa-9325f359d305 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:20.567553 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaae2dd-9e63-4b68-b0b8-d5b3e907d5ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:20.568163 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaae2dd-9e63-4b68-b0b8-d5b3e907d5ff service cinder] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:20.568443 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaae2dd-9e63-4b68-b0b8-d5b3e907d5ff service cinder] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:20.568717 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adaae2dd-9e63-4b68-b0b8-d5b3e907d5ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:20.578463 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaae2dd-9e63-4b68-b0b8-d5b3e907d5ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:20.579932 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adaae2dd-9e63-4b68-b0b8-d5b3e907d5ff service cinder] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:20.589437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1425/2873] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:36:20 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:36:20.896051 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd888424-81db-470b-a968-2ffa22c67687 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:20.905220 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd888424-81db-470b-a968-2ffa22c67687 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:20.909735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df5d79-7d96-4002-99b5-f33a413f29fa tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22248d6bbde4102b6d9c22a30f27b4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a26393947040479b138354ff46465e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:20.910336 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df5d79-7d96-4002-99b5-f33a413f29fa tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:20.910646 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df5d79-7d96-4002-99b5-f33a413f29fa tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:20.910922 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df5d79-7d96-4002-99b5-f33a413f29fa tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:20.911893 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df5d79-7d96-4002-99b5-f33a413f29fa tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:36:20.912193 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df5d79-7d96-4002-99b5-f33a413f29fa tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:20.913803 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df5d79-7d96-4002-99b5-f33a413f29fa tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:20.925942 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1449/2874] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:36:20.929984 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaae2dd-9e63-4b68-b0b8-d5b3e907d5ff service cinder] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:20.939735 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adaae2dd-9e63-4b68-b0b8-d5b3e907d5ff service cinder] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:20.944310 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cc3b1-e51e-4d77-88b7-9f1df7412a06 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22248d6bbde4102b6d9c22a30f27b4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a26393947040479b138354ff46465e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:20.944919 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cc3b1-e51e-4d77-88b7-9f1df7412a06 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:20.945201 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cc3b1-e51e-4d77-88b7-9f1df7412a06 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:20.945476 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990cc3b1-e51e-4d77-88b7-9f1df7412a06 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:20.946135 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cc3b1-e51e-4d77-88b7-9f1df7412a06 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:20.948330 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990cc3b1-e51e-4d77-88b7-9f1df7412a06 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:20.974216 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1426/2875] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:36:20 2022] POST /identity/v3/projects => generated 355 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:36:20.978372 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df5d79-7d96-4002-99b5-f33a413f29fa tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:20.985376 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:20.989223 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df5d79-7d96-4002-99b5-f33a413f29fa tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:21.048789 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d2eb4-772e-41f0-bc94-c7cbc42178a6 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22248d6bbde4102b6d9c22a30f27b4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a26393947040479b138354ff46465e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:21.049409 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d2eb4-772e-41f0-bc94-c7cbc42178a6 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:21.049690 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d2eb4-772e-41f0-bc94-c7cbc42178a6 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:21.049963 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5d2eb4-772e-41f0-bc94-c7cbc42178a6 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:21.050676 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d2eb4-772e-41f0-bc94-c7cbc42178a6 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:36:21.050979 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d2eb4-772e-41f0-bc94-c7cbc42178a6 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:21.052583 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5d2eb4-772e-41f0-bc94-c7cbc42178a6 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:21.064205 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1450/2876] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:36:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:36:21.101819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cc3b1-e51e-4d77-88b7-9f1df7412a06 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:21.112293 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990cc3b1-e51e-4d77-88b7-9f1df7412a06 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:21.116826 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4970fc34-6d1f-43f1-923a-8e1c085c4b65 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e22248d6bbde4102b6d9c22a30f27b4b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95a26393947040479b138354ff46465e', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:21.117453 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970fc34-6d1f-43f1-923a-8e1c085c4b65 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:21.117740 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970fc34-6d1f-43f1-923a-8e1c085c4b65 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:21.118024 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4970fc34-6d1f-43f1-923a-8e1c085c4b65 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] PATH_INFO: `/v3/projects/496f0f43aa564fec99d210d2d8c5fcb5` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:21.119216 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970fc34-6d1f-43f1-923a-8e1c085c4b65 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] RBAC: Authorizing `identity:delete_project(project_id=496f0f43aa564fec99d210d2d8c5fcb5)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:21.121153 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4970fc34-6d1f-43f1-923a-8e1c085c4b65 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:21.167202 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4970fc34-6d1f-43f1-923a-8e1c085c4b65 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '496f0f43aa564fec99d210d2d8c5fcb5', 'request_id': 'req-4970fc34-6d1f-43f1-923a-8e1c085c4b65'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:21.172689 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4970fc34-6d1f-43f1-923a-8e1c085c4b65 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '496f0f43aa564fec99d210d2d8c5fcb5', 'request_id': 'req-4970fc34-6d1f-43f1-923a-8e1c085c4b65'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:21.179893 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4970fc34-6d1f-43f1-923a-8e1c085c4b65 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '496f0f43aa564fec99d210d2d8c5fcb5', 'request_id': 'req-4970fc34-6d1f-43f1-923a-8e1c085c4b65'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:21.191723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4970fc34-6d1f-43f1-923a-8e1c085c4b65 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] The token cache is being invalidate because project 496f0f43aa564fec99d210d2d8c5fcb5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:36:21.192012 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4970fc34-6d1f-43f1-923a-8e1c085c4b65 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:21.193196 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-4970fc34-6d1f-43f1-923a-8e1c085c4b65 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:21.198327 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1427/2877] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:36:21 2022] DELETE /identity/v3/projects/496f0f43aa564fec99d210d2d8c5fcb5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:21.385409 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d2eb4-772e-41f0-bc94-c7cbc42178a6 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:21.387171 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3d5d2eb4-772e-41f0-bc94-c7cbc42178a6 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:21.451470 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5d2eb4-772e-41f0-bc94-c7cbc42178a6 tempest-VolumeQuotaClassesTest-1585341149 tempest-VolumeQuotaClassesTest-1585341149-project-admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:21.505292 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec22d8-3624-4fe8-be1a-fcef011f497e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:21.505956 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec22d8-3624-4fe8-be1a-fcef011f497e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:21.506227 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec22d8-3624-4fe8-be1a-fcef011f497e admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:21.506548 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec22d8-3624-4fe8-be1a-fcef011f497e admin admin] PATH_INFO: `/v3/users/11c06ae919924d60be719c3f1b7e8844` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:21.507839 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec22d8-3624-4fe8-be1a-fcef011f497e admin admin] RBAC: Authorizing `identity:delete_user(user_id=11c06ae919924d60be719c3f1b7e8844)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:21.509806 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec22d8-3624-4fe8-be1a-fcef011f497e admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:21.554770 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0eec22d8-3624-4fe8-be1a-fcef011f497e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11c06ae919924d60be719c3f1b7e8844'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:21.555865 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:21.568655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0eec22d8-3624-4fe8-be1a-fcef011f497e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11c06ae919924d60be719c3f1b7e8844'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:21.575755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0eec22d8-3624-4fe8-be1a-fcef011f497e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11c06ae919924d60be719c3f1b7e8844'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:21.576431 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0eec22d8-3624-4fe8-be1a-fcef011f497e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11c06ae919924d60be719c3f1b7e8844'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:21.584525 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-0eec22d8-3624-4fe8-be1a-fcef011f497e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11c06ae919924d60be719c3f1b7e8844'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:21.591275 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1451/2878] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:36:21 2022] DELETE /identity/v3/users/11c06ae919924d60be719c3f1b7e8844 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:21.595803 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b8bc0-4e56-4f7c-91d4-c6c30f365118 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:21.596285 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b8bc0-4e56-4f7c-91d4-c6c30f365118 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:21.596397 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b8bc0-4e56-4f7c-91d4-c6c30f365118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:21.615022 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-f82b8bc0-4e56-4f7c-91d4-c6c30f365118 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:21.616143 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f82b8bc0-4e56-4f7c-91d4-c6c30f365118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:21.674084 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1428/2879] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:36:21.683714 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec22d8-3624-4fe8-be1a-fcef011f497e admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:21.685265 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-0eec22d8-3624-4fe8-be1a-fcef011f497e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:21.742270 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec22d8-3624-4fe8-be1a-fcef011f497e admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:21.746019 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbf64e-ce90-457b-931e-70a0ecfe26cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:21.746655 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbf64e-ce90-457b-931e-70a0ecfe26cf service neutron] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:21.746970 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbf64e-ce90-457b-931e-70a0ecfe26cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:21.747242 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dbf64e-ce90-457b-931e-70a0ecfe26cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:21.756379 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbf64e-ce90-457b-931e-70a0ecfe26cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:21.757804 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dbf64e-ce90-457b-931e-70a0ecfe26cf service neutron] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:21.767875 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1452/2880] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:36:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:36:22.035405 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b8bc0-4e56-4f7c-91d4-c6c30f365118 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:22.036898 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-f82b8bc0-4e56-4f7c-91d4-c6c30f365118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:22.048880 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b8bc0-4e56-4f7c-91d4-c6c30f365118 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:22.053686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b011660-572c-4e8f-a4ff-12c452e04c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:22.054345 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b011660-572c-4e8f-a4ff-12c452e04c9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:22.054649 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b011660-572c-4e8f-a4ff-12c452e04c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:22.054918 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b011660-572c-4e8f-a4ff-12c452e04c9e admin admin] PATH_INFO: `/v3/projects/a7addf75bb7644fdb960e06bf127597a` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:22.056109 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b011660-572c-4e8f-a4ff-12c452e04c9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=a7addf75bb7644fdb960e06bf127597a)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:22.058014 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b011660-572c-4e8f-a4ff-12c452e04c9e admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:22.080000 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:22.110341 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b011660-572c-4e8f-a4ff-12c452e04c9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a7addf75bb7644fdb960e06bf127597a', 'request_id': 'req-3b011660-572c-4e8f-a4ff-12c452e04c9e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:22.115790 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b011660-572c-4e8f-a4ff-12c452e04c9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a7addf75bb7644fdb960e06bf127597a', 'request_id': 'req-3b011660-572c-4e8f-a4ff-12c452e04c9e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:22.124248 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b011660-572c-4e8f-a4ff-12c452e04c9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a7addf75bb7644fdb960e06bf127597a', 'request_id': 'req-3b011660-572c-4e8f-a4ff-12c452e04c9e'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:22.135262 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b011660-572c-4e8f-a4ff-12c452e04c9e admin admin] The token cache is being invalidate because project a7addf75bb7644fdb960e06bf127597a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:36:22.135552 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b011660-572c-4e8f-a4ff-12c452e04c9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:22.136184 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-3b011660-572c-4e8f-a4ff-12c452e04c9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:22.138271 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1429/2881] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:36:22 2022] DELETE /identity/v3/projects/a7addf75bb7644fdb960e06bf127597a => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:22.142433 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbf64e-ce90-457b-931e-70a0ecfe26cf service neutron] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:22.152069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dbf64e-ce90-457b-931e-70a0ecfe26cf service neutron] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:22.207717 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c5f58b-d94b-450f-9042-daf305ba1eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:22.208351 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5f58b-d94b-450f-9042-daf305ba1eec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:22.208632 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5f58b-d94b-450f-9042-daf305ba1eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:22.208906 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c5f58b-d94b-450f-9042-daf305ba1eec admin admin] PATH_INFO: `/v3/users/e22248d6bbde4102b6d9c22a30f27b4b` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:22.210053 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5f58b-d94b-450f-9042-daf305ba1eec admin admin] RBAC: Authorizing `identity:delete_user(user_id=e22248d6bbde4102b6d9c22a30f27b4b)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:22.212057 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c5f58b-d94b-450f-9042-daf305ba1eec admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:22.257763 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b5c5f58b-d94b-450f-9042-daf305ba1eec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e22248d6bbde4102b6d9c22a30f27b4b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:22.274772 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b5c5f58b-d94b-450f-9042-daf305ba1eec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e22248d6bbde4102b6d9c22a30f27b4b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:22.279254 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:22.283201 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b5c5f58b-d94b-450f-9042-daf305ba1eec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e22248d6bbde4102b6d9c22a30f27b4b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:22.284139 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b5c5f58b-d94b-450f-9042-daf305ba1eec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e22248d6bbde4102b6d9c22a30f27b4b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:22.293410 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b5c5f58b-d94b-450f-9042-daf305ba1eec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e22248d6bbde4102b6d9c22a30f27b4b'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:22.299694 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1453/2882] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:36:22 2022] DELETE /identity/v3/users/e22248d6bbde4102b6d9c22a30f27b4b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:22.577189 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b011660-572c-4e8f-a4ff-12c452e04c9e admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:22.578983 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3b011660-572c-4e8f-a4ff-12c452e04c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:22.592757 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b011660-572c-4e8f-a4ff-12c452e04c9e admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:22.648672 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a23514-4e08-47bc-ae9e-072aaba46374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:22.649280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a23514-4e08-47bc-ae9e-072aaba46374 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:22.649509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a23514-4e08-47bc-ae9e-072aaba46374 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:22.649781 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a23514-4e08-47bc-ae9e-072aaba46374 admin admin] PATH_INFO: `/v3/projects/95a26393947040479b138354ff46465e` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:22.650954 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a23514-4e08-47bc-ae9e-072aaba46374 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95a26393947040479b138354ff46465e)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:22.652866 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a23514-4e08-47bc-ae9e-072aaba46374 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:22.699744 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-06a23514-4e08-47bc-ae9e-072aaba46374 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95a26393947040479b138354ff46465e', 'request_id': 'req-06a23514-4e08-47bc-ae9e-072aaba46374'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:22.705200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-06a23514-4e08-47bc-ae9e-072aaba46374 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95a26393947040479b138354ff46465e', 'request_id': 'req-06a23514-4e08-47bc-ae9e-072aaba46374'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:22.712685 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-06a23514-4e08-47bc-ae9e-072aaba46374 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95a26393947040479b138354ff46465e', 'request_id': 'req-06a23514-4e08-47bc-ae9e-072aaba46374'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:22.723768 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-06a23514-4e08-47bc-ae9e-072aaba46374 admin admin] The token cache is being invalidate because project 95a26393947040479b138354ff46465e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80142) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:36:22.724054 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-06a23514-4e08-47bc-ae9e-072aaba46374 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:22.724676 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-06a23514-4e08-47bc-ae9e-072aaba46374 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:22.726166 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1430/2883] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:36:22 2022] DELETE /identity/v3/projects/95a26393947040479b138354ff46465e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:22.731127 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b586-0e89-4155-9ce9-3738c7a08281 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:22.732142 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b586-0e89-4155-9ce9-3738c7a08281 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:22.732281 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3987b586-0e89-4155-9ce9-3738c7a08281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:22.751255 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-3987b586-0e89-4155-9ce9-3738c7a08281 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:22.752441 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-3987b586-0e89-4155-9ce9-3738c7a08281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:22.812372 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1454/2884] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:36:22.820242 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6093-91df-4625-806d-cd825b4fe125 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:22.820525 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6093-91df-4625-806d-cd825b4fe125 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:22.820798 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cff6093-91df-4625-806d-cd825b4fe125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:22.841105 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-0cff6093-91df-4625-806d-cd825b4fe125 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:22.842306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-0cff6093-91df-4625-806d-cd825b4fe125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:22.850199 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1431/2885] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:22.854434 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b586-0e89-4155-9ce9-3738c7a08281 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:22.864664 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3987b586-0e89-4155-9ce9-3738c7a08281 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:22.869517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600fd6c-3c13-44b0-b44b-caeba2ba1533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:22.870109 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600fd6c-3c13-44b0-b44b-caeba2ba1533 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:22.870382 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600fd6c-3c13-44b0-b44b-caeba2ba1533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:22.870680 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1600fd6c-3c13-44b0-b44b-caeba2ba1533 admin admin] PATH_INFO: `/v3/domains` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:22.871373 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600fd6c-3c13-44b0-b44b-caeba2ba1533 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80141) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:36:22.871668 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600fd6c-3c13-44b0-b44b-caeba2ba1533 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:22.873238 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1600fd6c-3c13-44b0-b44b-caeba2ba1533 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:22.884336 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1455/2886] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:36:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 01 14:36:22.888526 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff6093-91df-4625-806d-cd825b4fe125 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:22.897713 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cff6093-91df-4625-806d-cd825b4fe125 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:22.902334 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe56ea9-059a-4e05-8753-c0ed60d37963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:22.902914 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe56ea9-059a-4e05-8753-c0ed60d37963 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:22.903820 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe56ea9-059a-4e05-8753-c0ed60d37963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:22.904117 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe56ea9-059a-4e05-8753-c0ed60d37963 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:22.904760 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe56ea9-059a-4e05-8753-c0ed60d37963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:22.906688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe56ea9-059a-4e05-8753-c0ed60d37963 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:22.933653 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1432/2887] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:36:22 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:36:22.937853 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600fd6c-3c13-44b0-b44b-caeba2ba1533 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:22.948399 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1600fd6c-3c13-44b0-b44b-caeba2ba1533 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:23.005803 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76aad1a-e04d-48ed-8bb8-fe04d6c1d424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:23.006420 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aad1a-e04d-48ed-8bb8-fe04d6c1d424 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:23.006735 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aad1a-e04d-48ed-8bb8-fe04d6c1d424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:23.007013 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76aad1a-e04d-48ed-8bb8-fe04d6c1d424 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:23.007683 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76aad1a-e04d-48ed-8bb8-fe04d6c1d424 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:23.009602 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76aad1a-e04d-48ed-8bb8-fe04d6c1d424 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:23.031519 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1456/2888] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:36:22 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 01 14:36:23.035727 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe56ea9-059a-4e05-8753-c0ed60d37963 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:23.047794 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe56ea9-059a-4e05-8753-c0ed60d37963 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:23.052420 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123d120-05a2-4cdf-bb1d-cc84a0da6184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:23.053021 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123d120-05a2-4cdf-bb1d-cc84a0da6184 admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:23.053299 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123d120-05a2-4cdf-bb1d-cc84a0da6184 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:23.053568 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f123d120-05a2-4cdf-bb1d-cc84a0da6184 admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:23.054249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123d120-05a2-4cdf-bb1d-cc84a0da6184 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:23.055882 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f123d120-05a2-4cdf-bb1d-cc84a0da6184 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:23.057191 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:23.067857 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1433/2889] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 01 14:36:23.071415 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76aad1a-e04d-48ed-8bb8-fe04d6c1d424 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:23.081531 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76aad1a-e04d-48ed-8bb8-fe04d6c1d424 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:23.086065 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10a4f5-28fe-42de-b29c-103f1f556839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:23.086685 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10a4f5-28fe-42de-b29c-103f1f556839 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:23.086965 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10a4f5-28fe-42de-b29c-103f1f556839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:23.087234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10a4f5-28fe-42de-b29c-103f1f556839 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:23.087921 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10a4f5-28fe-42de-b29c-103f1f556839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:23.089489 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac10a4f5-28fe-42de-b29c-103f1f556839 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:23.101481 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1457/2890] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:23.105724 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123d120-05a2-4cdf-bb1d-cc84a0da6184 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:23.118817 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f123d120-05a2-4cdf-bb1d-cc84a0da6184 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:23.123495 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff25d63-f27f-4d5a-bd5d-40c7db454b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:23.124149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff25d63-f27f-4d5a-bd5d-40c7db454b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:23.124426 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff25d63-f27f-4d5a-bd5d-40c7db454b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:23.124697 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff25d63-f27f-4d5a-bd5d-40c7db454b53 admin admin] PATH_INFO: `/v3/projects/29e9b79cd2714d03972c3cc626f6b416/users/063da5973d7040908a001b8a0212a302/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:23.139489 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff25d63-f27f-4d5a-bd5d-40c7db454b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29e9b79cd2714d03972c3cc626f6b416, user_id=063da5973d7040908a001b8a0212a302, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:23.142125 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff25d63-f27f-4d5a-bd5d-40c7db454b53 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:23.156089 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1434/2891] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:36:23 2022] PUT /identity/v3/projects/29e9b79cd2714d03972c3cc626f6b416/users/063da5973d7040908a001b8a0212a302/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:23.167442 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c296c-faeb-414f-8261-9cce05368898 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:23.167723 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c296c-faeb-414f-8261-9cce05368898 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:23.167990 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c296c-faeb-414f-8261-9cce05368898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:23.195808 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-5a4c296c-faeb-414f-8261-9cce05368898 None None] MFA Rules not processed for user `063da5973d7040908a001b8a0212a302`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:23.197259 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-5a4c296c-faeb-414f-8261-9cce05368898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:23.240571 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:23.264719 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1458/2892] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:23.269268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff25d63-f27f-4d5a-bd5d-40c7db454b53 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:23.333761 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff25d63-f27f-4d5a-bd5d-40c7db454b53 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:23.338444 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc14800-2420-4976-b76e-79204b666cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:23.339105 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc14800-2420-4976-b76e-79204b666cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:23.339387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc14800-2420-4976-b76e-79204b666cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:23.339662 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc14800-2420-4976-b76e-79204b666cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:23.340329 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc14800-2420-4976-b76e-79204b666cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:23.342819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc14800-2420-4976-b76e-79204b666cb2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:23.368624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1435/2893] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:36:23 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:36:23.372703 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c296c-faeb-414f-8261-9cce05368898 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:23.383892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4c296c-faeb-414f-8261-9cce05368898 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:23.439949 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa4733-4ad7-4a77-979d-faa8ff9d0960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:23.440488 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4733-4ad7-4a77-979d-faa8ff9d0960 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:23.440768 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4733-4ad7-4a77-979d-faa8ff9d0960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:23.441039 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aa4733-4ad7-4a77-979d-faa8ff9d0960 admin admin] PATH_INFO: `/v3/users` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:23.441686 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa4733-4ad7-4a77-979d-faa8ff9d0960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:23.443641 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aa4733-4ad7-4a77-979d-faa8ff9d0960 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:23.465613 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1459/2894] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:36:23 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:36:23.470122 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc14800-2420-4976-b76e-79204b666cb2 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:23.480347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc14800-2420-4976-b76e-79204b666cb2 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:23.485108 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c136f-4f1d-4290-86cf-d79b809bdf3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:23.485710 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c136f-4f1d-4290-86cf-d79b809bdf3b admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:23.485987 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c136f-4f1d-4290-86cf-d79b809bdf3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:23.486258 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c136f-4f1d-4290-86cf-d79b809bdf3b admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:23.486978 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c136f-4f1d-4290-86cf-d79b809bdf3b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:23.488586 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c136f-4f1d-4290-86cf-d79b809bdf3b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:23.499880 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1436/2895] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:23.504025 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa4733-4ad7-4a77-979d-faa8ff9d0960 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:23.514710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aa4733-4ad7-4a77-979d-faa8ff9d0960 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:23.519289 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0773ce-41fd-47a3-8dd6-03143343858f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:23.519945 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0773ce-41fd-47a3-8dd6-03143343858f admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:23.520221 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0773ce-41fd-47a3-8dd6-03143343858f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:23.520495 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0773ce-41fd-47a3-8dd6-03143343858f admin admin] PATH_INFO: `/v3/projects/9f6bb5e4fbf745bbab1f881e17b87de0/users/cffc9db157894f87b4e7f56038e453aa/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:23.535349 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0773ce-41fd-47a3-8dd6-03143343858f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6bb5e4fbf745bbab1f881e17b87de0, user_id=cffc9db157894f87b4e7f56038e453aa, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:23.537989 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0773ce-41fd-47a3-8dd6-03143343858f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:23.551419 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1460/2896] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:36:23 2022] PUT /identity/v3/projects/9f6bb5e4fbf745bbab1f881e17b87de0/users/cffc9db157894f87b4e7f56038e453aa/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:23.555391 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c136f-4f1d-4290-86cf-d79b809bdf3b admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:23.565723 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c136f-4f1d-4290-86cf-d79b809bdf3b admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:23.621509 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02feef8d-737f-4813-acf5-1e03054abbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:23.622648 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02feef8d-737f-4813-acf5-1e03054abbee admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:23.622930 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02feef8d-737f-4813-acf5-1e03054abbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:23.623200 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02feef8d-737f-4813-acf5-1e03054abbee admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:23.624508 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02feef8d-737f-4813-acf5-1e03054abbee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:23.626107 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02feef8d-737f-4813-acf5-1e03054abbee admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:23.635703 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1437/2897] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:23.640517 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0773ce-41fd-47a3-8dd6-03143343858f admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:23.650710 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0773ce-41fd-47a3-8dd6-03143343858f admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:23.655362 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd1ac8-7327-4c97-b4c7-efa1d83780cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:23.656006 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd1ac8-7327-4c97-b4c7-efa1d83780cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:23.656285 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd1ac8-7327-4c97-b4c7-efa1d83780cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:23.656559 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cd1ac8-7327-4c97-b4c7-efa1d83780cf admin admin] PATH_INFO: `/v3/projects/9f6bb5e4fbf745bbab1f881e17b87de0/users/cffc9db157894f87b4e7f56038e453aa/roles/0681632796d144f6a7ac8eca157001ec` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:23.658482 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd1ac8-7327-4c97-b4c7-efa1d83780cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f6bb5e4fbf745bbab1f881e17b87de0, user_id=cffc9db157894f87b4e7f56038e453aa, role_id=0681632796d144f6a7ac8eca157001ec)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:23.661137 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cd1ac8-7327-4c97-b4c7-efa1d83780cf admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:23.671050 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1461/2898] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:36:23 2022] PUT /identity/v3/projects/9f6bb5e4fbf745bbab1f881e17b87de0/users/cffc9db157894f87b4e7f56038e453aa/roles/0681632796d144f6a7ac8eca157001ec => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:23.681110 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870bd85-0322-4fdc-ae19-fa0e119bba89 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:23.681588 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870bd85-0322-4fdc-ae19-fa0e119bba89 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:23.681688 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870bd85-0322-4fdc-ae19-fa0e119bba89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:23.709560 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-4870bd85-0322-4fdc-ae19-fa0e119bba89 None None] MFA Rules not processed for user `cffc9db157894f87b4e7f56038e453aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:23.710681 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-4870bd85-0322-4fdc-ae19-fa0e119bba89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:23.742843 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:23.781991 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1438/2899] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:23 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:23.793015 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd1ac8-7327-4c97-b4c7-efa1d83780cf admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:23.795755 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-86cd1ac8-7327-4c97-b4c7-efa1d83780cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:23.852855 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cd1ac8-7327-4c97-b4c7-efa1d83780cf admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:23.857037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143b1879-5dc5-43f4-aa5d-fe53f09c4d7c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:23.857642 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b1879-5dc5-43f4-aa5d-fe53f09c4d7c service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:23.857925 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b1879-5dc5-43f4-aa5d-fe53f09c4d7c service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:23.858196 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143b1879-5dc5-43f4-aa5d-fe53f09c4d7c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:23.867338 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b1879-5dc5-43f4-aa5d-fe53f09c4d7c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:23.868784 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143b1879-5dc5-43f4-aa5d-fe53f09c4d7c service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:23.878958 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1462/2900] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:36:23 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:36:24.417353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870bd85-0322-4fdc-ae19-fa0e119bba89 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:24.479387 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870bd85-0322-4fdc-ae19-fa0e119bba89 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:24.484065 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b76c-b2cd-4d62-9691-6a5ce51904e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:24.484695 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b76c-b2cd-4d62-9691-6a5ce51904e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:24.484975 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b76c-b2cd-4d62-9691-6a5ce51904e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:24.485249 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8982b76c-b2cd-4d62-9691-6a5ce51904e2 admin admin] PATH_INFO: `/v3/users/063da5973d7040908a001b8a0212a302` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:24.486402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982b76c-b2cd-4d62-9691-6a5ce51904e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=063da5973d7040908a001b8a0212a302)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:24.488419 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8982b76c-b2cd-4d62-9691-6a5ce51904e2 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:24.533737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8982b76c-b2cd-4d62-9691-6a5ce51904e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '063da5973d7040908a001b8a0212a302'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:24.541073 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8982b76c-b2cd-4d62-9691-6a5ce51904e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '063da5973d7040908a001b8a0212a302'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:24.553304 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8982b76c-b2cd-4d62-9691-6a5ce51904e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '063da5973d7040908a001b8a0212a302'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:24.553937 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8982b76c-b2cd-4d62-9691-6a5ce51904e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '063da5973d7040908a001b8a0212a302'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:24.561190 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-8982b76c-b2cd-4d62-9691-6a5ce51904e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '063da5973d7040908a001b8a0212a302'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:24.566970 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1439/2901] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:36:24 2022] DELETE /identity/v3/users/063da5973d7040908a001b8a0212a302 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:24.571528 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f025b7-2d0f-44a8-a00e-326633695a26 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:24.571818 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f025b7-2d0f-44a8-a00e-326633695a26 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:24.572344 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f025b7-2d0f-44a8-a00e-326633695a26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:24.591194 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-60f025b7-2d0f-44a8-a00e-326633695a26 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:24.592404 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-60f025b7-2d0f-44a8-a00e-326633695a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:24.624588 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:24.652306 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1463/2902] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 01 14:36:24.662682 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b76c-b2cd-4d62-9691-6a5ce51904e2 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:24.664082 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-8982b76c-b2cd-4d62-9691-6a5ce51904e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:24.715528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:24.722811 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8982b76c-b2cd-4d62-9691-6a5ce51904e2 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:24.727487 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427aaef-833e-4351-99b3-6a805d1c3230 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:24.728148 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427aaef-833e-4351-99b3-6a805d1c3230 service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:24.728589 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427aaef-833e-4351-99b3-6a805d1c3230 service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:24.728860 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8427aaef-833e-4351-99b3-6a805d1c3230 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:24.737982 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427aaef-833e-4351-99b3-6a805d1c3230 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:24.739502 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8427aaef-833e-4351-99b3-6a805d1c3230 service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:24.748686 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1440/2903] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:36:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:36:25.021109 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f025b7-2d0f-44a8-a00e-326633695a26 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:25.022662 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-60f025b7-2d0f-44a8-a00e-326633695a26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:25.036549 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f025b7-2d0f-44a8-a00e-326633695a26 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:25.041456 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f48642-d77c-42f5-abe2-646be47f0c79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:25.042105 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f48642-d77c-42f5-abe2-646be47f0c79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:25.042388 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f48642-d77c-42f5-abe2-646be47f0c79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:25.042694 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f48642-d77c-42f5-abe2-646be47f0c79 admin admin] PATH_INFO: `/v3/projects/29e9b79cd2714d03972c3cc626f6b416` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:25.044569 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f48642-d77c-42f5-abe2-646be47f0c79 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29e9b79cd2714d03972c3cc626f6b416)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:25.046469 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f48642-d77c-42f5-abe2-646be47f0c79 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:25.095698 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a1f48642-d77c-42f5-abe2-646be47f0c79 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29e9b79cd2714d03972c3cc626f6b416', 'request_id': 'req-a1f48642-d77c-42f5-abe2-646be47f0c79'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:25.102047 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a1f48642-d77c-42f5-abe2-646be47f0c79 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29e9b79cd2714d03972c3cc626f6b416', 'request_id': 'req-a1f48642-d77c-42f5-abe2-646be47f0c79'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:25.109122 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a1f48642-d77c-42f5-abe2-646be47f0c79 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29e9b79cd2714d03972c3cc626f6b416', 'request_id': 'req-a1f48642-d77c-42f5-abe2-646be47f0c79'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:25.121513 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a1f48642-d77c-42f5-abe2-646be47f0c79 admin admin] The token cache is being invalidate because project 29e9b79cd2714d03972c3cc626f6b416 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:36:25.121854 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a1f48642-d77c-42f5-abe2-646be47f0c79 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:25.122487 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-a1f48642-d77c-42f5-abe2-646be47f0c79 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:25.124037 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1464/2904] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:36:25 2022] DELETE /identity/v3/projects/29e9b79cd2714d03972c3cc626f6b416 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:25.128060 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427aaef-833e-4351-99b3-6a805d1c3230 service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:25.137928 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8427aaef-833e-4351-99b3-6a805d1c3230 service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:25.193842 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f9dd21-6938-48bf-82d5-1a1af9ef883b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:25.194498 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9dd21-6938-48bf-82d5-1a1af9ef883b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:25.194818 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9dd21-6938-48bf-82d5-1a1af9ef883b admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:25.195086 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f9dd21-6938-48bf-82d5-1a1af9ef883b admin admin] PATH_INFO: `/v3/users/cffc9db157894f87b4e7f56038e453aa` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:25.196234 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9dd21-6938-48bf-82d5-1a1af9ef883b admin admin] RBAC: Authorizing `identity:delete_user(user_id=cffc9db157894f87b4e7f56038e453aa)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:25.198402 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f9dd21-6938-48bf-82d5-1a1af9ef883b admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:25.244737 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-26f9dd21-6938-48bf-82d5-1a1af9ef883b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cffc9db157894f87b4e7f56038e453aa'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:25.252016 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-26f9dd21-6938-48bf-82d5-1a1af9ef883b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cffc9db157894f87b4e7f56038e453aa'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:25.263880 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-26f9dd21-6938-48bf-82d5-1a1af9ef883b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cffc9db157894f87b4e7f56038e453aa'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:25.264520 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-26f9dd21-6938-48bf-82d5-1a1af9ef883b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cffc9db157894f87b4e7f56038e453aa'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:25.271564 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-26f9dd21-6938-48bf-82d5-1a1af9ef883b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cffc9db157894f87b4e7f56038e453aa'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:25.277428 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1441/2905] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:36:25 2022] DELETE /identity/v3/users/cffc9db157894f87b4e7f56038e453aa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:25.550693 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f48642-d77c-42f5-abe2-646be47f0c79 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:25.552158 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-a1f48642-d77c-42f5-abe2-646be47f0c79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:25.567522 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f48642-d77c-42f5-abe2-646be47f0c79 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:25.630113 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11e6d12-3337-4144-9365-664d30df429f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:25.630795 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e6d12-3337-4144-9365-664d30df429f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:25.631074 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e6d12-3337-4144-9365-664d30df429f admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:25.631347 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11e6d12-3337-4144-9365-664d30df429f admin admin] PATH_INFO: `/v3/projects/9f6bb5e4fbf745bbab1f881e17b87de0` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:25.632493 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e6d12-3337-4144-9365-664d30df429f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f6bb5e4fbf745bbab1f881e17b87de0)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:25.634432 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11e6d12-3337-4144-9365-664d30df429f admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:25.679773 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b11e6d12-3337-4144-9365-664d30df429f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f6bb5e4fbf745bbab1f881e17b87de0', 'request_id': 'req-b11e6d12-3337-4144-9365-664d30df429f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:25.685828 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b11e6d12-3337-4144-9365-664d30df429f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f6bb5e4fbf745bbab1f881e17b87de0', 'request_id': 'req-b11e6d12-3337-4144-9365-664d30df429f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:25.691522 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b11e6d12-3337-4144-9365-664d30df429f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f6bb5e4fbf745bbab1f881e17b87de0', 'request_id': 'req-b11e6d12-3337-4144-9365-664d30df429f'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:25.693257 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:25.706454 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b11e6d12-3337-4144-9365-664d30df429f admin admin] The token cache is being invalidate because project 9f6bb5e4fbf745bbab1f881e17b87de0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:36:25.706776 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b11e6d12-3337-4144-9365-664d30df429f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:25.707391 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-b11e6d12-3337-4144-9365-664d30df429f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:25.708868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1465/2906] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:36:25 2022] DELETE /identity/v3/projects/9f6bb5e4fbf745bbab1f881e17b87de0 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:25.713778 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269730f5-4923-44b4-a70d-a188ee508363 None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:25.714081 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269730f5-4923-44b4-a70d-a188ee508363 None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:25.714353 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269730f5-4923-44b4-a70d-a188ee508363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:25.734415 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-269730f5-4923-44b4-a70d-a188ee508363 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:25.736586 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-269730f5-4923-44b4-a70d-a188ee508363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:25.795437 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1442/2907] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:25.803276 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66bc27-eafd-44c7-859d-e006006d0643 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:25.803587 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66bc27-eafd-44c7-859d-e006006d0643 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:25.803867 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d66bc27-eafd-44c7-859d-e006006d0643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:25.824593 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-7d66bc27-eafd-44c7-859d-e006006d0643 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:25.825812 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-7d66bc27-eafd-44c7-859d-e006006d0643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:25.833845 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1466/2908] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:25.838040 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269730f5-4923-44b4-a70d-a188ee508363 None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:25.848306 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269730f5-4923-44b4-a70d-a188ee508363 None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:25.852852 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488bb02-1356-45aa-af4b-121325f71dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:25.853444 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488bb02-1356-45aa-af4b-121325f71dfe admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:25.853718 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488bb02-1356-45aa-af4b-121325f71dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:25.853986 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488bb02-1356-45aa-af4b-121325f71dfe admin admin] PATH_INFO: `/v3/domains` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:25.854710 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488bb02-1356-45aa-af4b-121325f71dfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80142) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 01 14:36:25.855011 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488bb02-1356-45aa-af4b-121325f71dfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:25.857204 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488bb02-1356-45aa-af4b-121325f71dfe admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:25.859597 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:25.870190 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1443/2909] 10.222.0.70 () {58 vars in 1153 bytes} [Mon Aug 1 14:36:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 01 14:36:25.874251 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66bc27-eafd-44c7-859d-e006006d0643 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:25.883584 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d66bc27-eafd-44c7-859d-e006006d0643 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:25.888301 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347289d-c0a0-4b14-a024-3d45e6409c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:25.888900 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347289d-c0a0-4b14-a024-3d45e6409c81 admin admin] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:25.889179 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347289d-c0a0-4b14-a024-3d45e6409c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:25.889452 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4347289d-c0a0-4b14-a024-3d45e6409c81 admin admin] PATH_INFO: `/v3/projects` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:25.890117 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347289d-c0a0-4b14-a024-3d45e6409c81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:25.892069 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4347289d-c0a0-4b14-a024-3d45e6409c81 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:25.918598 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1467/2910] 10.222.0.70 () {60 vars in 1153 bytes} [Mon Aug 1 14:36:25 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:36:25.923302 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488bb02-1356-45aa-af4b-121325f71dfe admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:25.933175 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488bb02-1356-45aa-af4b-121325f71dfe admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:25.988732 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcb22c-38a2-4a49-9264-54c450314f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:25.989347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcb22c-38a2-4a49-9264-54c450314f93 admin admin] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:25.989623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcb22c-38a2-4a49-9264-54c450314f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:25.989893 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbcb22c-38a2-4a49-9264-54c450314f93 admin admin] PATH_INFO: `/v3/users` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:25.990570 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcb22c-38a2-4a49-9264-54c450314f93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:25.992616 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bbcb22c-38a2-4a49-9264-54c450314f93 admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:26.013934 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1444/2911] 10.222.0.70 () {60 vars in 1144 bytes} [Mon Aug 1 14:36:25 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 01 14:36:26.018056 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347289d-c0a0-4b14-a024-3d45e6409c81 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:26.028920 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4347289d-c0a0-4b14-a024-3d45e6409c81 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:26.033414 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c7d4d-cc40-47b7-a63b-93c472a2d5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:26.034009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c7d4d-cc40-47b7-a63b-93c472a2d5f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:26.034280 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c7d4d-cc40-47b7-a63b-93c472a2d5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:26.034560 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33c7d4d-cc40-47b7-a63b-93c472a2d5f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:26.035269 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c7d4d-cc40-47b7-a63b-93c472a2d5f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:26.036856 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33c7d4d-cc40-47b7-a63b-93c472a2d5f7 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:26.048035 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1468/2912] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:26.051787 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcb22c-38a2-4a49-9264-54c450314f93 admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:26.062623 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbcb22c-38a2-4a49-9264-54c450314f93 admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:26.067149 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c5d7ff-4f36-456f-8de3-e3bd8049f27a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:26.067752 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5d7ff-4f36-456f-8de3-e3bd8049f27a admin admin] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:26.068032 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5d7ff-4f36-456f-8de3-e3bd8049f27a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:26.068305 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c5d7ff-4f36-456f-8de3-e3bd8049f27a admin admin] PATH_INFO: `/v3/roles` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:26.068992 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5d7ff-4f36-456f-8de3-e3bd8049f27a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:26.070650 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c5d7ff-4f36-456f-8de3-e3bd8049f27a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:26.081347 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1445/2913] 10.222.0.70 () {58 vars in 1122 bytes} [Mon Aug 1 14:36:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 01 14:36:26.085414 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c7d4d-cc40-47b7-a63b-93c472a2d5f7 admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:26.095871 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33c7d4d-cc40-47b7-a63b-93c472a2d5f7 admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:26.100578 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5b3e8-8588-4d11-902a-a13713727f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:26.101222 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5b3e8-8588-4d11-902a-a13713727f7d admin admin] REQUEST_METHOD: `PUT` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:26.101596 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5b3e8-8588-4d11-902a-a13713727f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:26.101892 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb5b3e8-8588-4d11-902a-a13713727f7d admin admin] PATH_INFO: `/v3/projects/c9229256e88d4c10b72065a1d7a7199e/users/e1a095bf245847da950459e58c353809/roles/125ef16e078848b2bd772db91d4115d4` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:26.116637 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5b3e8-8588-4d11-902a-a13713727f7d admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9229256e88d4c10b72065a1d7a7199e, user_id=e1a095bf245847da950459e58c353809, role_id=125ef16e078848b2bd772db91d4115d4)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:26.119292 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb5b3e8-8588-4d11-902a-a13713727f7d admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:26.131703 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1469/2914] 10.222.0.70 () {60 vars in 1483 bytes} [Mon Aug 1 14:36:26 2022] PUT /identity/v3/projects/c9229256e88d4c10b72065a1d7a7199e/users/e1a095bf245847da950459e58c353809/roles/125ef16e078848b2bd772db91d4115d4 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:26.143265 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fab80c-cc50-45d2-8d6b-8b3acead831b None None] REQUEST_METHOD: `POST` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:26.143554 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fab80c-cc50-45d2-8d6b-8b3acead831b None None] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:26.143828 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fab80c-cc50-45d2-8d6b-8b3acead831b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:26.171273 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.auth.core [None req-74fab80c-cc50-45d2-8d6b-8b3acead831b None None] MFA Rules not processed for user `e1a095bf245847da950459e58c353809`. Rule list: `[]` (Enabled: `True`). {{(pid=80142) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:26.172478 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-74fab80c-cc50-45d2-8d6b-8b3acead831b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:26.236486 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1446/2915] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:26.247256 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5b3e8-8588-4d11-902a-a13713727f7d admin admin] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:26.248942 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-ceb5b3e8-8588-4d11-902a-a13713727f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:26.305465 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb5b3e8-8588-4d11-902a-a13713727f7d admin admin] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:26.309000 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a4eaf0-fcb3-4412-9fd1-d8b406f2284c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a41da5d6d38341deaf1563fe0ebac32b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:26.309633 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4eaf0-fcb3-4412-9fd1-d8b406f2284c service cinder] REQUEST_METHOD: `GET` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:26.309909 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4eaf0-fcb3-4412-9fd1-d8b406f2284c service cinder] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:26.310181 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a4eaf0-fcb3-4412-9fd1-d8b406f2284c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:26.318429 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4eaf0-fcb3-4412-9fd1-d8b406f2284c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:26.319888 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a4eaf0-fcb3-4412-9fd1-d8b406f2284c service cinder] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:26.329399 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1470/2916] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:36:26 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:36:31.659556 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fab80c-cc50-45d2-8d6b-8b3acead831b None None] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:31.721380 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fab80c-cc50-45d2-8d6b-8b3acead831b None None] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:31.725902 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89344da9-6f08-4975-99a2-6531c6d2d88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:31.726536 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89344da9-6f08-4975-99a2-6531c6d2d88a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:31.726844 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89344da9-6f08-4975-99a2-6531c6d2d88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:31.727117 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89344da9-6f08-4975-99a2-6531c6d2d88a admin admin] PATH_INFO: `/v3/users/e1a095bf245847da950459e58c353809` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:31.728267 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89344da9-6f08-4975-99a2-6531c6d2d88a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1a095bf245847da950459e58c353809)` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:31.730183 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89344da9-6f08-4975-99a2-6531c6d2d88a admin admin] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:31.734801 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:31.777535 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-89344da9-6f08-4975-99a2-6531c6d2d88a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1a095bf245847da950459e58c353809'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:31.786315 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-89344da9-6f08-4975-99a2-6531c6d2d88a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1a095bf245847da950459e58c353809'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:31.799133 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-89344da9-6f08-4975-99a2-6531c6d2d88a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1a095bf245847da950459e58c353809'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:31.799819 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-89344da9-6f08-4975-99a2-6531c6d2d88a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1a095bf245847da950459e58c353809'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:31.807754 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.notifications [None req-89344da9-6f08-4975-99a2-6531c6d2d88a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1a095bf245847da950459e58c353809'} {{(pid=80142) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:31.815113 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1447/2917] 10.222.0.70 () {58 vars in 1224 bytes} [Mon Aug 1 14:36:31 2022] DELETE /identity/v3/users/e1a095bf245847da950459e58c353809 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 01 14:36:31.819528 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476cdf9-5f9c-4d85-96ca-2d8da2b68a86 None None] REQUEST_METHOD: `POST` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:31.819978 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476cdf9-5f9c-4d85-96ca-2d8da2b68a86 None None] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:31.820097 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476cdf9-5f9c-4d85-96ca-2d8da2b68a86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:31.841085 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.auth.core [None req-c476cdf9-5f9c-4d85-96ca-2d8da2b68a86 None None] MFA Rules not processed for user `22dd50ff891948b58a7664099f06c392`. Rule list: `[]` (Enabled: `True`). {{(pid=80141) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 01 14:36:31.842682 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c476cdf9-5f9c-4d85-96ca-2d8da2b68a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:31.901778 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1471/2918] 10.222.0.70 () {58 vars in 958 bytes} [Mon Aug 1 14:36:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 01 14:36:31.911775 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89344da9-6f08-4975-99a2-6531c6d2d88a admin admin] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:31.913188 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-89344da9-6f08-4975-99a2-6531c6d2d88a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:31.974720 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89344da9-6f08-4975-99a2-6531c6d2d88a admin admin] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:31.978351 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73cea6-ad15-4945-a7ae-061774faa23d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '33fcc673845943fc96bc18f011639716', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:31.979018 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73cea6-ad15-4945-a7ae-061774faa23d service neutron] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:31.979280 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73cea6-ad15-4945-a7ae-061774faa23d service neutron] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:31.979550 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e73cea6-ad15-4945-a7ae-061774faa23d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:31.989268 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73cea6-ad15-4945-a7ae-061774faa23d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:31.990900 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e73cea6-ad15-4945-a7ae-061774faa23d service neutron] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:32.001505 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1448/2919] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:36:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 01 14:36:32.263439 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476cdf9-5f9c-4d85-96ca-2d8da2b68a86 None None] Authenticating user token {{(pid=80141) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:36:32.264868 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.fernet_utils [None req-c476cdf9-5f9c-4d85-96ca-2d8da2b68a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80141) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:36:32.276980 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476cdf9-5f9c-4d85-96ca-2d8da2b68a86 None None] Validating token access rules against request {{(pid=80141) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:36:32.281592 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c456397-e7fd-4197-b164-5a4ca03d37e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '22dd50ff891948b58a7664099f06c392', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e6b4d136938b4489ad1103924c0d158f', 'project_domain_id': 'default', 'roles': ['reader', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80141) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:36:32.282234 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c456397-e7fd-4197-b164-5a4ca03d37e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:36:32.282513 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c456397-e7fd-4197-b164-5a4ca03d37e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:36:32.282815 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c456397-e7fd-4197-b164-5a4ca03d37e9 admin admin] PATH_INFO: `/v3/projects/c9229256e88d4c10b72065a1d7a7199e` {{(pid=80141) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:36:32.283973 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c456397-e7fd-4197-b164-5a4ca03d37e9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9229256e88d4c10b72065a1d7a7199e)` {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:36:32.285878 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c456397-e7fd-4197-b164-5a4ca03d37e9 admin admin] RBAC: Authorization granted {{(pid=80141) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:36:32.317953 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:INSERT=3,keystone:DELETE=2,keystone:SELECT=95 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:32.335494 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7c456397-e7fd-4197-b164-5a4ca03d37e9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9229256e88d4c10b72065a1d7a7199e', 'request_id': 'req-7c456397-e7fd-4197-b164-5a4ca03d37e9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:32.341654 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7c456397-e7fd-4197-b164-5a4ca03d37e9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9229256e88d4c10b72065a1d7a7199e', 'request_id': 'req-7c456397-e7fd-4197-b164-5a4ca03d37e9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:32.347372 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7c456397-e7fd-4197-b164-5a4ca03d37e9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9229256e88d4c10b72065a1d7a7199e', 'request_id': 'req-7c456397-e7fd-4197-b164-5a4ca03d37e9'} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:32.359725 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7c456397-e7fd-4197-b164-5a4ca03d37e9 admin admin] The token cache is being invalidate because project c9229256e88d4c10b72065a1d7a7199e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80141) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 01 14:36:32.360009 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7c456397-e7fd-4197-b164-5a4ca03d37e9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:32.360648 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG keystone.notifications [None req-7c456397-e7fd-4197-b164-5a4ca03d37e9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80141) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 01 14:36:32.362231 dv-cinder-845990-5-smb devstack@keystone.service[80141]: [pid: 80141|app: 0|req: 1472/2920] 10.222.0.70 () {58 vars in 1233 bytes} [Mon Aug 1 14:36:32 2022] DELETE /identity/v3/projects/c9229256e88d4c10b72065a1d7a7199e => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 01 14:36:41.996528 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=50,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:36:42.356186 dv-cinder-845990-5-smb devstack@keystone.service[80141]: DEBUG dbcounter [-] [80141] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80141) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 01 14:41:19.904191 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73cea6-ad15-4945-a7ae-061774faa23d service neutron] Authenticating user token {{(pid=80142) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 01 14:41:19.905609 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-3e73cea6-ad15-4945-a7ae-061774faa23d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:41:20.043762 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e73cea6-ad15-4945-a7ae-061774faa23d service neutron] Validating token access rules against request {{(pid=80142) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 01 14:41:20.102741 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875d4c7e-6693-4c3a-867b-6a3098c60c2e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e210ee6c390849e7a630a677ec52e966', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c8bcd31836684fe5b43fd604df3d3e8b', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'member', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80142) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 01 14:41:20.103350 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d4c7e-6693-4c3a-867b-6a3098c60c2e service placement] REQUEST_METHOD: `GET` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 01 14:41:20.103624 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d4c7e-6693-4c3a-867b-6a3098c60c2e service placement] SCRIPT_NAME: `/identity` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 01 14:41:20.103890 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875d4c7e-6693-4c3a-867b-6a3098c60c2e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80142) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 01 14:41:20.105594 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.fernet_utils [None req-875d4c7e-6693-4c3a-867b-6a3098c60c2e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80142) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 01 14:41:20.117208 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d4c7e-6693-4c3a-867b-6a3098c60c2e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 01 14:41:20.118835 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875d4c7e-6693-4c3a-867b-6a3098c60c2e service placement] RBAC: Authorization granted {{(pid=80142) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 01 14:41:20.128629 dv-cinder-845990-5-smb devstack@keystone.service[80142]: [pid: 80142|app: 0|req: 1449/2921] 10.222.0.70 () {60 vars in 1365 bytes} [Mon Aug 1 14:41:19 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 01 14:41:30.124369 dv-cinder-845990-5-smb devstack@keystone.service[80142]: DEBUG dbcounter [-] [80142] Writing DB stats keystone:SELECT=89 {{(pid=80142) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}